The Cellar

The Cellar (http://cellar.org/index.php)
-   Current Events (http://cellar.org/forumdisplay.php?f=4)
-   -   $27 million anti-evolution museum to open soon (http://cellar.org/showthread.php?t=13676)

Spexxvet 03-29-2007 09:01 AM

Quote:

Originally Posted by TheMercenary (Post 327776)
Come on, you know polls have little to no statistical validity.

True - take the 2000 presidential election, for example.

TheMercenary 03-29-2007 09:03 AM

Quote:

Originally Posted by Spexxvet (Post 327815)
True - take the 2000 presidential election, for example.

Elections and Polls are not the same, sorry to burst your bubble on that one. :handball:

elSicomoro 03-29-2007 09:19 AM

Quote:

Originally Posted by TheMercenary (Post 327814)
Ok pick a poll that has original data which we can inspect and we can pick it apart. The point here is that you rarely if ever can see how or where the data was gathered. I spend part of my job reading original source research. You have to know how to find the weaknesses before you accept the data. And the validity would increase as multiple researchers are able to replicate the data you gathered in exactly the same manner. You rarely have access to how polling data is gathered, therefore the research cannot be properly evaluated.

I have experience in both social and physical science research and am familiar with poll development. I understand what you are saying. While I don't think that polls get it right all the time, the major ones (Gallup, Zogby, etc.) seem to have taken great pains to be more transparent in their polling. For example...from this Gallup poll:

Results are based on telephone interviews with 1,007 national adults, aged 18 and older, conducted March 23-25, 2007. For results based on the total sample of national adults, one can say with 95% confidence that the maximum margin of sampling error is ±3 percentage points. In addition to sampling error, question wording and practical difficulties in conducting surveys can introduce error or bias into the findings of public opinion polls.

If you see more into it than I do, and would prefer raw data, that's all well and good. From what I'm seeing, this is a pretty solid poll...99% confidence would be nice, but 95% is usually a fair standard for statistical significance. And I don't have a reason to suspect that Gallup is trying to manipulate numbers for some sort of advantage or benefit.

TheMercenary 03-29-2007 09:23 AM

Quote:

Originally Posted by sycamore (Post 327831)
I have experience in both social and physical science research and am familiar with poll development. I understand what you are saying. While I don't think that polls get it right all the time, the major ones (Gallup, Zogby, etc.) seem to have taken great pains to be more transparent in their polling. For example...from this Gallup poll:

Results are based on telephone interviews with 1,007 national adults, aged 18 and older, conducted March 23-25, 2007. For results based on the total sample of national adults, one can say with 95% confidence that the maximum margin of sampling error is ±3 percentage points. In addition to sampling error, question wording and practical difficulties in conducting surveys can introduce error or bias into the findings of public opinion polls.

If you see more into it than I do, and would prefer raw data, that's all well and good. From what I'm seeing, this is a pretty solid poll...99% confidence would be nice, but 95% is usually a fair standard for statistical significance. And I don't have a reason to suspect that Gallup is trying to manipulate numbers for some sort of advantage or benefit.

Good stuff. The only thing that I wonder, and I don't know this, are not poll organizations hired by groups to study data? Is there no potential for bias? The greatest weakness is not only in the regularly small sample size, for example I would hardly say that 1000 people with telephones represent and extrapolation to "most people think...", but the weakness in buried in the questions and how they are constructed.

Shawnee123 03-29-2007 09:58 AM

:rolleyes:
Quote:

Originally Posted by TheMercenary (Post 327798)
Statistics, lies, and more statistics.

Such as "4 out of 5 dentists recommend Crispy Toothpaste." They don't tell you they asked 10 dentists, none of whom had teeth.

TheMercenary 03-29-2007 09:59 AM

Quote:

Originally Posted by Shawnee123 (Post 327868)
:rolleyes:

Such as "4 out of 5 dentists recommend Crispy Toothpaste." They don't tell you they asked 10 dentists, none of whom had teeth.

See my teeth?:D

elSicomoro 03-29-2007 10:16 AM

Quote:

Originally Posted by TheMercenary (Post 327835)
Good stuff. The only thing that I wonder, and I don't know this, are not poll organizations hired by groups to study data? Is there no potential for bias? The greatest weakness is not only in the regularly small sample size, for example I would hardly say that 1000 people with telephones represent and extrapolation to "most people think...", but the weakness in buried in the questions and how they are constructed.

I don't know either...I would suspect so. The 5% should cover most bias, though they have the disclaimers. As far as extrapolation, I guess it would depend on how they figure out who they're going to call...I don't know how they're doing that.

TheMercenary 03-29-2007 10:22 AM

Quote:

Originally Posted by sycamore (Post 327878)
I don't know either...I would suspect so. The 5% should cover most bias, though they have the disclaimers. As far as extrapolation, I guess it would depend on how they figure out who they're going to call...I don't know how they're doing that.

Agreed. And then the press picks up a result and runs with it. And then it is exploited by one group or another.:worried:

elSicomoro 03-29-2007 10:38 AM

I think that's just the nature of people though..."God is on our side." Who likes being wrong? If you can find the smallest shred of evidence to prop yourself up on, whoohoo!

Sundae 03-29-2007 10:41 AM

I have never been asked my opinion for a poll :(
(apart from on here, where I consider myself a minority anyway)

glatt 03-29-2007 10:43 AM

Are telephone pollsters exempt from the Do-Not-Call lists? I think they are.

My wife will always stay on the line and do a poll, even if it takes like 20 minutes. I'll sometimes do one, if it's around an election and I want to skew poll results towards liberal, but normally I won't do them.

Happy Monkey 03-29-2007 10:44 AM

I've answered a few poll questions that seemed to veer into product promotion...

TheMercenary 03-29-2007 10:46 AM

Quote:

Originally Posted by glatt (Post 327908)
Are telephone pollsters exempt from the Do-Not-Call lists? I think they are.

My wife will always stay on the line and do a poll, even if it takes like 20 minutes. I'll sometimes do one, if it's around an election and I want to skew poll results towards liberal, but normally I won't do them.

And there you have another source of a polls significant weakness. I say this because I have done the same thing.

elSicomoro 03-29-2007 10:50 AM

I think I was called when I lived in Philly...I enjoyed doing it, and answered all the questions as truthfully as I could. The poll questions seemed sound...no leading that I could tell.

Clodfobble 03-29-2007 10:55 AM

We were called 2 or 3 times for Gallup polls around the last election, and I get a call for a product survey every three months or so.

Political organizations and charities don't have to abide by the DoNotCall list (which we're on), and I'm pretty sure marketing surveys don't either since they're not directly trying to sell you their product.


All times are GMT -5. The time now is 06:19 PM.

Powered by: vBulletin Version 3.8.1
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.