Wednesday, March 28, 2007

IRRELEVANT EXPERTISE: WHAT HAPPENS WHEN YOU CONSULT A ZOOLOGIST ABOUT STATISTICS

We read:

The British government was advised against publicly criticising a report estimating that 655,000 Iraqis had died due to the war, the BBC has learnt. Iraqi Health Ministry figures put the toll at less than 10% of the total in the survey, published in the Lancet. But the Ministry of Defence's chief scientific adviser said the survey's methods were "close to best practice" and the study design was "robust".

The Lancet medical journal published its peer-reviewed survey last October. It was conducted by the John Hopkins School of Public Health and compared mortality rates before and after the invasion by surveying 47 randomly chosen areas across 16 provinces in Iraq.

Shortly after the publication of the survey in October last year Tony Blair's official spokesperson said the Lancet's figure was not anywhere near accurate. He said the survey had used an extrapolation technique, from a relatively small sample from an area of Iraq that was not representative of the country as a whole.

But a memo by the MoD's Chief Scientific Adviser, Sir Roy Anderson [A zoologist], on 13 October, states: "The study design is robust and employs methods that are regarded as close to "best practice" in this area, given the difficulties of data collection and verification in the present circumstances in Iraq."

To see what statisticians experienced in the research method concerned say, see here and here. I am myself a much published user of that research method and I made the following comments last year:

None of the comments I saw appeared to be by people who are experienced users of cluster sampling -- the method used for the Lancet study. I am a VERY experienced user of cluster sampling -- with many of my academic publications based on it. And the glaring error which rather explains why the study appeared in a medical journal rather than a more statistically sophisticated journal is that there was NO VALIDATION of the survey results. That your survey-takers might just sit down under a tree and "make up" their "interview" results is a routine peril and it is routine to take precautions against it -- usually by going back on a later occasion and checking with the alleged respondents a proportion of all interviews handed in. Just the awareness that a sample of the respondents will be re-interviewed tends to keep the interviewers honest -- though not always so, regrettably. So the results reported in the Lancet study have no credibility at all and must be regarded as garbage.

It is astounding that the authors of the study were so naive. Perhaps they WANTED their interviewers to "fudge" the results -- making clear what the desired results would be, of course.

Another oddity in the Lancet article that suggests something peculiar about the authors is the claim that their interviewers were all DOCTORS -- and not just any doctors but doctors bilingual in Arabic and English. I have never seen the like of that before. Experienced interviewers of some kind were what was needed and that is what is usually used, not doctors. Can we really believe that a whole corps of these rare doctors abandoned their medical duties for so long in order to do something outside their normal expertise? If true it certainly suggests a heavy political committment on the part of the doctors concerned -- exactly what one would NOT want in a study claiming to be objective. To me the whole claim seems like the sort of "gilding the lily" that con-men engage in.

Other critics have noticed other vast implausibilities in the results reported -- the amazingly high (98%) success-rate at getting people to consent to an interview, for instance --- garbage, garbage garbage. And the lie about the death certificates actually shows how bogus the results were.

"Those guys were not even trying to do real research. It was just a propaganda circus. I strongly support Moore's point about the survey's lack of demographic information. That is so unthinkable in survey research that the article would never have been published in an academic journal that knew anything about survey research. The Lancet should stick to medicine.

And as Iraq Body Count note:

"Between January and June 2006, there were 91 violent deaths recorded by the Lancet survey. This would correspond to over 180,000 deaths in the first 6 months of 2006, and an average rate of 1,000 per day. The daily death rate over the same period based on UN reports (which sum Baghdad morgue and Ministry of Health data) is 80 violent deaths per day. Cumulated media reports provide a somewhat lower figure. If the Lancet extrapolation is sound, this would imply a further 920 violent deaths every day (1000 minus 80) which have been recorded by neither officials nor the media. As these are averages, some days would see many more deaths, and others substantially fewer, but in either case, all of them would remain unnoticed."

*****************

ELSEWHERE

Democrat corruption coverup?: "Democrats promised reform and instituted "a moratorium" on all earmarks until the system was cleaned up. Now the appropriations committees are privately accepting pork-barrel requests again. But curiously, the scorekeeper on earmarks, the Library of Congress's Congressional Research Service (CRS)--a publicly funded, nonpartisan federal agency--has suddenly announced it will no longer respond to requests from members of Congress on the size, number or background of earmarks. "They claim it'll be transparent, but they're taking away the very data that lets us know what's really happening," says Oklahoma Sen. Tom Coburn. "I'm convinced the appropriations committees are flexing their muscles with CRS."

America's coming tax disaster: "Earlier today, I wrote a post discussing the Democrats proposed budget for next year. I briefly mentioned that this proposal is a sham to the American taxpayer. Having now listened throughout the day to their acrobatic attempts to justify it, I wanted to specifically tell you why it is so bad. Here we go... Their budget proposes the largest tax increase in American history - The Democrat's budget calls for a tax increase of every tax bracket, slashes the child tax credit, raises the death tax, and reinstates the marriage penalty. And this is just a sampling, there is more. In all, the Democrat's plan will cost taxpayers over $390 billion in the next 5 years. What is particularly frustrating about this ill-advised action is that the Democrats are blatantly ignoring the economic consequences and fiscal benefits that lower taxes have brought to the treasury the past few years. Revenue has increased in double digits the last two years alone because of the economic expansion encouraged by reduced taxation. This revenue growth has been crucial in reducing the deficit. The Democrats refuse to recognize this, though, and instead they just want to tax us to death. This is a recipe for disaster."

The media don't have a clue: "Noemie Emery has a great column in The Weekly Standard that rips Time magazine for its assessment of the current Administration and conservatism. In "How the Right Went Wrong", the writers at Time seem to have conveniently forgotten how, in a similar analysis done toward the end of the Reagan's Presidency (1987), they unanimously dismissed his legacy; while in the new article, they wax nostalgic about what a great man Reagan was; a beacon of purpose and clarity, a statesman of genuine vision and character, dwarfing the pygmies who have frittered away his inheritance."

No Leftist "liberation" campaign for Zimbabwe?: "This puzzle of the heartless Left came into focus tonight when I watched Abdel Bari Atwan of Al Quds newspaper claim on another BBC show that the problems of Zimbabwe stem solely from the sanctions imposed by Britain and America. America, apparently, was to blame for the Mugabe regime's policy of burning farms and the replacing white farmers with incompetent cronies that has sowed famine and economic catastrophe in a once-fertile land. This is a sorry state of affairs. The same Left that rails against Israel and the United States and organizes marches for the "liberation" of Palestine will not acknowledge the political crisis in Zimbabwe because it would mean siding with America."

For more postings from me, see TONGUE-TIED, EDUCATION WATCH, GREENIE WATCH, POLITICAL CORRECTNESS WATCH, GUN WATCH, SOCIALIZED MEDICINE, FOOD & HEALTH SKEPTIC, AUSTRALIAN POLITICS, IMMIGRATION WATCH and EYE ON BRITAIN. (Mirror sites here, here, here, here, here, here, here and here).

**************************

"Why should the German be interested in the liberation of the Jew, if the Jew is not interested in the liberation of the German?... We recognize in Judaism, therefore, a general anti-social element of the present time... In the final analysis, the emancipation of the Jews is the emancipation of mankind from Judaism.... Indeed, in North America, the practical domination of Judaism over the Christian world has achieved as its unambiguous and normal expression that the preaching of the Gospel itself and the Christian ministry have become articles of trade... Money is the jealous god of Israel, in face of which no other god may exist". Who said that? Hitler? No. It was Karl Marx. See also here and here.

The Big Lie of the late 20th century was that Nazism was Rightist. It was in fact typical of the Leftism of its day. It was only to the Right of Stalin's Communism. The very word "Nazi" is a German abbreviation for "National Socialist" (Nationalsozialistisch) and the full name of Hitler's political party (translated) was "The National Socialist German Workers' Party".

Comments? Email me here (Hotmail address). If there are no recent posts here blame Blogger.com and visit my mirror site here or here. My Home Pages are here or here or here

****************************

No comments: