The simple truth of the allegedly “contested” Kenya 2007 exit poll–what IRI reported to USAID (FOIA series part 14, War for History series part 19)

Raila Odinga has a couple of times recently made conspicuous public mention of the Kenya 2007 IRI/USAID/UCSD exit poll results identifying him as the winning vote-getter, including in his speech at the tenth anniversary of the founding of the Orange Democratic Movement party a few days ago, as well as a significant discussion in his autobiography.

Even a year-and-a-half after the Kenyan election, in July 2009, Kenyan Ambassador to the United States Peter Ogego said at the National Endowment for Democracy in Washington that it was important to get to the bottom of the situation with the U.S.-sponsored exit poll indicating an Odinga rather than a Kibaki win.  The late Congressman Donald Payne, then Chairman of the House Foreign Affairs Subcommittee on Africa said at the same event that the poll should have been published sooner and that not releasing it had been a mistake, although IRI, he thought, had a “good reason” for not releasing it initially.  This is the basic structure of what actually happened, contra what IRI claimed in a March 29, 2009 “rebuttal” to the New York Times investigation. (My point here is still not to berate IRI for continuing to publish this defamatory material worldwide, but I have sadly come to realize that many people seem to have been, surprisingly to me, actually misled by at least some of it.)

On Monday, January 14, 2008 the International Republican Institute’s Coalition for Electoral and Political Process Strengthening (CEPPS) manager submitted by email to USAID at 6:25pm our formal Quarterly Report on the Kenya polling program.  The program had begun with an exit poll for the 2005 constitutional referendum and was scheduled to end with our final pre-election public opinion survey in September 2007, but an amendment that September added the exit poll for the 2007 general election.

Here is this January 14, 2008 report as released under the Freedom of Information Act:

CEPPS IRI Kenya 8038_Oct-Dec 2007

In the report, we at IRI wrote:

Implementation of the December 2007 General Elections Exit Poll
IRI initiated discussions on the exit poll to be conducted during the December 2007 general elections. IRI reviewed the survey instruments, deployment plans, and schedules. Discussions between IRI, USAID, and the local polling firm, Strategic Public Relations and Implementation of the December 2007 General Elections Exit Poll
Research (“Strategic”), took place. Researchers from the University of California at San Diego also partnered with IRI to advise on the sample design, methodology, and data analysis, which they are using for independent studies on polling.

Training of Researchers
In consultation with IRI, Strategic conducted training sessions for the researchers collecting exit poll data. As with the previous polls, Strategic trained a number of researchers, who later deployed to the field as trainers of trainers (TOTs) to identify and train research assistants that would be used to collect data.

The training reviewed field resource management techniques, sampling, and interviewing techniques, as well as training to ensure that all staff had a good understanding of the questionnaire. The questionnaire was then pre-tested in various constituencies of Nairobi. The interviewers later met for a debrief and assessment of the pre-test before deploying nationally.

Data Collection

The poll was fielded on election day in Kenya, December 27, 2007.  A group of 2,887 researchers from Strategic deployed in teams to 175 of 210 constituencies, covering all eight provinces of Kenya.

The interviewers were expected to carry out interviews approximately 100 meters from polling stations.  The interviews were limited to people that had just voted, and the administration of the questionnaire varied from less than five to seven minutes.  To ensure the validity of the sample, between 15 to 25 interviews were conducted at selected polling stations, and only every fifth voter was asked to participate.  Strategic supervisors accompanied researchers to ensure the accuracy of reporting on a number of questionnaires.  Researchers relayed immediate results to their direct supervisors, who then called in to Strategic’s data processing center in Nairobi.

Challenges

During the implementation of the poll, researchers encountered certain challenges, such as the inaccessibility of some areas due to poor roads; poor network coverage; and hostility from polling officials and respondents.  In one instance, a researcher’s questionnaires were confiscated by a polling official.  However, these issues did not significantly affect the data collection exercise.  (emphasis added).

Data Analysis

As data was collected, it was immediately relayed to Strategic headquarters for compilation.  However, data analysis for the exit poll was still ongoing through the end of this quarter. (through December 31)

Earlier that Monday the McClatchy newspapers ran Shashank Bengali’s story “Kenyan president lost election according to U.S. exit poll”. 

Continue reading