The simple truth of the allegedly “contested” Kenya 2007 exit poll–what IRI reported to USAID (FOIA series part 14, War for History series part 19)

Raila Odinga has a couple of times recently made conspicuous public mention of the Kenya 2007 IRI/USAID/UCSD exit poll results identifying him as the winning vote-getter, including in his speech at the tenth anniversary of the founding of the Orange Democratic Movement party a few days ago, as well as a significant discussion in his autobiography.

Even a year-and-a-half after the Kenyan election, in July 2009, Kenyan Ambassador to the United States Peter Ogego said at the National Endowment for Democracy in Washington that it was important to get to the bottom of the situation with the U.S.-sponsored exit poll indicating an Odinga rather than a Kibaki win.  The late Congressman Donald Payne, then Chairman of the House Foreign Affairs Subcommittee on Africa said at the same event that the poll should have been published sooner and that not releasing it had been a mistake, although IRI, he thought, had a “good reason” for not releasing it initially.  This is the basic structure of what actually happened, contra what IRI claimed in a March 29, 2009 “rebuttal” to the New York Times investigation. (My point here is still not to berate IRI for continuing to publish this defamatory material worldwide, but I have sadly come to realize that many people seem to have been, surprisingly to me, actually misled by at least some of it.)

On Monday, January 14, 2008 the International Republican Institute’s Coalition for Electoral and Political Process Strengthening (CEPPS) manager submitted by email to USAID at 6:25pm our formal Quarterly Report on the Kenya polling program.  The program had begun with an exit poll for the 2005 constitutional referendum and was scheduled to end with our final pre-election public opinion survey in September 2007, but an amendment that September added the exit poll for the 2007 general election.

Here is this January 14, 2008 report as released under the Freedom of Information Act:

CEPPS IRI Kenya 8038_Oct-Dec 2007

In the report, we at IRI wrote:

Implementation of the December 2007 General Elections Exit Poll
IRI initiated discussions on the exit poll to be conducted during the December 2007 general elections. IRI reviewed the survey instruments, deployment plans, and schedules. Discussions between IRI, USAID, and the local polling firm, Strategic Public Relations and Implementation of the December 2007 General Elections Exit Poll
Research (“Strategic”), took place. Researchers from the University of California at San Diego also partnered with IRI to advise on the sample design, methodology, and data analysis, which they are using for independent studies on polling.

Training of Researchers
In consultation with IRI, Strategic conducted training sessions for the researchers collecting exit poll data. As with the previous polls, Strategic trained a number of researchers, who later deployed to the field as trainers of trainers (TOTs) to identify and train research assistants that would be used to collect data.

The training reviewed field resource management techniques, sampling, and interviewing techniques, as well as training to ensure that all staff had a good understanding of the questionnaire. The questionnaire was then pre-tested in various constituencies of Nairobi. The interviewers later met for a debrief and assessment of the pre-test before deploying nationally.

Data Collection

The poll was fielded on election day in Kenya, December 27, 2007.  A group of 2,887 researchers from Strategic deployed in teams to 175 of 210 constituencies, covering all eight provinces of Kenya.

The interviewers were expected to carry out interviews approximately 100 meters from polling stations.  The interviews were limited to people that had just voted, and the administration of the questionnaire varied from less than five to seven minutes.  To ensure the validity of the sample, between 15 to 25 interviews were conducted at selected polling stations, and only every fifth voter was asked to participate.  Strategic supervisors accompanied researchers to ensure the accuracy of reporting on a number of questionnaires.  Researchers relayed immediate results to their direct supervisors, who then called in to Strategic’s data processing center in Nairobi.

Challenges

During the implementation of the poll, researchers encountered certain challenges, such as the inaccessibility of some areas due to poor roads; poor network coverage; and hostility from polling officials and respondents.  In one instance, a researcher’s questionnaires were confiscated by a polling official.  However, these issues did not significantly affect the data collection exercise.  (emphasis added).

Data Analysis

As data was collected, it was immediately relayed to Strategic headquarters for compilation.  However, data analysis for the exit poll was still ongoing through the end of this quarter. (through December 31)

Earlier that Monday the McClatchy newspapers ran Shashank Bengali’s story “Kenyan president lost election according to U.S. exit poll”. 

Continue reading

Provocative Question: To Eliminate Redundancy, Should We Move USAID from DOS to DOD?

In this era of perceived relative austerity in U.S. public budgeting, there is much discussion about (1) cutting “foreign aid” and (2) addressing redundancy in federal spending. One obvious area of redundancy in terms, at least, of conceptual capacity and planning, is in the foreign assistance area where the lead agency is said to be the State Department in some cases, and in others USAID as a partially independent but intertwined organization funded through the State Department. At the same time, the Department of Defense, as part of military doctrine, aspires to maintain a parallel capacity to conduct reconstruction and development functions–and is often the “go to” agency for aspects of humanitarian/disaster relief in places like Indonesia, Haiti and New Orleans.

The basic doctrine is that the military services need to be ready to step in where civilian capacity is insufficient or simply fails (as in dealing with the situation when the Coalition Provisional Authority closed up shop in Iraq in 2004).

Redundancy has costs and benefits–there is a positive value to having “excess” capacity in terms of risk mitigation. On the other hand, there may be some downside from difficulties in coordination, moral hazard associated with having someone else available to “bail out” failure, etc. On balance, I think it is a net positive to have redundant development/assistance capacity. This is a bit like the much discussed and debated “extra engine” for the military Joint Strike Fighter program–there is some reduction in risk to have two engines in development at the same time to do the same thing. The question is one of efficiency and affordability.

In an era of cuts to assistance, it probably is not efficient enough to warrant duplicate capacity with the U.S. government.  Thus we should chose which basket to put our eggs into.

Personally, I am well persuaded that the national security triad (or “three-legged stool”) of Defense, Development and Diplomacy would be most efficiently and effectively handled through having USAID or a similiar agency operate as an independent “step sister” agency, rather than as a branch off one of the other legs of the stool. If that is not politically feasible, or there is not political will or courage to try it, and we are tasked with eliminating redundancy to maximize effectiveness with more limited dollars, we need to ask whether to continue with the current structure and try to eliminate funding for development within DOD and perhaps shift some of the savings to the DOS complex, or to simply consolidate the work in DOD.

At present we are more than two years into the Obama Administration and there is still no nominee for USAID Assistant Administrator for Africa.  In the meantime, AFRICOM has extensive support from USAID as described by testimony to Congress last summer by a USAID Deputy Assistant Administrator about national security and interagency collaboration:

The Africa Command, or AFRICOM, provides another example of where strong interagency partnership from its inception has advanced U.S. national security interests. Beginning in 2007, USAID staff in Africa was engaged in helping DOD plan U.S. Africa Command. As AFRICOM developed from a concept similar to the SOUTHCOM model to an independent command, USAID was engaged with counterparts in the Defense Department at every step in the process. AFRICOM was intended to bring together U.S. military assets devoted to Africa’s security in one unified command, but the mandate and operation of the command were the subject of lively interagency debate prior to its establishment. Our first senior development advisor, assigned to the European Command, or EUCOM, in 2007, was actively involved in the process. Other USAID officers, including senior career and political leadership, helped General Ward and his staff to define AFRICOM’s mandate, coordination mechanisms, and civilian roles in the Command, as well as shaping the Command to focus on its central priority of building the capacity of African military institutions. This resulted in the establishment of a USAID senior development advisor position at the command as well as detailing two USAID representatives to the command, one to direct the Programs Division and the other to manage their Humanitarian and Civic Assistance programs and funds. Subsequently, a representative of USAID’s Office of Foreign Disaster Assistance was assigned to the command.

As AFRICOM has stood up and developed its relationships with interagency partners, and senior Command officials have sought to forge strong ties with USAID. Developing capable and rightly-structured militaries in Africa is absolutely essential for Africa’s development and stability and AFRICOM plays an important role in enhancing the capacity of Africa’s military. We support and emphasize this crucial core function of AFRICOM in the interagency and in discussions in Stuttgart. At the same time, there are other areas where USAID and AFRICOM work closely and effectively together.

AFRICOM leadership has pressed for significant participation and officer exchanges with USAID, in general, for more positions than our small agency can provide. USAID officers in AFRICOM — at the level of the Commander, the Plans and Program Directorate, and Disaster Response unit — have both helped “shape” this new Command and improved the Command’s civil affairs and humanitarian programs and their intended audience, and interagency collaboration in strategic, conflict-prone areas, and in disaster response.

Perhaps the best example of USAID’s effect upon the Command has been where AFRICOM’s office overseeing funding for development projects or what the military refers to as “humanitarian assistance,” our representative has repeatedly proven the value of having a development advisor in this position. That officer has reshaped the provision of AFRICOM humanitarian assistance to be more effective and sustainable based on AFRICOM’s expertise in this area. Most recently, her efforts were recognized when she won a “dissent” award from the American Foreign Service Association for her contribution to the dialogue about the Defense Department’s proposed programs in the area of women’s health. USAID also actively participates in logistics cooperation training which illustrates a cohesive approach to coordination at all levels.

Realistically, isn’t it more feasible politically to consolidate the functions in DOD rather than DOS to maintain bi-partisan support for funding?  Isn’t the reality that the DOD function is the stronger bureaucratic player and will find ways to continue its own programs and capacity regardless? For instance, would a key appointment in a military combatant command such as AFRICOM remain unfilled for over two years?

Is it the case, cosmetics of “hard power” and “soft power” aside, that Development has more overlap with Defense than with Diplomacy anyway if it can’t stand on its own?

AFRICOM and the “Whale of Government” Approach

Special Inspector General on Iraq Democracy Grants to IRI and NDI

“During our review of the costs for seven grants, we found that only 41% of
the grant funds were actually spent on direct program activities. More than
60% of IRI’s expenditures and almost 50% of NDI’s expenditures were for
security and overhead costs; mostly security. NDI spent almost one third of
its funds on security, and IRI spent more than one half of its funds on
security. Thus, only approximately $47 million of the approximately
$114 million was spent on direct program activities.”

The overall subject of the audit was almost $250M in grants to have been supervised by the State Department’s Bureau of Democracy, Human Rights & Labor.  Hugely dislocating sums relative to what the US spends on democracy work in places like Kenya.  Sudan was number two while I was at IRI, but Iraq was by far the largest dollar program, and surely the “bill payer” for Washington overhead.

On The Cable blog at Foreign Policy Josh Rogin reported the release, and was promptly insulted by a commenter, in much the same terms used to insult New York Times reporters Mike McIntire and Jeffrey Gettleman for writing about IRI’s Kenya exit poll fiasco (see Page “The Kenyan Election and the US Exit Poll” above, and Documents and Stories links on your right). The personal insults were immediately preceded by “IRI” posting a link to IRI’s  response to the audit.

The whole report is here: SIGIR: DOS Grant Management–Limited Oversight of IRI, NDI Grants