Tag Archives: elections

Review: The Victory Lab by Sasha Issenberg

Attending a seminar about turnout of young voters in Norway at the Institute for Social Research, I am reminded of Sasha Issenberg’s excellent book The Victory Lab: The Secret Science of Winning Campaigns from last year. Here is a mini-review:

Great story of the work of political campaigns and political participation generally. Someone interested in applying the methods in another context, such as another country, must keep in mind how much they rely on the public voting files that give information of whether someone voted. Without these, the micro-targeting made possible by matching the voter records with consumer databases and census information would not be feasible, and it would make experimentation much more difficult. Recommended, but there is one thing that bothers me: The actual politics is often lost sight of. It would be great if these advances also could contribute to improving policy.

Below is a really long summary:

Introduction
-renewed interest in small improvements after narrow Bush election, etc.
-”crucial divide” … between “new empiricists and the old guard”
-Political consultant Mark Grebner contacted Gerber and Green. Sent people copy of their and their neighbour’s (public) voting histories before election, and said they would inform also about whether voted after election. Increased turnout by 20 %. Problem: Looked dirty/like blackmail. Solution through testing and trial and error: Use a more gentle tone. Also have it look more like information than advertising.
-The problematic story of data in Al Franken’s 2008 Minnesota Senate race. Because of a close initial margin (favoring Republican Coleman), a mandatory recount had to take place. Importantly, there were many votes that were wrongly rejected the first time. These, absentee (challenged), votes were now to be included, and Franken’s team identified those who were most likely to favor him, like those “challenged for change-of-address discrepancies (p 10),” got more of those opened, and carried the race. I do not understand why they did not draw a random sample of those challenged.
-Ch 1. How the field of political science failed to take the road of randomized field experiments.
-beginning of 20th century, political science emerged, and as direct primaries and elections became more common, a study began also of the voters, not only of institutions and parties, as previously. A key man was Gosnell, who in the 1920’s in Chicago experimented with different types of reminders to voters of a coming election. “Gosnell’s conclusions were obvious – mobilization efforts can have the biggest impact in places where little else is pushing voters to the polls – but no one had ever before quantified them (p. 26).” But although his method received a positive reception, the field of randomized field experiments did not take off. Instead the field of polling was developed to great sophistication, with especially the data gathered in what later became “American National Election Studies”.
-Ch 2. Increased focus on who to target – in particular getting out one’s own voters and convincing undecided. Vince Barabba merged socioeconomic information from the 1960 Census with political information to identify precincts where there might be swing voters. Sending letters to potential donors. Malchow arranged a large poll with few questions for Wyden’s campaign to get more disaggregated data. Argued for including controls groups, but met resistance, because the campaigns wanted everyone to be included. One of his workers, Anil Mammen: ““Convincing people to ignore people they would otherwise mail or contact people they would otherwise ignore is a major hurdle. You’re making an argument that’s counterintuitive and your evidence is something they haven’t seen before.”(p. 67)”
-Ch 3. Experiments of Green and Gerber. Shallow critique of rational choice models. Brief history of field experiments. From medicine. Tests of social programs under Lyndon B. Johnson, most famously the effect of a negative income tax: Randomization of bonus payments to low-income groups to look at labor supply effects-found … But not in elections and voting, a field GG went on and made their own. In the 1998 (uncompetitive) New Haven election, they randomized postcards, scripted calls and door knocks to 30 000 New Haven voters, each form of contact additionally containing different appeals. After the election they checked the public(?) individual voter histories and found that the scripted calls had no effect, postcards had almost none, whereas the individual visits had a huge impact, increasing average turnout by 8.7 %. A clear theoretical contribution was hard to formulate, but the practical implications for campaigners were clear.
-Ch 4. The Democrats developed field operations well in the 80’s and 90’s. Paul Tully lead the work in gathering data relevant for turnout, including precinct data from the Census. Taken up by the Republicans in the 00’s.
-Ch 5. The rise of polling, and then of large corporate databases. The Republican Gage in 2001 bought a large file with data on consumers, polled 5 000 of these with about 20 questions on political issues, then looked for connections between the personal and political variables and used what he found to microtarget messages. Developed further for Bush’s 2004 campaign, often targeted the voter with a message about the only issue that the voter agreed with the Republican party with. Also approached scientifically how to elicit anger with questions on that issue. Is is not really clear how the matching between the registries occurred? By name?
-Ch 6. How the geeks took over from the gurus. After 2000, some Democrats realized they were lagging behind. In the 2004 elections, a sample of 20 000 people formed a basis for experimentation with messages when combined with repeated polling and regular mailings. Showed whether people looked at the messages, what worked, and what worked with whom. Credit scores as a model. Emergence of the Analyst Group.
-Ch 7. The power of the social element and psychology. Todd Rogers drawing on Cialdini’s research, like “what he described as injunctive norms (“ you should not litter”) were far less effective at changing behavior than descriptive norms (“ few people litter”) (p. 186),” and towels in hotel rooms. Wanted to test this in the Democratic presidential campaign (for Wesley Clark), but it was decided that the candidate could not afford to leave out a control group of untreated. Later he got the chance in the gubernatorial elections in 2005, and learned that, contrary to the gurus’ opinion, warning about low turnout not effective, whereas emphasizing that others vote is. Grebner collaborated with Gerber and Green to send letters with information of subjects’ vote histories, cloaked in various terms, all of which created effects of 30+%.
-Ch 8. Republican consultant Dave Carney tinkers in various ways. One ex is different anti-Clinton mails, which was effective but not widely implemented in the 2006 presidential election because of fears of a clashback. Teamed up with Perry. Implemented win bonuses for those working for them. Later initiated a collaboration with G&G and two other academics, Daron Shaw and James Gimpel for the 2006 Texas gubernatorial race. They tested: TV ads at different amounts after matching similar media markets-found that had immediate effect that decayed; candidate visits-TV coverage had effect, personal visits had lasting effects. Conclude that tv advertising not very effective, contrary to conventional wisdom, as seen in the money allocated to it.
-Ch 9. The increasing sophistication of microtargeting. Young consultant Dan Wagner hired by Obama 2008 campaign. Database with more or less every American voter. Ken Strasma had been an early proponent of extrapolating political information about known populations to those with otherwise similar characteristics. Special challenges related to the caucuses. Matching people using several hundred consumer variables. Sophistication of Obamas’s primary campaign. Gathering of more and more data, implementation of competition between phone vendors and checking whether they did their job. People less honest when answering a volunteer than a paid call. Tracking of opinion shifts identifying “shifters” giving a more nuanced view of the undecided.
-Ch 10. Sophistication of Obama presidential campaign. Importance of good data from the field. Creation of canvassability, callability and answerability scores to help with this. Randomization of web page features and money requests- “A/B tests”. Demonstration of superiority of online ads and street teams over television for reaching young voters. Ability of the question ““Do you think your neighbors would be willing to vote for an African-American for president? (p. 296)” to pick out those for race was important.
-Epilogue. The social element of voting. Rogers’ experiment with mailing vote histories to people inspiring a follow-up by Malchow: First a phone call asking whether intended to vote, then those that said yes received a letter and then a robocall close to the election reminding them of the pledge – very effective, created new votes at 18 dollars each. Costas Panagopoulos’ experiments: Mailing people message that would publicize those who voted vs those who did not – the latter more effective; thanking those who voted in a previous election had effect; “honor roll” of people never having missed an election or thank you note – both effective. Gerber, intrigued by finding that many believed that the vote was not necessarily secret, found that mail with explanation of how it was kept secret increased turnout dramatically for registered voters that had not voted before. Malchow experimenting on ways to register new voters.

Voluntary registration, compulsory voting

During the dictatorship in Chile, the authorities sought to discourage political participation and implemented voluntary and cumbersome voter registration procedures. Together with compulsory voting rules already in place, this created the unique combination of voluntary registration and compulsory voting.

I learned this from a newly published paper (gated) by my friend Paulo Cox and his coauthor Alejandro Corvalan. If one guessed, e.g. on the basis of rational voter theory, that this rule would cause registration and turnout to plummet, one would be right. There is more to the story in Chile, though, as voters registered en masse to vote Pinochet out of power in 1988. After that, however, the prediction has it right, with the result of a gap in turnout of around 60% (ca 90-30) between older and younger voters in the 2009 election.

Corvalan and Cox’ main concern is the representativeness of the electorate, and they show that income is highly correlated with registering and voting among the young (when controlling for education, etc). As the young become old, this “class bias” might come to hold for all voters.

One person, one vote? Malapportionment in the Norwegian parliament

One person, one vote is a cherished principle, however, in most countries the representatives to the national legislative body come from certain fixed geographic regions. E.g., in the US Senators are elected from the states, while the  members of the House of Representatives come from a congressional district.

In Norway, each of the 169 representatives in parliament, the Storting, comes from one of 19 counties. At the heart of the distribution of seats is a weighted sum of the number of inhabitants of a county and its area, calculated as follows: #inhabitants+1.8 x area in sq.m. So 1 sq.m. counts as 1.8 person. This is a systematic overrepresentation of people in counties with relatively low population density and corresponding underrepresentation of people in more densely populated counties.

How does this play out in practice? For the elections in 2005 and 2009, the seat allocation was based on the inhabitant count as of 2004-01-01. Below I have plotted the number of representatives per inhabitant against the number of inhabitants for all the 19 counties. Counties with few inhabitants tend to have more representatives per inhabitants. The most Northern county, Finnmark, is the outlier, with more than double the number of seats per inhabitant as several other counties. (Or in other words: Fewer than half the number of people behind a representative.)

Norway 2005 and 2009

Due to migration within the country and a small reform, the allocation for the elections of 2013 and 2017 is shifted somewhat. More populous counties will now be a little less underrepresented: Norway 2013 and 2017

This topic is currently on my research agenda, so I will return to it in not too long. A seminal paper (pdf) by Samuels and Snyder,  more countries on Andrew Gelman’s blog, discussions of representation in the US Senate on CrookedTimber and in the New York Times

Update: for Norwegian readers: Discussions from the election in 2009, from Minerva, Aftenposten and Ferskvannsmandatet.