Tag Archives: research

An experiment on how to improve journal referee speed

Chetty, Saez and Sandor have experimented on the referees of the Journal of Public Economics. They find that somewhat unsurprisingly that shorter deadlines, cash incentives and social incentives make referees faster. Further, cash does not crowd out intrinsic motivation, report quality is unaffected, and spillovers on other referee activites are small or nonexistent. They do note that “[O]f course, referees must forego or postpone some activity to prioritize submitting referee reports. The social welfare impacts of our treatments depend on what activities get displaced.” To the extent that it is just procrastination that is crowded out, the conclusions could be even more positive.

H/t: @JFiva

The persistent effect of affirmative action

Conrad Miller from MIT finds in his job market paper that US affirmative action regulation introduced from 1979 onwards had substantial effect on the black share of employees, also after deregulation. The exogenous variation comes from “changes in employers’ status as a federal contractor” and the fact that it was only federal contractors who were subject to these regulations. To get at the full dynamic effect of the regulation, Miller does not stop at comparing employers when they switch contractor status, but exploits also variation in when the firms are contractors for the first or the last time. In this way he can estimate whether there is a (persistent) causal effect also after a firm has lost his status as a federal contractor (has become “deregulated”). 

The event study results are striking: Miller2014Persistenteffectsofaffermativeactionfigure2eventstudies

Figure 2 Event studies, from Miller 2014 The persistent effect of temporary affirmative action

The effect is quite small – becoming a contractor on average increases an establishment’s black share of around 0.15 percentage points per year – but the key point is that it persists, even when the firm is no longer is a contractor. There is much more in the paper, including a proposed explanation in terms of employers being induced to improve their screening procedures for potential employees.

Enhanced by Zemanta

Hell is unhappiness

Religious beliefs have been associated with happiness, but psychologists Shariff and Aknin (PLOS ONE) take a more disaggregated look:

They construct life satisfaction and daily affect measures from the Gallup World Poll and put it together with country-level beliefs in Heaven and Hell from the World Values Survey and the European Values Survey. Believing in Heaven is associated with greater well-being, believing in Hell with lower. This cross-national comparison shows the relationship between aggregate measures of daily well-being and “the percentage of population that believes in Heaven minus percentage that believes in Hell”:

There are also some regression results controlling for some things.

What is the causality? Shariff and Aknin also conduct an experiment on Amazon’s Mechanical Turk: People primed to think of Hell by writing a short paragraph about it reported lower happiness and positive emotions and higher sadness, fear and negative emotions afterwards compared to people writing about Heaven or an unrelated topic. The Heaven group or the control group did not differ from each other.

H/t: Kevin Lewis

The effect of football on work motivation and well-being

“Is soccer good for you? The motivational impact of big sporting events on the unemployed” is an article in Economic Letters (ungated) by Philipp Doerrenberg and Sebastian Siegloch at IZA that I believe a lot of people wished they had written. The authors analyze the effect of the Euro Cup and the World Cup on the unemployed in Germany:

We examine the effect of salient international soccer tournaments on the motivation of unemployed individuals to search for employment using the German Socio Economic Panel 1984–2010. Exploiting the random scheduling of survey interviews […] We show that respondents who are interviewed after a tournament have an increased motivation to work but, at the same time, request higher reservation wages. Furthermore, the sporting events increase the perceived health status as well as worries about the general economic situation. We also find effects on the subjective well-being of men.

The unemployed are made more motivated to work and more worried, and to perceive themselves as being healthier, but men’s well-being is decreased. Ht: Kevin Lewis.

When are children most physically active?

Glen Nielsen measured children’s movement using accelerometers – devices measuring the number and strength of the children’s accelerations – for his PhD project. ScienceNordic reports that the children exhibited the most intense physical activity during free play rather than organized sport. I am a supporter of organized sport for many different reasons, but it is important to let children’s areas allow them to create their own exercise, such as tree-climbing, football, and other types of games.

H/t: Merete Lund Fasting writing in Aftenposten

Ragnar Frisch on economic planning

Ragnar Frisch in the early 1960’s had high hopes for future Soviet economic development:

The blinkers will fall once and for all at the end of the 1960s (perhaps before). At this time the Soviets will have surpassed the US in industrial production. But then it will be too late for the West to see the truth. (Frisch 1961a)

That is from an article by Sæther and Eriksen in the new Econ Journal Watch. The paper contains much more than this angle.

It must be said that it was quite common for economists at the time to believe that the Soviet Union had a sustainable system. For instance Paul Samuelson, who repeatedly pushed his predictions for when the American GNP would be overtaken by the Soviet GNP further into the future. If anyone knows about any modern Norwegian debate about this, I would be interested to learn about it.

H/t: MR, Arnold Kling.

 

 

Children and happiness

Contemplating whether or the number of children to have? Take a look at “A Global Perspective on Happiness and Fertility” by Margolis and Myrskylä. The authors use data from 25 years of the World Value Survey, totalling 86 countries and over 200 000 respondents. They are interested in what the relation between what people answer on the question “Taking all things together, would you say you are very happy, quite happy, somewhat happy, or not at all happy?” and their number of children.

Margolis and Myrskylä find that a higher number of children is associated with lower happiness, but stress that looking at this in the aggregate is highly misleading. This is shown by breaking the data down by subcategories and plotting the results. In particular, they “find that the association between happiness and fertility evolves from negative to neutral to positive above age 40,” as shown e.g. here:

NIHMS369453.html

FIGURE 3 Happiness and number of children by age and sex, from Margolis, R. and Myrskylä, M. (2011), A Global Perspective on Happiness and Fertility. Population and Development Review, 37: 29–56. doi: 10.1111/j.1728-4457.2011.00389.x

So more children may pay off in the long run. Though it must be said that this is just descriptive, but valuable and interesting nevertheless. There are more graphs like this one, and the results can be understood simply by looking at the graphs.

With also the recent report that “economists with two or more kids tend to produce more research, not less, than their one-child or childless colleagues” in hand and just having achieved the second, I am expecting a short-term boost in productivity and long-term in happiness.

Do thought experiments in ethics have external validity?

A runaway train car is on its way to kill five people on the tracks. You have the power to direct it to a sidetrack on which there is only one person. Do you do it?

A well known thought experiments in ethics. However, will people’s judgments when thinking about such cases transfer to the real world? A group of researchers constructed virtual realities to improve the realisticness of the scenarios. Their finding: People acted in a more utilitarian way (sacrifice the one to save the five) in the virtual reality than in the text case. The virtual reality scenarios were deemed to be more emotionally arousing as measured by skin conductance.

H/t: Gary King

(Note: Very small sample size – 38.)

Welfare helps the children of the poor and unemployed

That may sound obvious, but debates about welfare too often focus on the worthiness of the recipients, i.e. the adults. 

Matt Yglesias summarises a recent academic study of a cash transfer scheme that took place during the Great Depression in the US. Kids of mothers who received cash transfers went on to earn more, live longer, have better health and obtain more schooling. These were really long-term – lifetime – outcomes. 

Review: The Victory Lab by Sasha Issenberg

Attending a seminar about turnout of young voters in Norway at the Institute for Social Research, I am reminded of Sasha Issenberg’s excellent book The Victory Lab: The Secret Science of Winning Campaigns from last year. Here is a mini-review:

Great story of the work of political campaigns and political participation generally. Someone interested in applying the methods in another context, such as another country, must keep in mind how much they rely on the public voting files that give information of whether someone voted. Without these, the micro-targeting made possible by matching the voter records with consumer databases and census information would not be feasible, and it would make experimentation much more difficult. Recommended, but there is one thing that bothers me: The actual politics is often lost sight of. It would be great if these advances also could contribute to improving policy.

Below is a really long summary:

Introduction
-renewed interest in small improvements after narrow Bush election, etc.
-”crucial divide” … between “new empiricists and the old guard”
-Political consultant Mark Grebner contacted Gerber and Green. Sent people copy of their and their neighbour’s (public) voting histories before election, and said they would inform also about whether voted after election. Increased turnout by 20 %. Problem: Looked dirty/like blackmail. Solution through testing and trial and error: Use a more gentle tone. Also have it look more like information than advertising.
-The problematic story of data in Al Franken’s 2008 Minnesota Senate race. Because of a close initial margin (favoring Republican Coleman), a mandatory recount had to take place. Importantly, there were many votes that were wrongly rejected the first time. These, absentee (challenged), votes were now to be included, and Franken’s team identified those who were most likely to favor him, like those “challenged for change-of-address discrepancies (p 10),” got more of those opened, and carried the race. I do not understand why they did not draw a random sample of those challenged.
-Ch 1. How the field of political science failed to take the road of randomized field experiments.
-beginning of 20th century, political science emerged, and as direct primaries and elections became more common, a study began also of the voters, not only of institutions and parties, as previously. A key man was Gosnell, who in the 1920’s in Chicago experimented with different types of reminders to voters of a coming election. “Gosnell’s conclusions were obvious – mobilization efforts can have the biggest impact in places where little else is pushing voters to the polls – but no one had ever before quantified them (p. 26).” But although his method received a positive reception, the field of randomized field experiments did not take off. Instead the field of polling was developed to great sophistication, with especially the data gathered in what later became “American National Election Studies”.
-Ch 2. Increased focus on who to target – in particular getting out one’s own voters and convincing undecided. Vince Barabba merged socioeconomic information from the 1960 Census with political information to identify precincts where there might be swing voters. Sending letters to potential donors. Malchow arranged a large poll with few questions for Wyden’s campaign to get more disaggregated data. Argued for including controls groups, but met resistance, because the campaigns wanted everyone to be included. One of his workers, Anil Mammen: ““Convincing people to ignore people they would otherwise mail or contact people they would otherwise ignore is a major hurdle. You’re making an argument that’s counterintuitive and your evidence is something they haven’t seen before.”(p. 67)”
-Ch 3. Experiments of Green and Gerber. Shallow critique of rational choice models. Brief history of field experiments. From medicine. Tests of social programs under Lyndon B. Johnson, most famously the effect of a negative income tax: Randomization of bonus payments to low-income groups to look at labor supply effects-found … But not in elections and voting, a field GG went on and made their own. In the 1998 (uncompetitive) New Haven election, they randomized postcards, scripted calls and door knocks to 30 000 New Haven voters, each form of contact additionally containing different appeals. After the election they checked the public(?) individual voter histories and found that the scripted calls had no effect, postcards had almost none, whereas the individual visits had a huge impact, increasing average turnout by 8.7 %. A clear theoretical contribution was hard to formulate, but the practical implications for campaigners were clear.
-Ch 4. The Democrats developed field operations well in the 80’s and 90’s. Paul Tully lead the work in gathering data relevant for turnout, including precinct data from the Census. Taken up by the Republicans in the 00’s.
-Ch 5. The rise of polling, and then of large corporate databases. The Republican Gage in 2001 bought a large file with data on consumers, polled 5 000 of these with about 20 questions on political issues, then looked for connections between the personal and political variables and used what he found to microtarget messages. Developed further for Bush’s 2004 campaign, often targeted the voter with a message about the only issue that the voter agreed with the Republican party with. Also approached scientifically how to elicit anger with questions on that issue. Is is not really clear how the matching between the registries occurred? By name?
-Ch 6. How the geeks took over from the gurus. After 2000, some Democrats realized they were lagging behind. In the 2004 elections, a sample of 20 000 people formed a basis for experimentation with messages when combined with repeated polling and regular mailings. Showed whether people looked at the messages, what worked, and what worked with whom. Credit scores as a model. Emergence of the Analyst Group.
-Ch 7. The power of the social element and psychology. Todd Rogers drawing on Cialdini’s research, like “what he described as injunctive norms (“ you should not litter”) were far less effective at changing behavior than descriptive norms (“ few people litter”) (p. 186),” and towels in hotel rooms. Wanted to test this in the Democratic presidential campaign (for Wesley Clark), but it was decided that the candidate could not afford to leave out a control group of untreated. Later he got the chance in the gubernatorial elections in 2005, and learned that, contrary to the gurus’ opinion, warning about low turnout not effective, whereas emphasizing that others vote is. Grebner collaborated with Gerber and Green to send letters with information of subjects’ vote histories, cloaked in various terms, all of which created effects of 30+%.
-Ch 8. Republican consultant Dave Carney tinkers in various ways. One ex is different anti-Clinton mails, which was effective but not widely implemented in the 2006 presidential election because of fears of a clashback. Teamed up with Perry. Implemented win bonuses for those working for them. Later initiated a collaboration with G&G and two other academics, Daron Shaw and James Gimpel for the 2006 Texas gubernatorial race. They tested: TV ads at different amounts after matching similar media markets-found that had immediate effect that decayed; candidate visits-TV coverage had effect, personal visits had lasting effects. Conclude that tv advertising not very effective, contrary to conventional wisdom, as seen in the money allocated to it.
-Ch 9. The increasing sophistication of microtargeting. Young consultant Dan Wagner hired by Obama 2008 campaign. Database with more or less every American voter. Ken Strasma had been an early proponent of extrapolating political information about known populations to those with otherwise similar characteristics. Special challenges related to the caucuses. Matching people using several hundred consumer variables. Sophistication of Obamas’s primary campaign. Gathering of more and more data, implementation of competition between phone vendors and checking whether they did their job. People less honest when answering a volunteer than a paid call. Tracking of opinion shifts identifying “shifters” giving a more nuanced view of the undecided.
-Ch 10. Sophistication of Obama presidential campaign. Importance of good data from the field. Creation of canvassability, callability and answerability scores to help with this. Randomization of web page features and money requests- “A/B tests”. Demonstration of superiority of online ads and street teams over television for reaching young voters. Ability of the question ““Do you think your neighbors would be willing to vote for an African-American for president? (p. 296)” to pick out those for race was important.
-Epilogue. The social element of voting. Rogers’ experiment with mailing vote histories to people inspiring a follow-up by Malchow: First a phone call asking whether intended to vote, then those that said yes received a letter and then a robocall close to the election reminding them of the pledge – very effective, created new votes at 18 dollars each. Costas Panagopoulos’ experiments: Mailing people message that would publicize those who voted vs those who did not – the latter more effective; thanking those who voted in a previous election had effect; “honor roll” of people never having missed an election or thank you note – both effective. Gerber, intrigued by finding that many believed that the vote was not necessarily secret, found that mail with explanation of how it was kept secret increased turnout dramatically for registered voters that had not voted before. Malchow experimenting on ways to register new voters.