Episode Transcript
On a recent podcast, we asked this question: “Would a big bucket of cash really change your life?” The episode was about a 19th century land lottery in Georgia. For the winners of this lottery it represented a substantial windfall. We wanted to know how that windfall affected the winners – and, more specifically, how it affected the winners’ children and grandchildren. In other words, did the winners just spend the windfall or did they invest it somehow, helping their future generations live better? Here’s Hoyt Bleakley, one of the economists who studied the Georgia land lottery:
Hoyt BLEAKLEY: We see a really huge change in the wealth of the individuals, but we don’t see any difference in human capital. We don’t see that the children are going to school more. If your father won the lottery or lost the lottery the school attendance rates are pretty much the same, the literacy rates are pretty much the same. As we follow those sons into adulthood, their wealth looks the same, you know, in a statistical sense. Whether their father won the lottery, lost the lottery, their occupation looks the same. The grandchildren aren’t going to school more, the grandchildren aren’t more literate.
So what we learned was that future generations of the winners didn’t really benefit. Now this was just one case-study from antebellum Georgia; it can’t definitively answer the larger question, which is this: what’s the best way to help poor people stop being poor? This is of course a timeless question but lately, thanks to a lot of new philanthropy and philanthropy research, it’s been discussed with a great intensity. And it’s given rise to even more questions, like: Is giving money directly to poor people perhaps the best thing you can do? What about giving them other stuff – free schooling or, if you’re a farmer in Africa, free animals or equipment? Or should you not focus on giving them anything at all, but rather try to build a better market economy to help them get better jobs?
Now as coincidence would have it, I recently had the opportunity to moderate a discussion on the very topic of how to best alleviate poverty, this was presented by a nonprofit called Innovations for Poverty Action. It took place in front of a live audience, here in New York City. So on this episode of Freakonomics Radio, we invite you to listen in.
* * *
So my name is Stephen Dubner. I’m the moderator for this event, which is called Using Evidence to Fight Poverty, and is presented by Innovations for Poverty Action. Our two guests are Dean Karlan, an economist at Yale who is president and founder of Innovations for Poverty Action, and Richard Thaler who is a professor of behavioral science and economics at the University of Chicago. So I’d like to give a very brief background of the two of them. Thaler, we’ll start here, Richard Thaler is one of the pioneers, perhaps the chief pioneer of the discipline that has come to be known as behavioral economics, which is a blend of economics, and psychology, and something that most academics are not known to employ, which is common sense. And it really did revolutionize the way that a couple generations of scholars, and writers, and others have looked at human behavior writ small and writ large. And honestly, I’m very grateful for what you’ve done. I don’t mean to get all mushy on you right off the bat, but it’s true. Dick is the coauthor of an excellent book called “Nudge: Improving Decisions in Health, Wealth, and Happiness” which is behavioral economics that can be used in the real world. He is advisor to the British government’s so-called Nudge Unit, so they named the unit after this book. And this Nudge Unit practices really what Thaler preaches on many dimensions. His non-academic interests include, per his website, “golf and fine wine.” Although not, I should note fine golf or just any wine. So the golf can be of any level and he’s fine, but the wine must be good. Dean Karlan was headed toward a hedge fund career when he spent three years in El Salvador working for a microloan organization. Does anyone need to know what a micro loan organization is? Don’t be shy. Everybody knows? Okay. He was surprised to find that this organization was not very good at collecting data to see if and or how well this system worked, which meant that a lot of decisions therefore were being based on a hunch, maybe ideology, rather that evidence. Dean went on to graduate school at the University of Chicago where he became a T.A. for none other than Dick Thaler. And in 2002 he founded Innovations for Poverty Action, which has grown to more than 900 people in 51 countries. Its mission is to “discover what works to help the world’s poor,” primarily by using randomized controlled trials, or trials, real trials in the real world, and then to get those solution put into place. Two years ago, Dean coauthored a book called “More Than Good Intentions: How a New Economics Is Helping to Solve Global Poverty.” So I invite you to welcome the two of these fine gentlemen, thank you.
If we could, let’s begin at the very beginning with the title of this talk, which is “Using Evidence to Fight Poverty.” When I saw the title I have to admit, my first thought was this, I remember the time I first heard the phrase “evidence-based medicine.” And I looked at it and I thought what the hell other kind of medicine is there, and then you realize there is a lot. So a great deal of medicine it turns out is based on kind of hunch, and feelings, and past experiences that may or may not be as real as we wish. So as it turns out, economics has a lot to say about this by now. And presumably you may have something to say, let’s start with you, Dick, about the power of and need for evidence generally if one wishes to solve problems, and where you see us being in the long arc.
Richard THALER: One thing this question reminds me of is you can ask a similar question about behavioral economics. In fact, Herb Simon once did, and asked, why do we need the phrase behavioral economics, what other kind of economics could there be? And we know there is another kind of economics that actually doesn’t rely much on evidence because they know stuff. So economists know a lot of stuff, the only problem is a lot of it is wrong. So what evidence-based economics or evidence-based policy is about is partly modesty of not thinking you know all the answers to all the questions, and curiosity, and a willingness to collect data. So, when I’m over in the U.K., early on in these meetings I would always say we can’t do evidence-based policy without evidence. And that became one of our mantras. It seems obvious.
Stephen DUBNER: It does. And yet?
THALER: Until you think about the way most policy is done.
Let’s talk about poverty for a little while, maybe the rest of our time. It strikes me as a bit odd that here we have two economists, at least I don’t know what your position is going to be on this, but I know yours Dean, 1.x economists who feel that the way, or a very good way to fight poverty is to, in one way, give stuff or money to poor people. So we’re used to hearing the argument from economists that if you want to help poor people you build a better, freer, more open market and maybe ensure that the governments aren’t, you know, corrupt. Is this a revolution, is it an anomaly, is this just you out there who believes this? So give us the context of economics or economic thought and poverty alleviation.
Dean KARLAN: So you hit on kind of two opposite ends of the spectrum in terms of ways of tackling. One is macro level interventions, which in terms of institutions and fighting corruption and things like this. And the second is a more micro level, which is where a lot of government programs are, a lot of nonprofits are working on the ground. So that’s really where our focus is. And it’s not to say that these macro level issues are wrong or right, you know, we have our own opinion about that. Frankly whatever we can do to improve property rights and things of that nature is good. But meanwhile, there’s a lot of money, a lot of resources, a lot of effort being spent on the ground for direct delivery of social services. And that’s where we’re focused, to say okay how do we improve that? How do we improve the way those programs are designed?
As Karlan sees it, the first step in improving how those programs are designed is to gather evidence as to what works and what doesn’t. For instance, how would it work to just give a bunch of cash directly to people in some poor villages in Kenya? A non-profit called GiveDirectly recently did just that. They went in to about 500 households and gave them money – in electronic form, stored on a cell phone – and they could spend as they pleased, no strings attached. Now this is what’s called an unconditional cash transfer. That is, you don’t have to agree to get job training or send your kids to school in order to get the money, which is how some programs work. In this case, some families got about $300, and others got around $1,100 – a huge amount of money, a year or two’s worth of income. Some people got the money all at once, others got it in installments. The idea was to have a few variations so that you could measure the effects of the giving. Lump sum versus installment, big sum versus smaller. And this included having a control group, nearby poor households who didn’t get any free money. This experiment was evaluated by Innovations for Poverty Action, Dean Karlan’s group. So: what happened?
KARLAN: As you would expect, the money goes into many different directions, which is one of the reasons why, this is not the question you asked, but why one of the things we’re very interested in seeing is this type of program compared to a program that is more targeted in equal value of transfers, but so for instance providing people four goats and food where it’s very focus on saying rather just giving you money for anything and having some of that maybe going to housing structure, whatever it is you choose, instead what we’re going to do is we are going to focus on providing you a set of assets that generate income and then let you do whatever you want with the extra income.
DUBNER: Okay.
KARLAN: So it’s moving back one step that level of flexibility to maximize. So that’s one of the tests that we’re setting up in other settings is this asset transfer rather than cash transfer. You know, in economics 101 we learn a lot of basic thing about why cash would not be as beneficial as something more. You know, if people have low information about how to improve the health around them, cash is not going to satisfy that. So this is this is just economics 101 that says that cash transfers might be great for direct alleviation of poverty at a very direct level and it’s efficient, but there might be other things which are, which have added benefits beyond the mere value of that transfer. So that’s what we need to start seeing more of is when is that right or when is that just mumbo jumbo that fits our econ 101 speak but doesn’t actually translate.
THALER: In some ways you can think about part of this is just understanding why people are poor, which seems like a very obviously question. They’re poor because they don’t have enough money. But why is that they don’t have enough money? So do they lack education, do they lack will power, do they lack resources. I mean, it does sound like a dumb question, or course we know what poverty is, but actually we don’t. And it’s going to vary. So somebody on the south side of Chicago being poor may be very different than a peasant in some African village. And the same interventions won’t necessarily work.
DUBNER: Do you know the results of this paper or can you be a blind for us?
THALER: No I don’t know the results of this paper.
DUBNER: Perfect, okay, so Dick, before we get to the results then, let’s say this, Dick, let’s say I come to you, you’re an economic sage and I want to learn at your feet, and I say Professor Thaler, we have a project here, or Dean has a project here where we’re going to give a bunch of families, a few hundred families, a bunch of money, cash to do with what they will. Here’s their living circumstances, they live in this kind of village, here’s what they can and cannot buy with it, dah, dah, dah, and the what they can and cannot buy, let’s say ranges from a farm animal on the productive end to let’s say, you know, gambling and alcohol, and tobacco, and prostitution if you’re against that on the other end — against all of those on the other end. How would you think that people in that circumstance would spend a windfall?
THALER: Some of each.
DUBNER: Okay, give me a median, or give me a mean.
THALER: It depends.
DUBNER: Let me rephrase the question. Let’s say I’m a donor and I have a thousand dollars that I want to spend. And Dean says, Oh I can take your thousand dollars and distribute it to poor families in Kenya where $1,000 goes a long way. And I’m just going to give it to them and they’re going to do what they want.
THALER: You know, my intuition is that in some cases that will work great. When people have a good sense of how to make use of that money. In other situations if you give them four goats and fertilizer and they wouldn’t know that spending the money on four goats and fertilizer is what will triple their income, then that wouldn’t work as well. So that’s why I’m not willing to go out on a limb.
DUBNER: I understand, so very brave of you…So Dean…
THALER: Ask me who’s going to be president in 2020, I’ll tell you, but these hard questions, you know.
DUBNER: So Dick, who will be president in 2020? I was going to give you 2016. I wasn’t even going to…
THALER: That’s too easy, Steve Levitt.
DUBNER: Steve Levitt. Dean, okay if you could then talk a little bit about the results of the study then. What did it find?
KARLAN: So they actually didn’t find money going into alcohol. It was a pleasant surprise…
THALER: What a waste. All that money and no fine wine.
KARLAN: Ironically in one other study I know of from Bolivia that we recently did found that giving in really rural areas, hunters and foragers kind of communities in rural Bolivia, giving people access to a savings account, did actually increase alcohol consumption because that was basically the main celebratory thing that people could do was take canoe ride for an hour or two and get a more expensive bottle of liquor and this was something that people saved up for. So giving them this vehicle did actually lead to that. So very much in the spirit of what Dick was saying the answer is going to depend. Having said that, in this context, when they did with Give Directly they did a lot of housing improvements, a lot of investment into income generating activities was the main thrust of where they saw the money going. And ceremonies I believe was also a big part.
Okay, let me break in here and give a bit of English translation, since you’re hearing a lot of economics jargon about “investment into income-generating activities” and so on. What was the result of this experiment in Kenya, where poor people were given big sums of cash to spend as they wish? Good news: fewer kids went hungry; farmers bought more cows — and started earning more money; and recipients of these cash grants apparently didn’t blow the money, at least not too much of it, on things like alcohol or gambling.
DUBNER: Can you talk a minute about the characteristics of the household or the person that gets that money that uses it most productively. We’ve all heard that if you give aid to women, women tend to take care of the family a little bit more. If you give it to men they’ll do what Thaler would do with it. Can you tell us anything about that?
KARLAN: So the striking thing on that, is I’ve seen a lot of studies that try to look at that and find that either it doesn’t matter, or like you said. I’ve never found a study that said giving it to men is better than giving it to women, but I’ve definitely see ones that go against the conventional wisdom and say oh it turns out that it didn’t matter. And some that find that the women are going, do put more money into things, the health and education for instance of children. But more often than not we’re actually surprised in finding that it doesn’t matter as much I think there’s a lot. Within the household there’s a little bit of a black box. Things aren’t quite as simple as we…
DUBNER: Okay, so speaking of the black box, let’s talk about, let’s bring it back out to talk about evidence a bit generally. You know the inputs here. You know the families where you find them, you know the money that’s being given to them in what form and there’s some variation in that. What about the output, what about the spending? How do you know what you know about how these people spend the money?
KARLAN: One thing I would say in the spirit of programs is that we have seen strong evidence that says you cannot just ask people what they did with the money. So we did a recent study.
THALER: They don’t remember.
KARLAN: They don’t remember. They don’t even know the answer. So we have a study in the Philippines that we’re about to release about how people spend their money from micro credit loans where here we ask people what did you do with the money, and we ask them in a way that allowed them to hide the answer, and we asked them in a very direct way. And when we asked them to hide the answer so they reveled in a kind of secret way they can tell us, they much faster to say well yeah, I did use it to pay down other debt and used it to pay for household expenses where these are loans that are supposed to go into the business. But when we actually asked in our survey about all the outflows, just tell us about everything you’ve spent in your life for more than $20 and we have a control group so we can compare treatment and control, we actually found all the money went into the business, which is striking given that their perception of the money is that it went to pay down debt.
THALER: This is not unique to undeveloped countries. So for years people have been asking behavioral economists, look when you get people to save more in their 401(k) plan how do you know they just don’t run up their credit card bills? And the answer was we don’t.
DUBNER: Really? Your whole SMarT plan is based on survey…
THALER: No, we know, but there’s a happy ending here so hold on Stephen. So we knew that their account balances were going up, but we don’t have access to their round sheets. Along comes Raj Chetty and John Friedman and a couple of Danish economists. And in Denmark it turns out they don’t have much concern about privacy, which is great for researchers. And they have a wealth tax. And so they were able to run the study I’ve wanted to run for 25 years. And very good news.
DUBNER: It works.
THALER: It works. It basically is all new savings….
DUBNER: The “it” we should say, you kind of left out the it.
THALER: If you automatically enroll people into some savings plan and escalate their contributions, 90 percent of the people just follow along with whatever you’re doing and their saving just goes up by that amount.
DUBNER: The default is you’re in, whereas the old model was you had to opt into these 401(k) plans, or whatnot.
KARLAN: The one other thing that was really interesting in that, too, is that if you drew attention to it, then it did crowd out. So if they were keenly aware of what was happening with the increases it did not, so it really makes a huge argument for subtle nudges that just shift the way the behavior will happen if you don’t do anything, and it’s that passive increase that led to the big…
DUBNER: I’m concerned when I read the study about the Give Directly intervention, where these people were given money and the IPA results show that they spent it, let’s call it productively. That productive spending is based on self-reported spending. So if you come into my house and you’re these nice American, or British, or Nigerian scholars and you say hey you’ve been chosen to receive $1,000 in cash, spend it however you want, and then I come back and six months, and 12 months, and 18 months later and say how’d you spend it. I’m going to say, Oh I bought a cow, and I sent my daughter to school, and I took her to the doctor when she was sick, and I bought better food, dah, dah, dah, dah. How, how do…I mean, we’ve all been trained to be, I think rightly suspicious of self-reported data on many levels, so persuade me that…
KARLAN: So there’s three answers. One is this is exactly why you have a control group. So if you do have underreporting systematically of expenditures you have it on both treatment and control. So you have to then tell the story, which maybe isn’t right, which is no we’re concerned about biased self-reporting more so in the treatment versus control. So the second thing that often happens is exactly the reason often for independence. Every study I know does not actually do this where there is no stated connection, but a lot of studies do. I know most of my work the survey work is done independently of the intervention. So the surveyors are coming representing themselves as workers at IPA or from a university and no stated link the interventions so there is no association that says oh I need to overreport to you…
DUBNER: I understand that, but I don’t want to be the head of a household who when the people who gave me the money or someone who knows the people who gave the money come and say what did you do with the money, I don’t want to be the one who says, Oh I had a fantastic month of gambling, and drinking, and smoking and I bought some prostitutes also. Let’s try…Raise your hand if you have cheated on your spouse or significant other in the last six months, let’s say.
KARLAN: So here’s a perfect example of how we ask that question…I don’t know, I don’t think they did this in their…
DUBNER: Mine was raised…
KARLAN: Just so you know, I have done in Uganda questions about cheating on your spouse, and I can tell you exactly how we elicited it, and we actually found the treatment effect that was from a study that found the intervention led to more cheating.
DUBNER: So how was it asked then?
KARLAN: You ask it this way: you say…
DUBNER: Sorry, let’s do that again, pretend I hadn’t asked.
KARLAN: You don’t ask it of any one individual. Okay you’re not going to get the measure of whether you cheated, but I can answer the question for the on average. So we ask, it’s called a technique called list randomization where you say…
DUBNER: Sorry, list…?
KARLAN: List randomization. Where you say I’m going to name three things and I want you to…You do this for half the people and you say tell me yes or no in total, just how many yeses, each one, just tell me total. I own a bicycle, I have at least three children, I was born in the city that I now live in. And half the people are just told how many of those statements are true. The other half are given those same three statements and then the fourth is I cheated on my wife. Again, don’t tell me which ones are yes or no, just tell me the total. Right. And you always throw some in so you never worry about getting a four. And then you just subtract. So if you get an average of 2.7 and 2.2 that means that 50 percent of people are tell you that they cheated on their wife. So we did this. And we actually found a positive…So there are ways of getting at these things. But I would say there’s a third answer to you question, which is that in a lot of settings we’re looking at an objective, administrative data as much as we can to find out, to observe outcomes. So we’re looking at so for instance there’s a commitment savings product that we tried out in Uganda with school children where we actually have test scores. So there’s no self-reporting here, we’re actually testing the kids with their numeracy and literacy and we found a treatment effect. And there’s others where you can test like doing clean water. And you actually test the water. So you can use objective measures like that. Not every study can do that. It depends on what we’re doing.
Coming up on Freakonomics Radio: Richard Thaler is a big fan of small nudges to move people in the right direction:
THALER: If you say most people in Westchester County paying their taxes on time and it is going to the new park we are building, you can get take up rate up by 5%.
And we take questions from the audience:
Susan DAVIS: What is the evidence on what helps people get out of extreme poverty?
* * *
Today’s episode is drawn from a conversation I recently moderated with Dean Karlan, a Yale economist who runs a nonprofit called Innovations for Poverty Action, and Richard Thaler, from the University of Chicago, he’s considered the dean of behavioral economics. Thaler is also the coauthor of a book called “Nudge,” which is about using cheap, simple, and easy ways to encourage pro-social behavior – whether it’s saving more money for retirement or increasing organ donations or using less energy. Some of Thaler’s ideas have now been adopted by the British Government, which now runs a “Nudge Unit,” and more recently by the U.S. Government. I asked Thaler to tell us a success story:
THALER: Well, probably the best example of that, one of the very first initiatives in Britain was meeting with some guy who’s in charge of collecting money from people who owe money on their taxes. Most people in the U.K. pay their taxes automatically.
Payroll withholding.
THALER: Pay As You Earn it’s called, and… but if you have a private business, you drive a cab, or you have whatever…
Doctors.
THALER: Yeah, what we would call Schedule C income here, then you have to file a tax return and come up with a lot of money, and some people were late and they were writing letters. And they would send one letter, and then they’d send another letter, and then turn it over to a collection agency, which is very expensive, and the team just started experimenting writing different letters. So there’s a simple trick from Bob Cialdini, the great social psychologist, author of the book “Influence” that you tell people truthfully, most people pay their taxes on time. That helps a little bit. If you say most people in Westchester County where you live…I’m making this up…pay their taxes on time, that helps more. If you say most people in Westchester County are paying their taxes on time and it’s going for that new park that we’re building…So you can get the take up rate up by as much as 5 percent.
DUBNER: What part of the psychology is doing that?
THALER: Each part, you know, the positive…
DUBNER: Is it herd mentality, is it social norming?
THALER: No, I mean, it’s social norming, and then making it local, you know it’s like Save More Tomorrow, the strategy I devised to help people save more, I threw everything I knew at that. So it doesn’t make very good psychology because you can’t sort out which ingredient, you know, you taste some dish at a restaurant, it takes great, you don’t know whether it was the little bit of thyme that they put in there that really…Right? It’s all of the ingredients. So we have varied the letters and you know, then they keep fiddling with things like a little handwritten note on the outside of the letter helps.
DUBNER: And give us a sense of scale of improvement.
THALER: You know, running one of these experiments paid all the expenses of the team of the first three years.
DUBNER: For the whole Nudge team, not just the tax Nudge team.
THALER: Yeah, so these experiments make money. Because sending out a well-written letter costs exactly the same amount as sending out a rude letter that doesn’t explain how to go about paying it off.
DUBNER: You’re assuming that a good writer is cheap to hire. You’re assuming that a good writer is as cheap as a rude writer.
THALER: Yeah, good writers are easy to find, Steve.
On that sick note…Yes please.
DAVIS: Hi I’m Susan Davis with BRAC. Dean we’ve worked together on the “graduation program” and I was wondering can you say what is the evidence right now looking at social protection systems whether it’s unconditional cash transfer, conditional cash transfer for something like graduation? What’s the evidence no what helps people get out of extreme poverty? Best, fastest?
KARLAN: So, and let me just recap what Susan’s referring to is a series of seven evaluations that IPA has been doing. And one of the themes of IPA is that we need to get beyond just having one study in one place and instead have collections of studies that speak to each other and help us understand the robustness of a particular approach. And this “graduation” approach, I put that in quotes, I realize you can’t hear quotes in the podcast is a model that says we’re going to work with the ultra poor and help them “graduate” out of poverty by providing them goats, by providing them training in how to, how to manage goats. And goats is just an example. There’s beekeepers in Ethiopia, a cow in West Bengal — different depending on the context. But it’s some sort of asset. It’s bundles of food along the way so that people do not turn around and sell the asset in order to eat. It’s often some health care, and it’s a lot of monitoring and help along the way in order to see that the income is generated and sustains. And so this package has proven to be fairly successful across most of the sites but not all. And that’s one of the things we’re trying to work on, is trying to figure out why. But it has not been compared in a very simple horse race to cash. In all of the studies so far, the comparison has been to a control. But we do not know the answer to the question that you’re basically asking as well and Susan’s posing, which is, how would it be compared to cash, and that is something that we’re very keen to do in the kind of the phase two of these studies that are helping to try to tinker on how best to do this model.
DUBNER: Yes in the green.
Luz SALAS: Hi I’m Luz Salas., from, I’m actually a graduate student from City University of New York, so I definitely value good quality information. My question is regarding, I mean, I know these interventions one of the biggest challenges of these interventions is to scaling them up. So I would like to know the insights from both of you, what is the percentage of how easy it is after you have good interventions going to the government or any institution and say how do we scale it up?
That’s a great question.
THALER: Well that’s really is what this is about.
KARLAN: This is exactly… I think the second mantra that you use for the Nudge Unit is really applicable here. So you use the mantra “make it easy.” And you mean this in the context usually of how we make it easy for people to do things. The same exact principle applies to scale up. How do we make it easy for government to make the right choices? How do we make it easy for N.G.O.s to choose the right thing? And this has implications on two levels. One is that it has the immediate implication for the type of evidence that we collect. It’s one of the reasons for running randomized trials. You can, the fact that you can put up a simple bar chart makes it easy for people to get it. Okay, treatment is here, control is there, I see the impact. The minute you have really fancy econometrics with lots of Greek letters, you are not making it easy for policy makers to understand and decipher what the lessons are from a research paper.
That’s a great point. I would like to thank you for your attendance and your very kind attention and please join me in thanking Richard Thaler and Dean Karlan. So as you heard, the jury is not yet in on whether giving cash works better than giving stuff – or if either of them is a good, systematic way to address poverty. What Dean Karlan and Richard Thaler do know is that if you wish to even stand a chance of solving a hard problem like poverty, you first need evidence of what the problem is and how some solutions might work, or not work. You don’t need hunches, or ideology, or old wives’ tales, you need evidence. Now at the moment, a good bit of this evidence is being gathered. And what does it tell us about, say, the wisdom of giving money directly to poor people? Well, it depends. Not a very satisfying answer, is it? But at least it has the virtue of probably being true.
Comments