U.S. Politics

A number of people have compared the final forecasts for the election (e.g. this), but I’m more interested in longer term forecasting, so I’m comparing the state-by-state predictions of Intrade and FiveThirtyEight on the dates for which I saved FiveThirtyEight data a month or more before the election.

Here is a table of states where Intrade disagreed with FiveThirtyEight on one of the first four dates for which I saved FiveThirtyEight data or where they were both wrong on July 24. The numbers are probability of a Democrat winning the state’s electoral votes, with the Intrade forecast first and the FiveThirtyEight forecast second.

State 2008-07-24 2008-08-22 2008-09-14 2008-10-01
CO 71/68 60/53 54.5/46 67.5/84
FL 42/29 34.5/28 30/14 55.2/70
IN 38/26 34.1/15 20/11 38/51
MO 50/26 32.9/13 22.1/11 42.5/48
NC 30/22 25/21 14/7 51/50
NV 51.2/49 49/45 44.9/32 55/66
OH 65/53 50/38 40/29 53.5/68
VA 60.5/50 52.3/36 42/22 59/79

On July 24, both sites predicted Florida, Indiana, and North Carolina wrong. FiveThirtyEight got Indiana right on Oct 1 when Intrade was still wrong, but Intrade got North Carolina right on that date (just barely) while FiveThirtyEight rated it a toss-up.
Intrade got Nevada right on July 24 (just barely) while FiveThirtyEight got it wrong (just barely).
For Virginia, Intrade was right in July and August while FiveThirtyEight was undecided and then wrong.
FiveThirtyEight got Colorado wrong on September 14, but Intrade didn’t.
FiveThirtyEight got Ohio wrong on August 22, while Intrade got it right.
Intrade rated Missouri a toss-up on July 24, while FiveThirtyEight got it right.

On September 14, FiveThirtyEight was fooled by McCain’s post convention bounce by a larger margin than Intrade, but by Oct 1 FiveThirtyEight was more confident about correcting those errors.
For states that were not closely contested, there were numerous examples where Intrade prices where closer to 50 than FiveThirtyEight. It’s likely that this represents long-shot bias on Intrade.

In sum, Intrade made slightly better forecasts for the closely contested states through at least mid September, but after that FiveThirtyEight was at least as good and more decisive. Except for Intrade’s Missouri forecast on July 24, the errors seem largely due to underestimating the effects of economic problems – errors which were also widespread in most forecasts for other things affected by the recession.

In the senate races, I didn’t save FiveThirtyEight forecasts from before November 1. It looks like both Intrade and FiveThirtyEight made similar errors on the Alaska and Minnesota races.
[Update on 2009-01-13: contrary to initial reports, they apparently got the Alaska and Minnesota races right, although there’s still some doubt about Minnesota.]

On the other hand, Intrade had been fairly consistently (but not confidently) saying since early July that California’s Proposition 8 (banning same-sex marriage) would be defeated. Pollsters as a group did a somewhat better job there by issuing conflicting reports.

I had been half-heartedly planning the past few months to vote for Libertarian presidential candidate Bob Barr. I had previously considered voting for Obama when it looked like he would make an important difference in the Iraq war, but it now looks like the Iraqi government will persuade the U.S. to leave soon enough for that difference not to matter. If I lived in a swing state and the election was close, I might persuade myself that Obama’s personality and intelligence make him more qualified, but my track record for evaluating politicians that way is sufficiently unimpressive that I ought to be uncertain whether I’ve been fooled by his eloquence.
Voting Libertarian is normally the best way to encourage whoever wins to adopt a better policy, but this time it’s unclear whether that would send the message “I want more unprincipled opportunists”. Barr’s past support for the war on some drugs and his current mixed opinions on that subject are damaging the Libertarian party’s reputation.
The final straw that has convinced me not to vote for him is in this New Yorker piece:

For Barr, the terrorist attacks of September 11, 2001, and the subsequent expansion of executive power under President Bush, were a political turning point. “I went through Reagan National after 9/11, and saw guardsmen with automatic weapons,” he told me. “It dawned on me that we’ve entered a whole new world. It may have made other passengers feel more secure, but it made me feel dramatically less free.”

An NRA director saying the presence of armed men is a threat to freedom? There’s no shortage of dishonest pretenses of security that directly interfere with the average passenger. I haven’t heard any indication that armed guardsmen in airports do anything to innocent people. I saw more armed soldiers in the Zurich airport in the late 1980s than I saw in U.S. airports, and I’m fairly sure they didn’t erode Swiss freedom.
This is sufficiently bizarre as to suggest he can’t keep track of which ideology he believes today.
Not to mention this older report where he seems to specifically say Reagan National should have armed guardsmen.

To deter any suspicion that the comparisons I plan to make between Intrade’s predictions and polls are comparisons I selected to make Intrade look good, I’m announcing now that I intend to use FiveThirtyEight.com as the primary poll aggregator. I intend to pay attention to predictions that are more long-term than I focused in 2004, so the comparison I’ll attach the most importance to will be based on the first snapshot I took of FiveThirtyEight.com’s state by state projections, which was on July 24.

Also, as of last week, one of the Presidential Decision Markets that I’m subsidizing, DEM.PRES-OIL.FUTURES, has attracted enough trading (I suspect from one large trader) to make me reasonably confident that it’s showing the effects of trader opinion rather than the effects of my automated market maker (saying that oil futures will drop if the Democratic candidate wins, and rise if he loses).

Book review: The Age of Turbulence: Adventures in a New World by Alan Greenspan.
The first half of this book provides a decent history of the past 40 years, with a few special insights such as descriptions of how most presidents in that period worked (he’s one of the least partisan people to have worked with most of them). The second half is a discussion of economics of rather mixed quality (both in terms of wisdom and ability to put the reader to sleep).
He comes across as a rather ordinary person whose private thoughts are little more interesting that his congressional testimony.
One of the strangest sections describes the problems he worried would result from a projected paydown of all federal government debt. He does claim to have been careful not to forget the possibility those forecasts could be mistaken. But his failure to mention ways that forecasts of Social Security deficits could be way off suggests he hasn’t learned much from that mistake.
He mentions a “conundrum” of falling long-term interest rates in 2004-2005, when he had expected that rising short-term rates would push up long-term rates. I find his main explanation rather weak (it involves technology induced job insecurity leading to lower inflation expectations). But he then goes on to describe a better explanation (but is vague about whether he believes it explains the conundrum): the massive savings increase caused largely by rapid growth in China. I suspect this is a powerful enough force that Deng Xiaoping deserves more credit than Greenspan for the results that inspired the label Maestro.
The book is often more notable for what it evades than what it says. It says nothing about his inflationary policies in 2003-2004 or his favorable comments about ARMs and how they contributed to the housing bubble.
He gives a brief explanation of how Ayn Rand converted him to an Objectivist by pointing out a flaw in his existing worldview, but he is vague about his drift away from Objectivism. His description of the 1995 government “shutdown” as a crisis is fairly strong evidence of a non-Randian worldview, but mostly he tries to avoid controversies between libertarianism and the policies of politicians he likes.
He often praises markets’ abilities to signal valuable information, yet when claiming that the invasion of Iraq was “about oil”, he neglects to mention the relevant market prices. Those prices appear to discredit his position (see Leigh, Wolfers and Zitzewitz’ paper What do Financial Markets Think of War in Iraq?).
He argues against new hedge fund regulations on the grounds that hedge funds change their positions faster than regulators can react. He is right about the regulations that he imagines, but it’s unfortunate that he stops there. The biggest financial problems involve positions that can’t be liquidated in a few weeks. It seem like it ought to be possible for accounting standards to provide better ways for institutions to communicate to their investors how leveraged they are and how sensitive their equity is to changes in important economic variables.
He argues against using econometric models to set Fed policy, citing real problems with measuring things like NAIRU and GDP, but if he was really interested in scientifically optimizing Fed policy, why didn’t he try to create models based on more relevant and timelier data (such as from the ISM?) the way he did when he had a job that depended on providing business with useful measures? Maybe he couldn’t have become Fed chairman if he had that kind of desire.
I listened to the cd version of this book because I got it as a present and listening to it while driving had essentially no cost. I wouldn’t have bought it or read the dead tree version.

Sen. John Barrasso (R-WY) has introduced a bill to create prizes for carbon sequestration:

This is how it would work. There would be four different levels of prizes. The first level award would go to the public or private entity that could first demonstrate a design for a successful technology that could remove and permanently sequester greenhouse gases. Second, there would be a prize for a lab scale demonstration project of the technology that accomplishes the same thing. Third, there would be an award for demonstrating the technology to remove and permanently sequester greenhouse gases that is operational at a larger, working model scale. Finally, there would be an award for whoever could demonstrate the technology to remove and permanently sequester greenhouse gases on a commercially viable scale.

It sounds like many important details would be decided by a federal commission. The prizes could have many of the promises and drawbacks of Virgin Earth Challenge.
The first three levels of the prizes appear to create incentives to create designs with little regard for commercial feasibility. If those prizes are large, they might end up rewarding technologies that are too expensive to be worth using. Small prizes might have little trouble with this due to inventors not wanting to spend much money to win the prizes, but I’d still have concerns about inventors paying little attention to reliability and maintenance costs. The fourth level appears more promising.
Bureaucrats are likely to put more effort into clarifying prize rules that the Virgin Earth group did. But it’s unclear whether any approaches that a government agency is likely to recommend will do a decent job of translating the “commercially viable” goal into a clear enough set of rules that inventors will be able to predict how the prizes will be awarded.
My advice for the commission, should it be created, is that it tie the prizes to actual amounts of carbon removed from the atmosphere over some pre-specified period, or to estimates of those amounts derived from a prediction market.
(HT Jim Manzi).

The Politimetrics provides implied probabilities of Clinton or Obama winning in November if they get the nomination, derived from Intrade prices. I’m surprised that it’s been showing recently that the difference in their electabilities has been mostly zero, with occasional indications that Clinton is slightly more electable. Most other sources of information appear to suggest that Obama has more support than Clinton among independents and Republicans.
I just did a little trading to help move the market toward showing Obama as more electable by replacing my small bet against Clinton being nominated with a bet against her becoming president, but the amount I’m willing to trade was small enough that the markets moved in the opposite direction (i.e. showed increased Clinton electability).
What could cause the markets to indicate knowledge that conflicts with what I expect?
It could be that several limitations of Intrade impair market efficiency, such as not making it easy to see what those of us who have noticed the Politimetrics site see, or having margin requirements that are not conducive to exploiting inefficiencies of this nature (even if I were more confident that the market is wrong, the expected return on investment isn’t enough to persuade me to make large trades).
It could be that Obama is sufficiently unusual that there’s more uncertainty in how he will do, so that while the most likely result is that he’d get more votes than Clinton would, there’s a greater chance of a negative surprise with him.
It could be that Clinton is expected to be sufficiently vicious if she’s losing that she would hurt Obama before giving up.
But the history shown on the Politimetrics site has swings that seem unexplained by these guesses.

Book review: Poverty and Discrimination by Kevin Lang.
This book is designed to make you feel less sure of your knowledge, and it succeeds in that goal. That’s a worthy accomplishment, although it provides much less satisfaction than a book that provides a grand vision for solving problems would. At some abstract intellectual level I liked the book, but my gut feelings often told me that reading the book was unrewarding work that I shouldn’t do unless it was assigned reading for a course I needed.
The book will dissatisfy anyone who wants to view politics as a fight between good and evil. For many issues such as the minimum wage, he provides strong arguments that the effects are small enough that we should doubt whether the issue is worth fighting about.
He gives good explanations of why it’s hard to even have clear concepts of poverty and discrimination by providing examples of how seemingly trivial or unobservable differences can create results that our intuitions say are important to our moral rules.
He provides clear evidence that some discrimination still exists, and then thoroughly explains why there’s large uncertainty about how harmful it is. He presents one moderately unrealistic model in which discrimination is common but doesn’t affect wages. Then he presents a somewhat more realistic model in which a tiny bit of discrimination produces large wage differences. But those wage differences may overstate the harm done, because they’re partly due to minorities spending less on education and to women pursuing careers in lower risk occupations or careers which allow more flexibility to take time off.
There are only a handful of places where I doubted his objectivity.
He reports one study showing evidence of racial discrimination in home loans, but fails to mention any of the contrary evidence such as the Anderson and Vanderhoff paper showing higher marginal default rates for blacks.
The final few pages on policy implications seem poorly thought out compared to the rest of the book (he says that’s the least important chapter of the book). He claims that income taxes on the bottom quintile can be reduced to zero by a 10% increase on the top quintile, but that claim depends on assumptions about how reported income changes in response to tax increases. He doesn’t indicate what assumptions his claim depends on.
He claims “The high rate of incarceration in the United States and the high level of inequality are related.” He gives a plausible theory about why inequality causes the wealthy in some countries to spend a lot protecting their wealth from the poor, but provides no evidence connecting that theory to U.S. incarceration rates.

Early this week, the Federal Reserve Board lowered interest rates at an unexpected time by a surprisingly large amount.
I see three possible explanations, which I think are about equally likely.

  • The Fed has evidence that the economy is slowing more than markets have realized.
  • The Fed has evidence that some big financial institutions have troubles that are endangering the careers of some influential people, and is bailing out those institutions in hopes that those people will use their influence to enhance the job security of the people in charge of the Fed.
  • Bernanke isn’t interested in the kind of publicity he can get by maximizing the total number of rate cuts. He realizes that a steady, predictable series of small rate cuts doesn’t stimulate the economy as well as cutting rates far enough that it isn’t easy to predict that more rate cuts will be needed (for one thing, making further rate cuts predictable creates incentives to postpone borrowing to when rates are lower). If that’s what’s happening, it’s not going to work as well as he would like this time, because the markets think the Fed is following the predictable rate cut strategy that gives them publicity for doing something at the time that the average person is most concerned about recession.

In related news, Singapore has a system which is designed to stabilize the economy rather than to provide politicians with opportunities to claim credit for doing something about the economy.
China is imposing widespread price controls and suffering power shortages which hinder production. If China were like the U.S., I’d say it’s trying to recreate the experience the U.S. had in the early 1970s. But the way Chinese politics work, the central government probably will allow local authorities to use a lot of discretion in enforcing the price controls, so the price controls will probably only produce shortages in a few industries that are dominated by large state-owned firms.

Politimetrics (associated with the Westminster Business School) has sponsored some additional Intrade contracts which will provide information about the impact of the presidential election on the country if they ever get enough liquidity. So far, there’s been no sign that much liquidity will exist.
One reason I (and presumably other traders) haven’t placed many orders is that the contracts deal with individual candidates. Since the value of the new contracts should fluctuate with the probability of the relevant candidate’s winning, and those fluctuations are currently much larger than any other factor affecting the prices, trading them would require any trader who doesn’t accept the market price to frequently monitor the prices of the underlying contracts. Nobody wants to do that unless the contracts already have significant volume.
Even if they had some liquidity, there’s a good deal of risk that the long-shot bias which appears to be common on Intrade would limit my confidence in the value of the information provided by those prices for all but the two or three candidates who are most likely to win in November (i.e. I’d probably believe what they said about Clinton relative to Obama, but I’d doubt they would be useful for voters in Republican primaries).
When it becomes clear who will win each party’s nomination, these problems will be reduced, and I’ll probably place a moderate number of orders on some of these contracts.
It should be possible to design a better user interface for decision markets of this nature so that users could place orders purely on the probable impact of a candidate’s election. Shock response futures come closer to doing that than contracts of the form “X wins and Y happens”, but can probably only indicate the direction of the impact.
I’ve created web pages at https://bayesianinvestor.com/amm/implied.html and https://bayesianinvestor.com/amm/implied4.html (which are currently being updated 4 times a day) which show implied prices (i.e. the price of the conditional contract as a percent of the price of the underlying candidate’s contract) that ought to represent what the markets think the probable effects would be if that candidate wins. Ideally traders could place orders expressed in terms of those implied prices, but that’s nontrivial to implement, and unlikely to happen unless someone pays Intrade a fair amount to create.
I’ve commented on Jed Christiansen’s blog about why I doubt the conditional contracts I’m subsidizing have had enough trading yet to produce valuable information. But the trends suggest there will be enough trading within a few weeks.

I have implemented subsidies to encourage trading of some conditional prediction market contracts that may provide useful information about the consequences of the 2008 presidential election, via a simple automated market maker (using an algorithm described near the end of http://hanson.gmu.edu/ifextropy.html). The subsidized market maker ought to provide incentives for traders to devote more thought to these contracts than they would if the liquidity was less predictable.
Intrade has agreed not to charge any trading or expiry fees on these contracts.
Some places to look for extensive description of the motivations behind these subsidies are here and here.

The contracts are:

Please read the detailed specifications at Intrade before trading them, as one-line descriptions are not sufficient for you to fully understand them.
For the first two of those contracts, the market maker will enter bids and asks of 38 contracts, and can lose a maximum of $5187.76 on each contract. For the other four contracts, the market maker will enter bids and asks of 115 contracts, and can lose a maximum of $7906.25 on each contract.
I will maintain a web page here devoted to these contracts.
See also this more eloquent description on Overcoming Bias.