Conventional wisdom holds that the OPEC oil cartel has the world in its grasp. It can manipulate prices by tinkering with supplies. Last month OPEC released a new study on world oil demand that seemed to signal the cartel was readying to tighten the taps because higher prices were slaking the world's thirst for oil. The American Petroleum Institute released fresh data showing that demand for oil products in the United States (the world's largest market) dropped a whopping 3 percent from the year earlier. The news about lower demand has caused oil prices to fall a bit, and all eyes are on OPEC's wizards to tighten supplies.

But the conventional wisdom is mostly wrong. OPEC (which stands for the Organization of the Petroleum Exporting Countries) is no wizard. For the most part, its actions lag behind fundamental changes in oil supply and demand rather than lead them. OPEC looks like a masterful cartel when, in fact, it is mainly just riding the waves.

It is hard to figure out exactly what goes on behind's OPEC's closed doors, but glimpses are possible by probing what the cartel members say about prices and how they set quotas. Over the last five years, OPEC members have announced ever-higher price goals only after the market had already delivered those high prices. As the market has soared, OPEC has followed. Only in the last few months has Saudi Arabia suggested that the cartel would be better off if prices reversed because high prices would encourage the world's big oil consumers to wean themselves from oil. It proffered $125 a barrel. The markets shrugged and kept on rising until real facts about slowing demand revealed that fundamentals were changing.

OPEC also sets quotas so that each member knows its role. Throughout its history, OPEC has faced the difficult task of holding the cartel in the face of strong incentives by each member to cheat. Today's oil market makes that job easy because nearly every member, except Saudi Arabia, is producing at full capacity. OPEC, more or less, has nothing to do.

In fact, the last time OPEC made a major adjustment to its quotas—September 2007—it jiggered them to reflect what its members were already pumping. Algeria got a big boost because it was already supplying nearly 50 percent more than its quota. Kuwait, Libya and Qatar also got boosts that aligned their OPEC quotas with existing reality. OPEC also set, for the first time, a quota on Angola's output. Since then, Angola has attracted a steady stream of new production projects, which makes it inevitable that OPEC will adjust Angola's quota to reflect the new reality. (Iraq has no quota; it has troubles enough without pretending to align its oil output to OPEC strictures.)

Nigeria and Venezuela got haircuts because their political troubles meant they were already producing far less than their quotas. Indonesia also cut its quota and a few months later left OPEC because it realized that as a big oil user it actually had more in common with oil importers than its fellow OPEC members. These changes in quotas were reflections of political realities that OPEC doesn't control.

Today's oil cartel, even more than in the past, is really about Saudi Arabia. But Saudi Arabia also is no wizard at the controls of the world market. The Saudis can adjust their output a bit since they control nearly all of spare capacity in the world market. (Earlier this month they pledged another 200,000 barrels per day to dampen pressure from the United States and other governments that are reeling from high oil prices. But that move was more symbolic than real as the markets were already expecting the new supplies.)

Saudi Arabia is on the front lines of the new reality in world oil supply. It is proving much harder and more costly to bring on more supplies. The Saudis have an ambitious plan to increase output about one third over the coming decade, but they are finding that will be a stretch. Their fellow OPEC members are in a similar situation, and those hard facts also produce high oil prices. In fact, the Middle East members of OPEC are, today, producing at just the same level as they were three decades ago because none of them invested much in finding and producing new supplies. High prices into the future reflect these fundamental facts rather than the assumption that OPEC is a masterful cartel.

Conventional wisdom holds that because OPEC is raking in more cash than ever, it has never been stronger than it is today. In fact, OPEC has rarely been weaker. It is the accidental beneficiary of forces that have caused today's high prices, and it will be nearly as powerless when prices come down.

The real solutions to today's high oil prices require more attention to demand. Blaming OPEC, while good political theater, won't have much impact. Legislation now working its way through the U.S. Congress would actually attempt to break up the oil cartel. Such schemes won't work, and the political effort would be better spent on policies that redouble the nation's efficiency, producing more oil from diverse sources here at home, and in finding ways to move beyond oil altogether.

As oil prices surge through $140/barrel at the time of writing, surely one can at least count on the invisible hand of the market to drive further exploration and production and ultimately bring more supplies on line, right? Or perhaps, more ominously, high oil prices presage a darker future of shortage and conflict as global oil fields pass their geological “peak”? In fact, both positions miss a crucial point about the dynamics of the world oil market — that it is increasingly animated by the counterintuitive behavior of the state-owned oil and gas giants that now control the vast majority of the world’s hydrocarbon resources.

“On average national oil companies (NOCs) extract resources at a far lower rate than international oil companies (IOCs), leaving about 700 billion barrels of oil effectively ‘dead’ to the world market.”So-called “national oil companies,” or NOCs, own about 80 percent of the world’s proven reserves of oil, a percentage that has been on the rise as the persistent high price environment encourages countries to assert even tighter control over the rent streams flowing from their resources. NOCs are curious and variegated beasts, and, contrary to the popular imagination, some are highly capable both technically and organizationally. Brazil’s Petrobras is an acknowledged world leader in deepwater drilling, while Norway’s StatoilHydro is highly regarded for its competence and transparent business practices. Saudi Arabia’s national champion, SaudiAramco, is secretive to the outside world but generally considered to be a well-run, technically capable organization. At the other end of the continuum, government infighting and micromanagement hobble Mexico’s Pemex and Kuwait’s KPC. Once-independent PDVSA in Venezuela has been remade by President Hugo Chávez into a government puppet that spends liberally on social programs but consistently undershoots its production targets. And indeed some national oil companies are hardly oil companies at all — Nigeria’s NNPC, for example, is mostly a rent-seeking bureaucracy.

What NOCs do share in common as distinct from the familiar international oil companies (IOCs) is being answerable to a host government, which inevitably brings with it some focus on objectives other than simple profit maximization. Typically, an NOC arises originally from the desire of resource-rich governments (“principals”) to gain more effective control over resource extractors (“agents”) by creating an oil champion owned by the state. Prior to NOC formation, governments are frequently (and often justifiably) wary of exploitation by the foreign oil operators providing hydrocarbon extraction services. Lacking a deep understanding of the costs of production, states are simply unable to be sure they are taxing their agents appropriately. In addition to enhancing control over the hydrocarbon sector and the revenue it brings, states may hope for other benefits from the NOC: cheap energy to fuel a growing economy, employment and development of local industry to support the hydrocarbon sector, or even foreign policy leverage derived from control of key resources.

Image

A detailed study of NOC performance and strategy at the Program on Energy and Sustainable Development at FSI suggests a useful way of thinking about the effects of NOC resource domination on world oil and gas markets. Price versus quantity supply curves from classical economics assume that increased price will spur efforts to expand supply. Unfortunately, the counterintuitive reality for NOCs is that, when it comes to expanding supply in the current high-price environment, most either 1) can but don’t want to or 2) want to but can’t. The end result is what one could call a “backward-bending” supply curve — additional price increases do little or nothing to boost supply.

“The world has plentiful hydrocarbons in the ground, but that’s where many of them are going to stay due to the unique organizational and political dynamics of the NOCs.”In the “can but don’t want to” category are resourcerich governments that have decided they cannot assimilate any more money. Already, their investments are running into political resistance around the globe — witness Dubai’s failed attempt to purchase U.S. port management contracts, CNOOC’s failed bid for Unocal, or the increasing calls for curbs on the activities of sovereign wealth funds. Nations may decide they have enough cash and are better off leaving resources in the ground where they safely await monetization at a later date.

In the “want to but can’t” camp are countries and their NOCs that are simply unable to provide the stable political and regulatory climate to support additional build-out of expensive production and transport infrastructure. This situation is particularly common for natural gas, where long investor time horizons are needed to bankroll the multibilliondollar capital costs of pipelines or liquefied natural gas (LNG) terminals.

Meanwhile, international oil companies are left on the sidelines salivating helplessly over the vast reserves in NOC hands. Venezuela’s Orinoco region could yield hundreds of billions of barrels of heavy crude, but the government and a nowpliant PDVSA invite favored countries and their NOCs to explore rather than selecting the operators most capable of extracting the challenging but plentiful resource. Technical expertise and massive investment are required to fully develop vast Russian gas fields including Kovykta, Shtokman, and Yamal, but IOCs already burned by nationalizations and shifting rules in these and other Russian ventures are unlikely to be in a position to supply enough of either. In the face of dwindling resources they can tap, IOCs will need to diversify their business models, perhaps tackling technologically challenging options like oil sands or liquids from coal in conjunction with the carbon storage techniques that could make these palatable from a climate change perspective. Ironically, the only “easy” oil for IOCs has become oil that is geologically and technologically difficult.

While oil price is dependent on many factors (including global economic health) and is impossible to forecast with certainty, one can confidently predict continued tight supply of oil and gas, especially given global demand that will be propped up indefinitely by rising consumption in China and India. The world has plentiful hydrocarbons in the ground, but that’s where many of them are going to stay due to the unique organizational and political dynamics of the NOCs. Leverage over the market is weak; measures to reduce demand for oil and gas (though politically unpopular) or to spur development of alternative fuels and associated infrastructure (though slow to develop at scale) may be all that we have.

“Should the United States promote democracy around the world?” Stanford alumna Kathleen Brown, a former FSI advisory board member, former Treasurer of the State of California, and current head of public finance (Western region) Goldman Sachs

How are democracy, development, and the rule of law in transitioning societies related? How can they be promoted in the world’s most troubled regions? These were among the provocative issues addressed by faculty from the Freeman Spogli Institute’s Center on Democracy, Development, and the Rule of Law, as part of Stanford Day in Los Angeles on January 21, 2006. Panelists included Michael A. McFaul, CDDRL director, associate professor of political science, and senior fellow, the Hoover Institution; Kathryn Stoner, associate director for research and senior research associate at CDDRL; and Larry Diamond, coordinator of CDDRL’s Democracy Program, a Hoover Institution senior fellow, and founding co-editor of the Journal of Democracy.

The capstone of a day devoted to “Addressing Global Issues and Sharing Ideas,” the CDDRL panel was attended by more than 850 alumni, Stanford trustees, and supporters as part of the nationwide “Stanford Matters” series. Moderated by Stanford alumna Kathleen Brown, a former FSI Advisory Board member, former treasurer of the State of California, and current head of public finance (western region) Goldman Sachs, the panel looked at some of the toughest trouble spots in the world, including Iraq, Russia, and other parts of the former Soviet Union.

“Should the United States promote democracy around the world?” Brown began by asking Center Director Michael McFaul. “The President of the United States has said that the United States should put the promotion of liberty and freedom around the world as a fundamental policy proposition,” McFaul responded, noting “it is the central policy question in Washington, D.C., today.” It is not a debate between Democrats and Republicans, he continued, but rather between traditional realists, who look at the balance of power, and Wilsonian liberals, who argue that a country’s conduct of global affairs is profoundly affected by whether or not it is a democracy. The American people, McFaul noted, are divided on the issue. In opinion polls, 55 percent of Republicans say we should promote democracy, while 33 percent say no. Among Democrats, only 13 percent answer unequivocally that the United States should promote democracy.

“The President of the United States has said that the United States should put the promotion of liberty and freedom around the world as a fundamental policy proposition, and it is the central policy question in Washington, D.C., today.” CDDRL Director Michael McFaulAsserting that the United States should promote democracy, McFaul offered three major arguments. First is the moral issue—democracies are demonstrably better at constraining the power of the state and providing better lives for their people. Democracies do not commit genocide, nor do they starve their people. Moreover, most people want democracy, opinion polls show. Second are the economic considerations—we benefit from open societies and an open, liberal world trade system, which allows the free flow of goods and capital. Third is the security dimension. Every country that has attacked the United States has been an autocracy; conversely, no democracy has ever attacked us. The transformation of autocracies, including Japan, Germany, Italy, and the Soviet Union, has made us safer.

It is plausible to believe that the benefits of transformation in the Middle East will make us more secure, McFaul argued. “It would decrease the threats these states pose for each other, their need for weapons, and the need for U.S. intervention in the region,” he stated. Democratic transformation would also address a root cause of terrorism, as the vast majority of terrorists come from autocratic societies. There are, however, short-term problems, McFaul pointed out. Free elections could lead to radical regimes less friendly to the United States, as they have in Egypt, Iran, Iraq, and now in Palestine. U.S. efforts to promote democracy, he noted, can actually produce resistance.

Having advanced a positive case, McFaul asked FSI colleague Stoner-Weiss, “So, how do we promote democracy?” Stoner-Weiss, also an expert on Russia, said it is instructive to see how Russia has fallen off the path to democracy. In 1991, when the Soviet Union collapsed, it seemed to be an exciting time, rife with opportunity. “Here was an enemy, a major nuclear superpower, turning to democracy,” she stated. Despite initial U.S. enthusiasm, the outcome has not been a consolidated democracy. Russia, under Vladimir Putin, is becoming a more authoritarian state, a cause for concern because it is a nuclear state and a broken state—with rising rates of HIV and unable to secure its borders or control the flow of illegal drugs.

“So can we promote democracy?” Stoner-Weiss asked. The answer is a qualified yes, from Serbia to Georgia, and the Ukraine to Kyrgyzstan. But Russia has 89 divisions, 130 ethnicities, 11 time zones, and is the largest landmass in the world, she noted. Moving from a totalitarian state to a democracy and an open economy is enormously complicated. As Boris Yeltsin said in retiring as president on December 31, 1999, “What we thought would be easy turned out to be very difficult.”

Where is Russia today? It ranks below Cuba on the human development index; it is moving backward on corruption; and its economic development is poor, with 30 percent of the public living on subsistence income. Under Putin’s regime, private media have come under pressure, television is totally stated controlled, elections for regional leaders have been canceled, troops have remained in Chechnya, and Putin has supported controversial new legislation to curb civil liberties and NGO’s operating in Russia.

“How did Russia come to this?” she asked. In retrospect, the power of the president has been too strong. Initial “irrational exuberance” in the United States and Europe about what we could do has given way to apathy. Under Yeltsin, rule was oligarchical and democracy disorganized. Putin came to office promising a “dictatorship of law” to rid the country of corruption. Yet Russia under Putin, who rose through the KGB and never held elective office, has become far less democratic. He has severely curtailed civil liberties. The economy, dependent on oil and natural gas, is not on a path of sustainable growth.

“What can the United States do?” Stoner-Weiss asked. We have emphasized security over democracy, she pointed out, and invested in personal relations with Russia’s leaders, as opposed to investing in political process and institutions. We do have important opportunities, she noted. Russia chairs the G-8 group of major industrial nations this year, providing major opportunities for consultation, and wants to join the World Trade Organization. The United States should advance an institutional framework to help put Russia back on a path to democracy, a rule of law, and more sustainable growth, she argued.

Diamond, an expert on democratic development and regime change, examined U.S. involvement in the Middle East, noting that it is difficult to be optimistic at present. “Democracy is absolutely vital in the battle against terrorism,” he stated. The United States has to drain the swamp of rotten governments, lack of opportunity for participation and the pervasive indignity of human life. “The dilemma we face,” he pointed out, “is getting from here to there in the intractable Middle East.” There is not a single democracy in the Arab Middle East. This is not because of Islam, but rather the authoritarian nature of regimes in the region and the problem of oil.

“Can we promote democracy under these conditions?” Diamond asked. We need to get smart about it, he urged, noting that success depends on the particular context of each country. “If we want to promote democracy, the first rule is to know the country, its language, culture, history, and divisions,” he stated. We need to know, he continued, “who stands to benefit from a democratic transformation and, conversely, who stands to lose?” Rulers of these countries need to allow the space for freedom, for civic and intellectual pluralism, for open societies and meaningful participation. The danger is that there could be one person, one vote, one time. A second rule is that “academic knowledge and political practice must not be compartmentalized.” “To succeed,” Diamond stated, “we need to marry academic theories with concrete knowledge of these countries’ traditions, cultures, practices, and proclivities.”

In the lively question-and-answer session, panelists were asked, “Under what conditions is it appropriate to use force to promote democracy?” McFaul answered that we cannot invade in the name of democracy—we rebuilt Japan in that name but we did not invade that nation. We invaded Iraq in the name of national security. We know how to invade militarily, but still must learn how to build democracy. Effectiveness in the promotion of democracy, Diamond pointed out, requires the exercise of “soft” power—engagement with other societies, linkages with their schools and associations, and offering aid to democratic organizations around the world. Stoner-Weiss concurred, noting that we have used soft power effectively in some parts of the former Soviet Union, notably the Ukraine. People-to-people exchanges definitely help, she added.

To combat Osama bin Laden and the threat of future attacks in the United States, Diamond stated, we must halt the proliferation of nuclear weapons. North Korea and Iran are two of the most important issues on the global agenda. And we have got to improve governance in the Middle East in order to reduce the chances that the states of the region will breed and harbor stateless terrorists. A democratic Iran is in our interest, McFaul emphasized. Saudi Arabia must change as well—the only issue is whether change occurs with evolution or revolution. Democracy, economic development, and the rule of law, McFaul concluded, are inextricably intertwined.

Asked by alumnus and former Stanford trustee Brad Freeman what needs to happen to re-democratize Russia, McFaul pointed out that inequality has been a major issue in Russia—a small portion of the population controls its wealth and resources and, therefore, the political agenda and the use of law. Russia has been ruled by men and needs the rule of institutions, said Stoner-Weiss. We should insist that Putin allow free and fair elections, freedom of the press, and freedom of political expression, and re-focus efforts on developing the institutions of civil society, she stated.

Reform is a generational issue, McFaul emphasized. We need to educate and motivate the young so they can change their country from within. The Stanford Summer Fellows Program, which brought emerging leaders from 28 transitioning countries to Stanford in the program’s inaugural year of 2005, provides an important venue for upcoming generations to meet experienced U.S. leaders and others fighting to build democracies in their own countries. Such exchanges help secure recognition that building support for democracy, sustainable development, and the rule of law is a transnational issue.

After the exhausting and dispiriting testimony of General David Petraeus and Ambassador Ryan Crocker to Congress this week, it is now even more starkly apparent that we are stuck in Iraq with no exit strategy. The plan of the Bush administration, and of these military and diplomatic leaders, is still to "stay the course" and hope things will finally take hold in Iraq: hope that the competing Iraqi parties and factions will finally settle their biggest political differences; hope that the Iraqi Army will finally show the ability to face down threats to security and hold the country together; hope that "strategic patience" will eventually allow us to draw down our forces to a level that will not stretch the U.S. Army to the breaking point. But as a group of mid-level American military officers who served in Iraq observed in a devastating edited volume of this name, "Hope is Not a Plan."

To be fair, the U.S. military surge in Iraq (and its attendant shift in strategy on the ground), has achieved many positive things. Iraqi and American casualties have fallen sharply (by more than two-thirds on some measures) from their peak levels in 2006 and early 2007. The Iraqi army and police have grown by roughly 100,000, in addition to some 80,000 local community militia forces ("concerned local citizens") armed and paid by the U.S. As a result of increased force levels and a dramatic change in strategy toward engaging the Sunni Arab communities (including forces once active in the resistance), Al Qaeda has been driven out of most Sunni Arab communities, particularly in Anbar province, and its fearful grip on that section of the country has been broken. This has been the most important achievement of the surge. In many Iraqi urban neighborhoods, both in Baghdad and in other cities, particularly in the once lawless Anbar province, Iraqis have been able to return to the streets and to something approaching normal commercial and social life.

One of the biggest blunders has been the analytical failure to see that the Shiite Islamist political party's political triumph in Iraq would bring a strategic bonanza to Iran--effective control of at least the southern half of Iraq. These are not small achievements. Unfortunately, in the absence of a larger and more tough-minded strategy, they are also not sustainable ones.

John McCain may have been right for the moment when he declared to the Kansas Veterans of Foreign Wars on April 7, "We are no longer staring into the abyss of defeat." Unfortunately, in the context of continued political stalemate in Baghdad and the absence of a viable political strategy for stabilizing Iraq, the second part of his sentence simply does not follow: "... and we can now look ahead to the genuine prospect of success." Rather, as Petraeus and Crocker unwittingly made clear, what we can look forward to is the indefinite commitment of 130,000 to 140,000 American troops, holding together a country that would otherwise shatter into much wider bloodshed. Hope is not a formula for success.

The truth is, we remain trapped in an awful quagmire. No less staunch a Republican than Senator Richard Lugar observed in the Senate hearings this week, "Simply appealing for more time to make progress is insufficient." Senator McCain lacks the candor or clarity of mind to recognize that absent a new political strategy, we are stuck in a holding pattern, propping up a badly divided and corrupt political class in Baghdad. At least he has had the candor, however, to acknowledge that, under these circumstances, American troops might have to be in Iraq for another 10, 20, or 100 years.

Senators Clinton and Obama, in turn, recognize that the United States cannot maintain large numbers of American troops in Iraq for anything like that long. Not only will Iraqi resistance forces rise up against it again, but these commitments are draining our fiscal and military vitality.

Even if we were to leave Iraq tomorrow, it would take years to rebuild, re-equip, and reset the American armed forces to their pre-war levels of capacity and readiness. In a survey of American military officers by the Center for a New American Security, 88 percent thought the war had stretched the US military dangerously thin. And then there is the question of what kind of Army we will be left with as we have to lower standards further and further to find the "recruits" to sustain this military quagmire. CNN reported on April 7 that one out of every eight new recruits requires a waiver because of past criminal behavior or other prior misconduct. The percentage of high school graduates among recruits has declined to 79%. Retired General Barry McCaffrey said recently that ten percent of Army recruits "should not be in uniform." And when the Vice-Chief of Staff of the Army testifies (as General Richard Cody did last week) that repeated deployments are placing "incredible stress on our soldiers and their families" and that "our readiness is being consumed as fast as we can build it," you know we have a serious problem.

Yet Clinton and Obama don't see the other side of this awful reality: that a swift, unconditional timetable for withdrawal of the kind they propose (on the order of one to two combat brigades per month) would likely see Iraq slip back into all-out civil war -- unless something dramatic changes in the political landscape there.

We urgently need an exit strategy from Iraq, but it cannot simply be to declare we are leaving by some fixed, early date -- and goodbye and good luck. Without the prospect of a substantial American military drawdown on the near horizon, Iraq's political factions will lack the incentive to make the hard choices for a sustainable compromise that might hold the country together. But in the absence of an intense diplomatic effort to broker this compromise, the prospect of imminent American withdrawal will not induce compromise, but rather rigidity and the psychology of preparing for an imminent civil war.

So what needs to be done?

To begin with, we need a more hard-headed analysis of our real interests. For years now, the Bush administration has leaned toward the Shiite Islamist political party, ISCI (the Islamic Supreme Council of Iraq, formerly the Supreme Council for the Islamic Revolution in Iraq, or SCIRI). ISCI and its militia, the Badr Organization, which has heavily penetrated the Iraqi army and police, were formed in exile in Iran in the 1980s and grew up under the heavy influence there of the Iranian Revolutionary Guards. They subscribe to the hard-core Khomeini of system "velayat al faqih" -- rule by the Islamic jurist. And they have welcomed numerous Iranian agents into Iraq to help them establish that system.

Of the many grand blunders of the Bush administration in Iraq, one of the biggest has been the analytical failure to see that ISCI"s political triumph in Iraq would bring a strategic bonanza to Iran -- effective control of at least the southern half of Iraq. To pave the way for this, ISCI and its leader, the ailing Islamist cleric, Abdul Aziz al-Hakim, have long sought to gather all nine provinces in the Shiite southern half of the country into a single super-region, which would enable ISCI to establish political hegemony over the entire Shiite region, control most of the country's oil resources (based mainly in the Basra area of the far south), and dominate the politics of the center.

Prime Minister Nuri al-Maliki's recent ill-fated crackdown on the Mahdi Army militia of Muqtada al-Sadr was not just about establishing order in the south. A more important subterranean motive (for which the United States allowed itself to be used) was to remove the chief obstacle to ISCI's bid for hegemony in the south. Sadr and his disparate political and militia forces oppose the creation of a Shiite super-region, and constitute the most significant political rival to ISCI (and its junior partner in Shiite politics, Nuri al-Maliki's Dawa party). ISCI's calculation has been that if Sadr could be neutralized, its path to victory in the coming provincial elections in October could be cleared, and then it could press forward with its aim of gathering all nine southern provinces into one.

We should have no illusions: Sadr is a nasty, deeply illiberal character. His militia forces, or those who swagger around, draped in weapons, seizing territory and imposing Islamic order in his name, often approximate the Taliban in their level of commitment to human rights, women's rights, religious freedom, and the rule of law. But Sadr's political movement is a broad tent that also includes more nationalist Shiite elements who share with one another (and with many Sunni Arab factions with whom they have been in contact) a determined resistance to ISCI's and Iran's bid to control southern Iraq, and through that region, the country as a whole. In other words, the participation of the Sadrist movement in electoral politics at least preserves political fluidity and pluralism. Its elimination, while leaving ISCI and its tightly knit militia network in control of much of the security apparatus and of existing provincial governments in the south, paves the way for Iranian domination.

One of the greatest and most bitter ironies of the Bush administration's posture in Iraq has been its persistent failure to see how it was handing the greatest threat to security in the region -- the Islamic Republic of Iran -- a grand strategic prize. So far, the Iranian regime has largely succeeded in its goals of bogging the U.S. down in a bleeding insurgency, draining its military and its treasure and sapping its will, until the point that Iraq (so they think) will fall into their hands like a ripe apple. No wonder the Iranian ruling elite so often seems to be smiling like a mafia gang on its way to eliminating its rivals. As one Iraqi recently observed to me, "The Iranians are more intellectual, more strategic, and more patient than the U.S. The Bush administration's approach in Iraq has been purely tactical. When the U.S. spends a billion dollars in Iraq, Iran spends $50 million and gets more."

It is not clear that this strategic victory for Iran in Iraq can be prevented at this point. Certainly it will not come from the Kurds, who have long since struck a cynical bargain with ISCI: they can have their Shiite super-region, and in return the Kurds want to absorb into their Kurdistan region the city and province of Kirkuk, whose vast oil resources would make eventual Kurdish independence a much more viable proposition.

It does not take much facility in political arithmetic to figure out who are the big losers in all of this: first of all the Sunni Arabs (about twenty percent of Iraq's population), who have no major oil producing assets in the provinces where they predominate, and who believe the creation of a Shiite super-region would be a formula for their own permanent marginalization and impoverishment. The other big loser would be all those Iraqis (surprisingly, a majority) who continue to believe in the idea of a united Iraq, and who are adamantly opposed to Iranian domination.

For this reason, the bargain between ISCI and the Kurds (codified in the 2005 constitution) cannot be the basis of a stable and democratic Iraq. It leaves out two crucial sections of the population: first, the Sunni Arabs, and second, a majority of Iraq's Shia as well, who fought Iran in a bloody eight-year war in the 1980s and do not want their territory to become a satellite of Iran's Islamic Republic. If the United States were to withdraw from an Iraq configured along these lines, civil war would almost certainly follow. It would pit an ISCI-dominated government in the south and in Baghdad, backed by Iran, against a loose coalition of Sunni Arab and Shiite nationalist resistance, backed by Jordan, Saudi Arabia, and other Sunni Arab states in the region alarmed by Iran's expanding power (which also includes a determined drive to acquire a nuclear weapons capacity). And in the chaos, there would also be a welter of more local-level fights for dominance.

The only way out of this nightmare scenario is a coherent, well-prepared, vigorous effort to broker a constitutional compromise before it is too late. The parameters of the necessary bargain have been clear for many years. ISCI would need to give up its ambition of a single, nine-province super-region, but could be granted a federal system with the eventual ability to lobby for creation of smaller regions (of up to three provinces each, as the interim Iraqi constitution had allowed for). The Kurds would get to keep their own region as part of a federal system, but the development of new oil fields would remain a prerogative mainly of the central government, not, as the Kurds and ISCI wish, regional governments. The Sunnis would have to reconcile themselves to being a minority political force in Iraq, but their provinces would be assured a fair and automatic distribution of the oil revenue, more or less in proportion to each province's share of the population.

There are a number of other issues to be worked out as well (including the reintegration of former Baathists below the top level into government, and the pruning of ISCI loyalists from the commanding ranks of the security forces, especially the police). But the pivotal elements of a deal involve the structure of the federal system and the control of oil production and distribution of its revenue.

The constitutional deal that is needed cannot be brokered by the United States alone. A "diplomatic surge" is urgently needed, in which the U.S. would partner with the UN and the European Union. For an administration that has been loathe to surrender control in Iraq, this is a difficult step, but without it, there will be no political breakthrough, and thus no exit from the quagmire.

In the context of such a grand bargain, the United States could draw down somewhat more gradually than Clinton and Obama now envision, perhaps getting down over the course of about three years to a small residual security force to protect American civilian operations in Iraq. If the provincial elections scheduled for this October can come off without massive intimidation and bloodshed, that will help, as it will likely deliver setbacks tin the south to ISCI and Dawa (who have governed poorly) and generate a more pluralistic political terrain, in which power in the Shiite south is shared by a more diverse set of actors.

It is far from clear that Iran, so close to winning its prize, would not sabotage such an outcome. Direct and intensive engagement with the Iranian regime would also be needed. This could offer the Iranians other incentives as part of a larger deal that would include verifiable suspension of their nuclear program. It could also play on the prospect of what they could themselves could face in an Iraq without the United States: a divided Shiite community, part of which is rising up in resistance to their dominance, allied with a united Sunni community with the broad backing of other Arab states in the region. And all of this before they had acquired the nuclear weapon they think will give a huge boost to their regional power.

A certain amount of brinksmanship would be needed to demonstrate to Iran that the alternative to compromise in Iraq is that they could wind up trading places with us, being bled and drained in an insurgent war while their enemies score opportunistic gains. In that case, the strategic prize could become an albatross around the neck of a regime that faces huge economic and political problems within Iran itself.

The above offers no sure path out of Iraq. Should diplomacy fail, we would be left with little choice but to prepare to withdraw, perhaps rapidly and in extremis, letting the regional actors and the Iraqis themselves pick up the pieces. It would be an ugly and costly scenario. But the credible threat of it might be the one thing that tips Iraq's polarized parties toward accommodation. And bad as it would be for a time, it could hardly be worse than having the United States bogged down in Iraq, desperately holding our military fingers in the dike for the decades that Senator McCain seems prepared to envision, while both our military capacity and our soft power drain away.