While Hemenway's article that purports to debunk the catastrophists' scenarios is a nice try, it has several weaknesses, and vtpeaknik has illuminated many of these.  There are three other things worth emphasizing:

1.  1965 vs. 2006.  In 1965, there were approx. 3.3 billion people on the planent.  Today, there are approx. 6.6 billion, i.e. double the population.
In 1965, a much smaller percentage of the planets food and energy crops were genetic varieties requiring lavish dosages of synthetic fertilizer, fungicides, insecticides and herbicides, and generous (and energy intensive due to pumping) amounts of irrigation.  Norman Borlaug's "green revolution" essentially    transformed world agriculture creating vulnerable, but high yielding varieties that could never survive on their own in the wild.  More primitive plant breeding techniques pre-Borlaug  had given us lower yielding varieties, but at least these varieties weren't so weak, so drought intolerant, and so dependent on petro-derived chemical protection.  In 2006, we can look back at the last 30+ years and see how we have simply delayed the day of reckoning to stabilize world population - instead we were lulled to sleep by leveraging agriculture with a diminishing resource - fossil fuel.  As oil & gas get more scarce, there will most certainly be a frantic return to less chemical dependent means of crop production.  The question is, with such a high percentage of the world dependent on the status quo (Archer Daniels Midland, etc) and upon imports of food aid: will there be chaos?  widespread starvation in places like Egypt?  It would seem to be highly likely.  We really don't know how many people the planet can support using permaculture, or more hollistic methods of food production. But, the last time we tried (pre-1965), the population was less than half of today's, and even then, there was considerable hardship in the developing world.

2.  Diminishing Returns of Technology for Efficiency.  Regarding the potential for conservation via technology, Hemenway is at best naive.  Sure, as energy gets expensive, lots more people may drive less, or carpool.  But don't be delusional about constantly doubling fuel efficiency.
The best examples we have for efficient cars are from Honda & Toyota - Honda's Insight gives at best 70 mpg, but only carries two people and little else.  This is a 3 cyl. engine with a big battery.  If you just want a 3 cyl engine you can dredge up the old Geo Metro from the early 90s - it got 54 mpg tops.  The old Civic VX got 50 mpg, and the smallest Toyota Yaris maybe 52 mpg.  Anyway,  Honda's & Toyota's engineers have been working on the efficiency thing for decades, and we are likely to only see tiny increments of improvement going forward.  The most likely scenario is that people will be replacing their cars with 1 cylinder motorbikes to carry two persons plus a bit of stuff.  With these you could eke out 100 mpg.   But before we retreat to these more minimalist modes of transportation, what will become of the hundreds of millions of existing gas guzzlers?  Will they be magically recycled, just in time?  
In terms of home heating, we may see people retreating into smaller portions of their homes in the winter, and draining the plumbing from parts they can't afford to heat.  Also, they could thicken the walls with scraps from other construction, but again, where are the huge leaps in efficiency going to come from?

3.  There are legitimate weaknesses in the scenarios laid out by the more "catastrophist" wing of the peak oil milieu, but Hemenway misses them.  On Savinar's site, for example, he mentions what the world or US population is likely to be (based on a UN estimate) by the year 2020 and juxtaposes this with how small oil reserves are likely to be at this time.  What Savinar fails to grasp is that once oil prices pass a certain threshold, say, $100 per barrel, maybe higher, the growth in world population is likely to stop in its tracks, and begin reversing.  Many countries in Africa, and parts of Asia are going to suffer unprecedented levels of austerity once the industrial agricultural complex begins to falter, and first world nations can no longer give food aid or even sell much food for export.  When this happens, people who might be considering having children simply won't be able to.  Their own survival, and where to find their next meal will their only thought.
   

Dude, you are quite right to raise the population issue in association with oil depletion.  The product of gross depletion, decreasing EROEI and increasing population stands to make the descent much steeper - as we have to get by on MUCH less energy per capita than we've been accustomed to and built an infrastructure (particulary food production) reliant upon.  But I have to disagree with you on one point.  Pop. growth will not "stop in its tracks".  Even poor, desperate people have children.  There's tremendous momentum in the demographic structure.  The global bulge of those currently under 30 (give or take) are going to have a lot of kids themselves.  Once things are bad enough for enough of them to be starving to death rather than procreating, we'll be living (and dieing)in TEOTWAWKI, rather than  having staved it off.
My latest crunching of these numbers (and I'm not a number cruncher by nature) is thus: Assuming decline of FIP of 5-8%, half of which is offset by new production, yields a net decline of 2.5-4%. Ten years out, as EROEI declines from todays ~15:1 to ~10:1-7:1, and population grows to ~7.5 billion, we're left with a net available energy of about 2.5 barrels/person/year, compared to today's ~4.4 bbls/pers/yr. So we'll have roughly 60% of today's available oil per person in just ten years. I'd love to see someone adept at graphics figure out a way to show this visually.
Clifman,
You may be partly right about the behaviour of poor people in times of austerity.  Clearly things have been brutal in countries like Somalia, Ethiopia and Sudan for decades, yet these countries populations keep increasing.  It is hard to know exactly how much more marginal a person's existence needs to become before a person consciously decides not to have children.  Typically though, once a woman's physiology is compromised by lack of adequate food energy their body is either too weak to procreate or conception does not occur.
It is a too-oft forgotten fact that during the oil shocks of the 70s there were short periods of starvation in countries dependent on food aid.  Clearly, countries like Egypt with population sizes that have gone far beyond their  lands carrying capacity will suffer immensely if US & Euro food aid is cut off.  Initially there may be rationing...later there may be an attempted exodus north to Turkey and Greece.