A Different Way to Perform the Hubbert Linearization

A quick post about a different manipulation of the logistic differential equation. By using the first derivative, we get a new way to perform the Hubbert linearization. Some results are given on Norway and the US oil production.

[Updated by Khebab on 08/18/2006 at 02:36 PM EDT] After some thinking, I came up with a simple way to combine the two linearizations (see text below).
The logistic differential equation relates the production P to the cumulative production Q as following:
P=dQ/dt=KQ(1-Q/URR)
This equation is the basis for the standard Hubbert Linearization (HL) technique as explained by Stuart here. Let's differentiate P:
dP/dt=(dP/dQ)(dQ/dt)=(dP/dQ)P=K(1-2Q/URR)P
We get the following new equation for the production relative annual increase:
(dP/dt)/P=K(1-2Q/URR)
Therefore, for a logistic curve, the relative annual production increase is a linear function of the cumulative production. The logistic parameter (K and URR) can be estimated by a simple linear fit using the annual production increase versus cumulative production representation (see Fig. 2 below). The new HL line crosses zero at half the URR value. There are different ways to numerically estimate the first derivative, for instance we can use dP/dt=P(t)-P(t-1) or dP/dt=(P(t+1)-P(t-1))/2. The second approach is probably more accurate because less sensitive to noise and it is not shifted as the first one. We can compared the results of the standard HL and the second HL techniques on the Norway production (Fig. 1 and Fig. 2) and the US production (Fig. 3 and Fig. 4).




Fig. 1-
Standard Hubbert linearization (top) and resulting logistic curve (bottom). The peak date is determined by matching cumulative productions for the last year. (data from BP 2006, all liquids excluding refining gains). Click To Enlarge.



Fig. 2-
Hubbert linearization on the production annual increase (top) and resulting logistic curve (bottom). The peak date is determined by matching cumulative productions for the last year. (data from BP 2006, all liquids excluding refining gains). Click To Enlarge.



Fig. 3-
Standard Hubbert linearization (top) and resulting logistic curve (bottom) for the US. The peak date is determined by matching cumulative productions for the last year. (data from the EIA, crude oil only). Click To Enlarge.



Fig. 4-
Hubbert linearization on the production annual increase (top) and resulting logistic curve (bottom) for the US. The peak date is determined by matching cumulative productions for the last year. (data from the EIA, crude oil only). Click To Enlarge.


A few comments:
  1. this approach is much more sensitive to noise because of the use of the production first derivative and seems to give more reliable estimates for the URR than for K.
  2. the data representation is more symmetric compare to the standard HL approach which is very sensitive to noise for low cumulative production values (therefore, early production data points are generally excluded).
  3. the two HL techniques could be combined.
[Updated by Khebab on 08/18/2006 at 02:36 PM EDT] After some thinking, I came up with a simple way to combine the two linearizations: if you look at the original HL equation and the proposed second HL, they only differ by a factor 2 on the slopes, their intercept with the y-axis being the same and equal to K. Therefore, the two representations could be mixed together by multiplying the cumulative production by a factor two in the second representation (shown as blue dots on Fig. 5).


Fig. 5-
Hybrid Hubbert linearization combining the production annual increase (blue points) and the standard P/Q representation (black points), the resulting logistic curve (bottom) for the US. The peak date is determined by matching cumulative productions for the last year. (data from the EIA, crude oil only). Click To Enlarge.


Other stories on TOD about the Hubbert Linearization here. The Datasets used in this post can be found here.
solid Khebab...very solid.  differential equations: they rock.
I was able to scrape some of the mental rust off that 30-year old calculus class and actually follow the derivation. Cool analysis.
Noise aside, this approach interests me and i await your early results on global all liquids.  Thanx Khebab.
Below a first attempt using the years 1983-2005 (BP data), the peak year is 2013:



Not to make too much of this, but eyeballing the graph the 2013 predicted peak looks like around 1.5 mbpd more than now?
+2.53 mbpd to be precise:

P(2013)= 83.62 mbpd
P(2005)= 81.1 mbpd

Just a reminder to all that this would indicate an 88-mbd peak (83.6 + 4.4 ref gain) based on ASPO.
Actually, BP & ASPO differ on 2005.  The indicated all liquids peak is implied at 86.7-mbd (83.6 + 3.1 ref gain) based on BP/IEA data for 2005.
The problem with all linearizations is choosing which data to include in the fit. Depending on your data choice you can move the peak around a few years.
Thats why it would be nice to have a method where you didn't have to exclude any data points.  The 2nd HL method looks closer to being able to do that.
I agree, it'a common problem with the curve fitting approach especially when we have several production peaks.
what is this all about?
Pumping the fear factor out of oil
As more production comes online over the next few years, prices may ease by as much as $20 a barrel.
http://money.cnn.com/2006/08/18/news/economy/oil_fear/index.htm
It would even be more effective with a 10% cut in consumption by the US. ;-)
A good piece on current oil price dynamics. Have any of you started drafting those press releases suggesting we all ride oxen to work?

Peak Oil Passnotes: Supply 'Cushionitis'

By Edward Tapamor
18 Aug 2006 at 11:49 AM EDT

PARIS (ResourceInvestor.com) -- You have seen what Resource Investor was mooting about the oil market last week, basically come true. Oil has actually fallen a little faster than we expected - to around $71 - but it still has an important couple of barriers to break before it goes really wild to the downside. So let us take a little look at some recent history and see if we can figure out why.

On April 21st the Nymex WTI price reached $75.17 on the back of worries over Iran and general supply tightness. By June the Nymex WTI was at $69 before it set off on its latest run. In other words it had hit a strong high before falling back. It then surged back once more to hit $78.40 on July 14th before dropping off once again. Then we reached an odd moment a few days ago, on August 7th when some genuine myopic hysteria set in around the crude markets.

Brent crude had broken up past the WTI by August 7th as supplies of Brent became constrained by declines and increasing seasonal demand, pushing up past its historically higher-priced relative. The price was spurred by a number of reasons, not of which were crystal clear. One being the Israeli attack on Lebanon, others being the problems in Nigeria and the first signs of the difficulties for BP [NYSE:BP; LSE:BP] at Prudhoe Bay.

At the time we pointed out that although significant these events were underpinned by the - now seemingly age old - supply cushion absence. As there was no supply cushion the market had driven itself into hysteria. The Prudhoe Bay outage was not that significant although it was not helpful. Lebanon did not produce oil even though indirectly the invasion was about energy being a proxy war between the U.S. and Iran. Nigeria was going on the same as it has been in recent months.

Brent boomed up to an all time record of $78.64 intraday and $78.30 at the close with the WTI chipping in at a healthy $77.05 at the end of trading.

Now just 10 days or so later Nigeria actually seems to have got worse, armed men stormed a bar in Port Harcourt (who calls a bar Goodfellas in a place like that?) although the short-term outage at Nembe Creek of around 180,000 barrels per day has been restored. Meanwhile the Lebanon situation is still not really impacting oil and its supply. BP on the other hand has managed to keep somewhere around half of its Prudhoe Bay output online, even so you will note that is a loss of some 200,000 barrels per day. A loss is after all a loss.

Yet we are seeing the WTI hit exactly $70 intraday, some seven dollars off its high in around eight days active trading. Brent is around $72. A big, big move to the downside.

There is one other reason, Goldman Sachs. They are not excited about the new gasoline contract for - cough - reformulated gasoline blendstock for oxygenate blending or RBOB. New regulations in the U.S. have meant that RBOB is replacing methyl tertiary butyl ether (MTBE) in gasoline. Sachs are not about to risk a load of cash on this new contract so they have simply stopped playing.

The result of such a big player leaving the table is that there is no liquidity - or relatively little - in the gasoline market. This has pulled down the price of gasoline which has impacted on the price of crude. So the combination of events, Lebanon ceasefire, Prudhoe Bay, staying half-online, Nembe Creek being repaired and RBOB illiquidity have stuck a knife in the gut of the oil price. Then we hear stuff like this.

"Some of the factors and disruptions that helped drive us to very high levels have been resolved now," according to a statement by from Eoin O'Callaghan at the French bank BNP Paribas.

No they have not.

Lebanon is not resolved, Nigeria is not resolved, Prudhoe Bay and BP's general behaviour is not resolved, Iran is still awaiting the outcome of its nuclear enrichment programme and demand is still healthy. What has happened is the market has seen a great time to take a big chunk of profits. A breather. That is all.

If we were smart guys we would open a book on the first "Oil Makes Dramatic Surge" headline. No doubt you will see it in the next sixty days. We will be told all the stories about collapse, markets imploding, frenetic activity on the trading floor and `peak oil freaks' will be telling us to ride Oxen to work. Then we will do the same dance all over again. Isn't energy great?

I'm very sorry for you.  

Did we burst your dreamy life?  Have you read just enough about it to be only scared?  Do you really think that CNN is not selling ads to : car, insurance, housing, bank and oil company so they can stay "impartial"

They dont want to tell you the truth, you cant handle the truth, the economy and those company either.

Oil = finite ressource

No matter what you think.  

Hubbert Linearization is technique developped in 1956 and used since then to calculate the production of whole region or country.

Oil at 20$ may be next door but in that case we will have suffer a very deep, profond and large depression.

Unless you dont have some math background, you cannot increase oil consumption very much because of exponential growth.  I suggest that you take a look at this presentation by prof Albert Bartlett you will see what we mean.

Again, we are very sorry to have woke you.

You should have taken the blue pill.


ohhhhhh, it's the great CNN conspiracy that has allowed oil prices to fall...somebody thank thme for me....and the Bloomberg conspiracy I bet kept them from going to....where...$200, $150 a barrel this past summer as was predicted by so many of the catastrophephists....somebody REALLY thank them for me!  (By the way, as much as I admire them, why don't you all have a field day of ridicule when Simmons or Pickens blows predictions at least as bad as Yergin does? Fair is fair....this year everybody blew it....)

Yes oil is a finite resource, but that frankly don't tell us shiit...(quick,name something on Earth that is not a finite resource except for hungry mouths of beasts to feed, including us....ain't that a paradox?), but just being finite does not tell us HOW MUCH is out there, now does it?

"... we are very sorry to have woke you."  Cute and humorously snide, but don't worry about waking us....some of us are a helll of a lot more awake than you give us credit for....
(now I am just waiting for that great MSNBC conspiracy to kick in so the prices will really come down....how'd a thought that bringing prices down could have been this easy?  :-)

Roger Conner  known to you as ThatsItImout

Actually, "finite" does tell us something: The amount of oil is limited. And, with constant growth (populations, economies), we'll likely hit that limit soon. If two trillion barrels of light sweet were discovered in Antarctica tomorrow, we'd still be screwed in the short-term because of steady growth, which is the core issue.

-best

Of course the only true problem is GROWTH in a finite environment!

But that does not seem to be of concern at TOD, 99.98% of the posts are about, when THIS particular Peak Oil will happen, brainstorming about technical "solutions" by mostly technologically ILLITERATES, anecdotes and gossip about life in the US (not so bad, entertaining at least) and endless haggling by Peak Deniers.


"Of course the only true problem is GROWTH in a finite environment!"

Maybe, but at the end of the day, that's biting off more than I can chew.

If I ruled by fiat, and everyone would obey my command to cease fornication (because after all, birth control pills require energy to make!), then maybe growth would cease.....but since I don't and everyone won't, it's a bit of a moot point, isn't it?  Growth, like change, has probably been going on too damm long....but nobody knows how to make either one stop.

You say, "99.98% of the posts are about, when THIS particular Peak Oil will happen, brainstorming about technical "solutions" by mostly technologically ILLITERATES.  That's actually not a bad overview.  I have learned a couple of things since I came here:

  1.  Everybody's a damm physicist!  I didn't know we had so may physics genuises in the country, until every other post I read ended every debate about all the things that could not be done (half of them already being done somewhere) with the flat and knowing assertion, "the physics proves it" or "it's in the physics"....that second one has the cool resigned detachment of the old Bruce Hornsby song..."That's just the way it is....some things will never change.....", and then he takes the counter point, "but don't you believe it..."   I prefer to take the counterpoint.

  2.  Despite the fact that no one knows exactly how much oil and gas there is, or exactly how to define it, everybody knows to the day when we are going to peak!  Astounding that!  Both the optimists and the pessimists have this in common!  Even the Dan Yergin's, despite having no idea whatsoever how much gas and oil is actually out there, completely relient on other people's word, says, we have plenty for the next decade!  While the pessimists like Deffeyes who says that HL (Hubbert Linearization) is holy writ, even though Hubbert Linearization is based entirely on known URR (Ultimate Recoverable Reserves) when confronted on lack of any real knowledge of world URR by anybody, he changes gears and says, "Well, it's production that counts, reserves mean nothing!  You can't pull up to the pump and fill up you car with reserves!"  What do the optimists and the pessimists have in common?  Despite having no idea how much is there, and what exactly counts  (crude oil, all liquids, which of course makes nat gas interchangable with crude oil....despite another poster on TOD who recently shut his ears "hear no evil" fashion, "I have heard too much about bottled gas, there seems to be bottled gas everywhere!"...yep, the world is a confusing place!

  3.  Despite everyone, EVERYONE saying "peak is not "running out!", when they talk you can hear they all have a mental picture of running out, right to the last drop!
Someone says "perhaps we can build windmills", they reply, "that takes oil" as though there won't be a pint left!  Someone says, "perhaps we can build electric cars", they reply "that will take oil to produce them and the batteries".....what, won't there even be a few gallon?"  Medication?  "Big dieoff is coming, medication takes oil."  Now, exactly how many tons of the oil consumed in the world, exactly what percent of the total tonnage goes to production of medication?  (I am leaving aside the fact that many medicines and chemicals are made with natural gas processing for the moment, I love it when people on here will scream about how oil is used to make fertilizer!  Well, actually, it's natural gas....but back to the point....)  You mean that if we reduce the waste burning of crude oil, there still won't be even enough for medicines that actually use it in their production?
You mean if everyone drove a 2 cylinder tin box like a Citreon 2CV, we would still run clear out, and be as Deffeyes says, "Stone age by 2030", or thereabouts?  Does "Peak Oil" really mean a Fred Flintstone world?

The view of the world is sometimes childlike....growth is the problem, tell them to stop!  and they will.....Technology?  Go home and tell you daddy technology is BAD!  It is a BAD THING!!  If he is trying to develop technology, he is a BAD MAN!   Don't let him fool you, and say it's efficient, it is still technology, and will use energy, and we will be OUT, it's BAD!  He is an evil DENIER!  Life in the U.S., it is a BAD THING!!  It must stop, many must die!  Then some will go on and do the right thing....with no TECHNOLOGY, the BAD thing that messed up the world!!

As you say, not so bad, entertaining at least, or at least it would be if it were not so sad, and the problem is far too serous, too complex, too much in need of sophisticated acceptance of real ideas, real modern maturity.

We are not as much paying the price for wasted energy, we are paying the greater price, as we knew we someday would, for wasted talent, preperation, mental ability to design, to concieve of more than yes/no, and to think in terms of multiple, interlocking options and confluent ideas.  We are frankly stumbling in the dark, blind but hoping to pass ourselves off as "seers" who will lead the "ILLITERATES", the "screaming monkeys" and the "sheepies" out of the dark.  Such are the terms we use to win over our disciples.  That alone should tell you volumes.

Roger Conner  known to you as ThatsItImout

Maybe, but at the end of the day, that's biting off more than I can chew.

You may prefer starving to choking but both are an ugly death.

every other post I read ended every debate about all the things that could not be done

"every other", yes, but the OTHER half was all about the miraculous solutions.
Just as unsubstanciated, illiteracy comes both ways.

The view of the world is sometimes childlike

To the point, but nobody is compelled to share so much optimism.

growth is the problem, tell them to stop! and they will...

Of course not, this is my point, telling won't do :
- Enforcing, not politically correct and LOTS of trouble, struggle, strife, unanswerable messy arguments.
- Die-off...

Go home and tell you daddy technology is BAD! It is a BAD THING!!

Are you speaking to me?
I thought I cleared up this in our previous discussions.

to pass ourselves off as "seers" who will lead the "ILLITERATES"

TPTB have been doing a hell of a job leading the illiterates , too bad the looming difficulties are WELL BEYOND THEIR SKILLS, in spite of the high appraisal they have of their capabilities.

we are paying the greater price, as we knew we someday would, for wasted talent, preperation, mental ability to design, to concieve of more than yes/no,

A "price", yes, ignorance can be remedied AT A COST, stupidity cannot.
What is the ratio between these 2 impediments, and, hoping for the best, can we bear the cost?

What happens if you include all the data using the second HL method?  The early data, although noisy, looks symmetric.
Ah, nevermind.  Just read the comments.
Sorry about the last update, I have a weird bug: the < and > characters used for the html tags became &gt and &lt when the post was updated!
I think it's fixed K.  It's a formatting issue with the update function and how it works with HTML, I think.
Well, I'll ask the dumb question:  What does the new method show that the old HL didn't?  I uderstand the noise, K, etc. parts.  But not why the new HL is important.

Todd

Good question. I don't know yet if it's important or not, maybe it's useless :). However, the fact that we can exploit not only the cumulative production values, its derivative (the production) and its second derivative is interesting in itself.
Well Khebad, that's nevertheless interesting. I think that developing different approach to get the same result is actually good in itself.  While it's never ultimate proof, it does show persistence.

As an aside, I will be giving 2 conferences september 23 in Metabetchouan (Lac Saint-Jean).  One in the morning regarding peak oil and one in the afternoon regarding solutions.

I know it's gone a be a bit far from you, but I wanted to let you know.

The local newspaper is going to produce a series of articles also.  I hope regional, then national will pick it up.

Anyway, it's gona be fun.

I believe you are maybe one of the first to give conferences on peak oil in Quebec! good luck and keep me posted.
I'm no mathematician but shouldn't there be some deep reason for the closeness of the result using both methods?

well, look at the first and third equation above, they are basically the same (only a factor 2 in the slope for the second approach hence the hybrid approach I proposed).
OK, I saw that, just checking.

Since I barely escaped with a "C" in last math course in college,  Partial Differential Equations and Boundary Value Problems, when Jimmy Carter was still president, I have tried to avoid calculus, so my inclination is to go with the simplest method that seems to work.  

We know that the old method was 99% accurate (using only production data through 1970) in predicting post 1970 cumulative Lower 48 production, through 2004.  How about if you did the same thing with the second method?

The second method is less acurate because of the noisy first derivative. The hybrid method gives about the same result as the HL on the Lower-48 production.
How do you quantify accuracy, since we don't actually yet know URR? Are you talking accuracy or precision? Are the URRs calculated the two different ways statistically different?
"How do you quantify accuracy"

For the Lower 48 case history that I cited, Khebab just used the production data through 1970 to generate a predicted post-1970 production profile (using HL method #1).   The cumulative post-1970 Lower 48 production was 99% of what the HL method predicted that it would be.  

Since the world is now about where the Lower 48 was at in 1970, this has obvious implications for world oil production.

Westexas is talking about how accurate is the prediction of the cumulative production value Q for the last year based on the fitted logistic curve. For the lower-48, the logistic curve predicts the actual cumulative production Q(2005) with an error less than 1%.

One of the problems with the conventional way of graphing the HL fit is that the y axis variable (P/Q) is a function of the X axis variable (Q).  This is why the variability in the data appears to smooth out with increasing  Q.  This alternate way of graphing the data does not have this problem and so we see the variability seems much greater but uniform.  That is actually a good thing if you are performing a least squares fit.  I've never delved too deeply into how people are doing a hubbert linearization fit,  but it is not strictly apropriate to use the least squares fit on the P/Q versus Q data.  

So good work Khebab, this alternate graphical form of the logistics curve does show the actual variability inherent in the data and is thus a much more informative graphical representation of the hubbert logistics model.      

 

it is not strictly apropriate to use the least squares fit on the P/Q versus Q data.
 
The standard least-square fit assumes gaussian distributed residuals which is not the case for the HL (probably a more heavy tail distribution). I always use a robust fit technique based on robust statistics which is recommended in case of contaminated residuals by outliers.
Very original idea! Thanks for sharing.

I am struck by similarity of both equations:
(dQ/dt)/Q=K(1- Q/URR)
(dP/dt)/P=K(1-2Q/URR)

I understand all the details, but somehow I know that there is something deeper that escapes me. I'll think about it.

I have some questions/comments:

What do you use dP/dt=P(t)-P(t-1) or dP/dt=(P(t+1)-P(t-1))/2? (you favor the second one so I suppose that's the one, don't you?)

It is really nice to combine both methods in the same picture for comparison. But, what I would favor is to draw two lines, one for each method.

To combine all points of both methods and then draw only one line (your hybrid method) seems odd. I understand why you want to do this: you want to compensate the low sensitiveness of the tail of the first method with the noisy second method. But you put too much weight into the left side of the plot, where most of the points are. Anyway, its a very nice idea worth considering.

Well, I also wanted to tell you that I really like your plots: the text is of the right size, the legend is very clear and informative, the dots are just the right size. I mean, I really dig your plots. What program do you use? Do you have to fiddle a lot to make each one? Or is it quite automatic?

I love plots. I am a very visual person. I use Mathematica but I don't like the style it outputs and so I have to export the plot into wmf and then change font size, the labeling, etc with Flash or Power-Point. Very time consuming. At some point I have to customize the style of the plots Mathematica outputs into something I like. But it is not trivial.

Thats all for the moment.