Skip to main content

How to Estimate Anything From Nothing...

or How to be a Good System Engineer

This will be a discussion of how to estimate something from little or almost no information.
We call this making a Scientific Wild-Ass Guess or a SWAG.

I've been pretending to be a system engineer for a long time.  And I have to admit that I still have to go look up the average wait time in a queue or the Poisson distribution. Typically estimates are extensions of known data, the more data the better.  But what happens when you know hardly anything about the data that answers the question, because it doesn't exist?

Something from Nothing...

The modern method of how to estimate something from no information at all is the classic paper: "Implications of the Copernican principle for our future prospects" by J. Richard Gott III [1]. Sounds innocuous, but is probably one of the best tools ever invented for doing system analysis when information is lacking. It's almost as important as Baye's theorem that allows one to adjust their estimates of a probability given new information.  With these two tricks you can make an estimation of almost anything, and correct it as you learn new information. Some might call that science, but it's more like 'practical science' or what most people call engineering.

How long will the Berlin Wall stand?

If you were standing beside the Berlin Wall when vacationing in Berlin, you might ask yourself that question.  But how could you predict something like that?  Go collect data about all the walls in all the cities in the world by type, size, lifetime and then use that data to predict how long the Berlin Wall will live by finding all the walls that are similar to it? That's a lot of work. But it will almost certainly give you a fairly accurate lifetime prediction for the Berlin Wall. We can make a SWAG without all that additional data, it will be more inaccurate, but maybe it's accurate enough for whatever other calculation you are doing.

Gott's Copernican theory goes like this: If I am at a random place and time and I observe something that is N years old, with a 95% confidence level I can say that it's extended lifetime will be between N/39 and 39N.

Or a 2/3rds chance of having a 1/6 to 6 times longer lifetime.  Why?

This is because if you are observing the lifetime of an object at random, you can be there at any time during its lifetime. This means that if you assume that lifetimes are randomly distributed and your appearance is random, half the time you will be in the last half of the object's lifetime and half the time you'll be in the object's first half of its lifetime. Continuing on, there's a 2.5% chance you'll be in the object's first 2.5% of its lifetime or 1/40th of its life. Double that for a 95% confidentiality limit, so 1/39th and then 39 times for the odds in the other direction.  For instance, Gott was a tourist in Germany in 1966.  He saw the Berlin wall.  He read a plaque that told him the wall was built in 1957. He then concluded that he was seeing the wall at a random time during its lifetime.  He wasn't there to see the wall, he just happened upon it. Since at that time the wall was 9 years old, with 95% confidence, he expect it to last another 9/39 years (12 weeks) to 39*9 years (351 years). It came down in 1984 after 27 years. He expected it to be there 1.5 years to 54 years 2/3rds of the time. Whats the most likely time to live? 50 % of the time it is between 3 and 18 years. The most likely time is 9 more years.[2]

How Long will North Korea's communist state survive?

They were founded in 1952.  That was 64 years ago.  With a 95% confidence level the state of North Korea will be around for 64/39 years (1 year, 7 months) to 64*39 years (2500) years. Wow, that's scary. Maybe we should figure out some way to 'nudge' that around.

See how easy it is! There's been many arguments about why exactly this formula actually works.  Its been tried on Broadway show run lengths and found to be accurate and I've read about it on the Internets, so it must be true. Let's use it to calculate something interesting: How long will the human race survive? (From [1]) The human race is a species. It's been around for about 200,000 years. You are alive today at some random time.  The human species, with a 95% probability will be around for another 200,000/39 years (6000 years) or 200,000*39 years (9,321,000 years.)  Hmm. Looks like not enough time to settle the galaxy, but it depends upon how fast you can travel. It doesn't say that we might not create some other species to settle the galaxy... but it seem unlikely that we could by ourselves. Seems like it's going to take killer robots to settle the galaxy or nothing.

Thanks for reading,
 -Dr. Mike

[1] Nature, Vol. 363, 27 May 1993
[2] reference

Comments

Post a Comment

Popular posts from this blog

The Declaration of Independence is the foundation of modern ethics

The Settlement of the War between Science and Religion . Why the Declaration of Independence and the Bill of Rights are More Important than you realize. These two documents provide the foundation of the Grand Moral Compromise between Religion and Science that allowed the Industrial Revolution to progress by defining the morals and ethics of governments and their relationship with the people. The only moral and ethical form of government is declared to be a Lawful Democracy with Religious  Freedom . These two documents define why this is from first postulates and dictate the method to form a government. The Grand Moral Compromise was defined in the Declaration of Independence and codified in the Bill of Rights : it is the agreement that abolished the crime of heresy in return for freedom of all religions , including science , the harbinger of truth . Only about half [G] of the world has agreed to this  Grand Moral Compromise , the rest are still at war with themselv
Post a Comment
Read more

Hilbert space has no physical extent or extent in time. Quantum wave functions live in Hilbert space.

Hilbert space has no physical extent or extent in time. Quantum wave functions live in Hilbert space. This means that when you change a parameter in Hilbert space it changes everywhere at the same time. Every single entangled wave function now sees the same modified Hilbert space at the same time. The changes in Hilbert space are transmitted at infinite speed, apparently (It's actually worse than that: if you set up the experiment correctly you can get the Hilbert space to affect particles in the past. Yes, you can change the distribution of measurements on an entangled particle by making another measurement in the future, after the first particle is gone, absorbed in a detector. [1]) It really is like Einstein said: if you think you understand quantum mechanics then you just haven't been paying attention enough! Quantum mechanical wave functions are weirder than anyone thought they were and they were plenty weird before. Einstein, et al. defined how physical theories work,
Post a Comment
Read more

Ten Grand Technical Challenges of the 21st century: 1. Settle Space, Mars, moon, asteroids, the solar system.

Settle Space, Mars, moon, asteroids, the solar system. The first of the Ten Grand Technical Challenges of the 21st century TIme for some more blogging. One blog post on each of the TEN GRAND CHALLENGES of the 21st century. The things that make us proud to be a part of the human race. The things that we should be doing regardless of what else is true, the things that make life have meaning. Humanity will infect the galaxy; we already are. Humanity has a chance to make a real mark on the universe. If you look at what we've been throwing out into space for the last 50 years, it's obvious we have some innate need to expand into new environments. People have been in space almost continuously since 1971 (that'd be ~50 years) and I detailed the history of the technology in this post [1] about how technology changes things. We keep throwing robots out there as fast and as far as we can. They aren't yet killer robots (we keep those closer to ho
Post a Comment
Read more