Skip to main content

A few words about Thomas Bayes






P(H/D) = [P(D/H) x P(H)] ÷ P(L)


Thomas Bayes, a mid-eighteenth century English mathematician, dead since 1761, performed magic the ramifications of which continue to unfold, and in directions of interest to the world of finance today. But I won't really get into the applications here. I'll just state the main point associated with this man, so I can refer you back to this post if I eventually do get to them. I want this blog to be a bit sticky.

Probability

In Bayes’ day, the study of probability was mostly about issues of this form: if we know a certain underlying fact, what is the probability that we will make certain observations? If we know there are 100 blue balls and 40 red balls in the urn, and the urn has been thoroughly shaken, what is the probability that we will draw two blue balls in succession from the urn?

Bayes’ famous posthumous manuscript was about “inverse probability” in that it inverted this problem. If we know only the observed data, what can we infer about the underlying matters of fact? If we have just drawn two blue balls from the urn, what can we infer about the mixture of balls inside?

That ms itself didn’t lay down what is nowadays known as Bayes’ theorem, but it took some big steps in that direction, steps further developed at the start of the nineteenth century by the astronomer Pierre-Simon Laplace into the present accepted formulations. (One common formulation of Bayes' theorem is portrayed in large characters at the  top of this blog entry, where H stands for "hypothesis" and D stands for the supporting data.)

From these starts, Bayesians have also developed the idea of a Bayesian game: that is, a game in which a player has to try to figure out the characteristics of other players despite incomplete information on the basis of various signals. People are more complicated than urns filled with balls, but otherwise this is a natural development of the underlying idea. Think of a poker player trying to decide whether the other guy’s facial tick means that he has lousy cards, or just that he has a facial tic.
The probability that he has lousy cards given the tic is equal to the probability of a tic if he has lousy cards, multiplied by the probability that he has lousy cards in general, all divided by the probability of facial tics.
 
Or (to dip our toe into finance after all) think of a plot of land that may or may not have oil beneath it, and how its value might rise when the market learns of geological features that could be a sign of such oil.


I think I have that right....

Comments

Popular posts from this blog

A Story About Coleridge

This is a quote from a memoir by Dorothy Wordsworth, reflecting on a trip she took with two famous poets, her brother, William Wordsworth, and their similarly gifted companion, Samuel Taylor Coleridge.   We sat upon a bench, placed for the sake of one of these views, whence we looked down upon the waterfall, and over the open country ... A lady and gentleman, more expeditious tourists than ourselves, came to the spot; they left us at the seat, and we found them again at another station above the Falls. Coleridge, who is always good-natured enough to enter into conversation with anybody whom he meets in his way, began to talk with the gentleman, who observed that it was a majestic waterfall. Coleridge was delighted with the accuracy of the epithet, particularly as he had been settling in his own mind the precise meaning of the words grand, majestic, sublime, etc., and had discussed the subject with William at some length the day before. “Yes, sir,” says Coleridge, “it is a maj...

The Lyrics of "Live Like You Were Dying"

Back in 2004 Tim McGraw recorded the song "Live Like You were Dying." As a way of marking the one-decade anniversary of this song, I'd like to admit that a couple of the lines have confused me for years. I could use your help understanding them. In the first couple of verses, the song seems easy to follow. Two men are talking, and one tells the other about his diagnosis. The doctors have (recently? or a long time ago and mistakenly? that isn't clear) given him the news that he would die soon. "I spent most of the next days/Looking at the X-rays." Then we get a couple of lines about a man crossing items off of his bucket list. "I went sky diving, I went rocky mountain climbing, I went two point seven seconds on a bull named Fu Man Chu." Then the speaker -- presumably still the old man -- shifts to the more characterological consequences of the news. As he was doing those things, he found he was loving deeper and speaking sweeter, and givin...

Searle: The Chinese Room

John Searle has become the object of accusations of improper conduct. These accusations even have some people in the world of academic philosophy saying that instructors in that world should try to avoid teaching Searle's views. That is an odd contention, and has given rise to heated exchanges in certain corners of the blogosphere.  At Leiter Reports, I encountered a comment from someone describing himself as "grad student drop out." GSDO said: " This is a side question (and not at all an attempt to answer the question BL posed): How important is John Searle's work? Are people still working on speech act theory or is that just another dead end in the history of 20th century philosophy? My impression is that his reputation is somewhat inflated from all of his speaking engagements and NYRoB reviews. The Chinese room argument is a classic, but is there much more to his work than that?" I took it upon myself to answer that on LR. But here I'll tak...