Bayes Rules and Base Rates Count

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Bayes Rules and Base Rates Count

George Duncan-2
Here's an easy numerical example of why conditional probabilities as employed in Bayes Rule are important:
 
George Duncan
Emeritus Professor of Statistics, Carnegie Mellon University
georgeduncanart.com
See posts on Facebook, Twitter, and Instagram
Land: (505) 983-6895  
Mobile: (505) 469-4671
 
My art theme: Dynamic exposition of the tension between matrix order and luminous chaos.

"Attempt what is not certain. Certainty may or may not come later. It may then be a valuable delusion."

From "Notes to myself on beginning a painting" by Richard Diebenkorn. 

"It's that knife-edge of uncertainty where we come alive to our truest power." Joanna Macy.



.-. .- -. -.. --- -- -..-. -.. --- - ... -..-. .- -. -.. -..-. -.. .- ... .... . ...
FRIAM Applied Complexity Group listserv
Zoom Fridays 9:30a-12p Mtn GMT-6  bit.ly/virtualfriam
unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
archives: http://friam.471366.n2.nabble.com/
FRIAM-COMIC http://friam-comic.blogspot.com/ 
Reply | Threaded
Open this post in threaded view
|

Re: Bayes Rules and Base Rates Count

Tom Johnson
Good explanation.  But it always comes back to the basic question: What are the methods and data informing our assumptions about prevalence, at this moment, in a population?  Or am I wrong?
Tom
 

============================================
Tom Johnson - [hidden email]
Institute for Analytic Journalism   --     Santa Fe, NM USA
505.577.6482(c)                                    505.473.9646(h)
NM Foundation for Open Government
Check out It's The People's Data                 
============================================


On Wed, Apr 29, 2020 at 4:03 PM George Duncan <[hidden email]> wrote:
Here's an easy numerical example of why conditional probabilities as employed in Bayes Rule are important:
 
George Duncan
Emeritus Professor of Statistics, Carnegie Mellon University
georgeduncanart.com
See posts on Facebook, Twitter, and Instagram
Land: (505) 983-6895  
Mobile: (505) 469-4671
 
My art theme: Dynamic exposition of the tension between matrix order and luminous chaos.

"Attempt what is not certain. Certainty may or may not come later. It may then be a valuable delusion."

From "Notes to myself on beginning a painting" by Richard Diebenkorn. 

"It's that knife-edge of uncertainty where we come alive to our truest power." Joanna Macy.


.-. .- -. -.. --- -- -..-. -.. --- - ... -..-. .- -. -.. -..-. -.. .- ... .... . ...
FRIAM Applied Complexity Group listserv
Zoom Fridays 9:30a-12p Mtn GMT-6  bit.ly/virtualfriam
unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
archives: http://friam.471366.n2.nabble.com/
FRIAM-COMIC http://friam-comic.blogspot.com/

.-. .- -. -.. --- -- -..-. -.. --- - ... -..-. .- -. -.. -..-. -.. .- ... .... . ...
FRIAM Applied Complexity Group listserv
Zoom Fridays 9:30a-12p Mtn GMT-6  bit.ly/virtualfriam
unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
archives: http://friam.471366.n2.nabble.com/
FRIAM-COMIC http://friam-comic.blogspot.com/ 
Reply | Threaded
Open this post in threaded view
|

Re: Bayes Rules and Base Rates Count

George Duncan-2
You indeed are indeed correct, Tom. That is the fundamental question for Bayesian applications. For a time it was considered to be an impossible hurdle that blocked Bayesian statistical analysis. Today there are a variety of conceptualizations that have changed that view, and so Bayes Rules!

George Duncan
Emeritus Professor of Statistics, Carnegie Mellon University
georgeduncanart.com
See posts on Facebook, Twitter, and Instagram
Land: (505) 983-6895  
Mobile: (505) 469-4671
 
My art theme: Dynamic exposition of the tension between matrix order and luminous chaos.

"Attempt what is not certain. Certainty may or may not come later. It may then be a valuable delusion."

From "Notes to myself on beginning a painting" by Richard Diebenkorn. 

"It's that knife-edge of uncertainty where we come alive to our truest power." Joanna Macy.




On Thu, Apr 30, 2020 at 5:40 PM Tom Johnson <[hidden email]> wrote:
Good explanation.  But it always comes back to the basic question: What are the methods and data informing our assumptions about prevalence, at this moment, in a population?  Or am I wrong?
Tom
 

============================================
Tom Johnson - [hidden email]
Institute for Analytic Journalism   --     Santa Fe, NM USA
505.577.6482(c)                                    505.473.9646(h)
NM Foundation for Open Government
Check out It's The People's Data                 
============================================


On Wed, Apr 29, 2020 at 4:03 PM George Duncan <[hidden email]> wrote:
Here's an easy numerical example of why conditional probabilities as employed in Bayes Rule are important:
 
George Duncan
Emeritus Professor of Statistics, Carnegie Mellon University
georgeduncanart.com
See posts on Facebook, Twitter, and Instagram
Land: (505) 983-6895  
Mobile: (505) 469-4671
 
My art theme: Dynamic exposition of the tension between matrix order and luminous chaos.

"Attempt what is not certain. Certainty may or may not come later. It may then be a valuable delusion."

From "Notes to myself on beginning a painting" by Richard Diebenkorn. 

"It's that knife-edge of uncertainty where we come alive to our truest power." Joanna Macy.


.-. .- -. -.. --- -- -..-. -.. --- - ... -..-. .- -. -.. -..-. -.. .- ... .... . ...
FRIAM Applied Complexity Group listserv
Zoom Fridays 9:30a-12p Mtn GMT-6  bit.ly/virtualfriam
unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
archives: http://friam.471366.n2.nabble.com/
FRIAM-COMIC http://friam-comic.blogspot.com/
.-. .- -. -.. --- -- -..-. -.. --- - ... -..-. .- -. -.. -..-. -.. .- ... .... . ...
FRIAM Applied Complexity Group listserv
Zoom Fridays 9:30a-12p Mtn GMT-6  bit.ly/virtualfriam
unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
archives: http://friam.471366.n2.nabble.com/
FRIAM-COMIC http://friam-comic.blogspot.com/

.-. .- -. -.. --- -- -..-. -.. --- - ... -..-. .- -. -.. -..-. -.. .- ... .... . ...
FRIAM Applied Complexity Group listserv
Zoom Fridays 9:30a-12p Mtn GMT-6  bit.ly/virtualfriam
unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
archives: http://friam.471366.n2.nabble.com/
FRIAM-COMIC http://friam-comic.blogspot.com/ 
Reply | Threaded
Open this post in threaded view
|

Re: Bayes Rules and Base Rates Count

David Eric Smith
In reply to this post by Tom Johnson
Yes, while the clip was a nice explanation about Bayesian updating, the narrator’s statement that we need to make assumptions about prevalence seem to me like they send the viewer on a wrong turn.

It’s just an affine transform.  If you know the sensitivity and the selectivity of your test (which presumably you get from the design process before you deploy it), then the fraction of test-positives and test-negatives is just a linear function of the fraction of true-positives and true-negatives, +/- sampling noise.  In a large sample, the noise can be pushed down as a fraction of the mean.

So the test-positives and test-negatives do not equal the true-positives and true-negatives, but the former are an invertible function of the latter.  This is a simplification of a binary variable, I think.  But I haven’t taken a minute to go looking for a range of examples to show where non-invertibility starts.  I imagine again all this was largely worked out between 1500 and 1700, and is in basic stats textbooks.

I think everything I have said above is right.  I did take a minute to just write out the decomposition in terms of priors, likelihoods, and posteriors on a sheet of paper, and the linear function sits there and looks at me, so I don’t think I am spouting off the cuff.

Anyway,

Eric



On May 1, 2020, at 8:39 AM, Tom Johnson <[hidden email]> wrote:

Good explanation.  But it always comes back to the basic question: What are the methods and data informing our assumptions about prevalence, at this moment, in a population?  Or am I wrong?
Tom
 

============================================
Tom Johnson - [hidden email]
Institute for Analytic Journalism   --     Santa Fe, NM USA
505.577.6482(c)                                    505.473.9646(h)
NM Foundation for Open Government
Check out It's The People's Data                 
============================================


On Wed, Apr 29, 2020 at 4:03 PM George Duncan <[hidden email]> wrote:
Here's an easy numerical example of why conditional probabilities as employed in Bayes Rule are important:
 
George Duncan
Emeritus Professor of Statistics, Carnegie Mellon University
georgeduncanart.com
See posts on Facebook, Twitter, and Instagram
Land: (505) 983-6895  
Mobile: (505) 469-4671
 
My art theme: Dynamic exposition of the tension between matrix order and luminous chaos.

"Attempt what is not certain. Certainty may or may not come later. It may then be a valuable delusion."

From "Notes to myself on beginning a painting" by Richard Diebenkorn. 

"It's that knife-edge of uncertainty where we come alive to our truest power." Joanna Macy.


.-. .- -. -.. --- -- -..-. -.. --- - ... -..-. .- -. -.. -..-. -.. .- ... .... . ...
FRIAM Applied Complexity Group listserv
Zoom Fridays 9:30a-12p Mtn GMT-6  bit.ly/virtualfriam
unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
archives: http://friam.471366.n2.nabble.com/
FRIAM-COMIC http://friam-comic.blogspot.com/
.-. .- -. -.. --- -- -..-. -.. --- - ... -..-. .- -. -.. -..-. -.. .- ... .... . ...
FRIAM Applied Complexity Group listserv
Zoom Fridays 9:30a-12p Mtn GMT-6  bit.ly/virtualfriam
unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
archives: http://friam.471366.n2.nabble.com/
FRIAM-COMIC http://friam-comic.blogspot.com/


.-. .- -. -.. --- -- -..-. -.. --- - ... -..-. .- -. -.. -..-. -.. .- ... .... . ...
FRIAM Applied Complexity Group listserv
Zoom Fridays 9:30a-12p Mtn GMT-6  bit.ly/virtualfriam
unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
archives: http://friam.471366.n2.nabble.com/
FRIAM-COMIC http://friam-comic.blogspot.com/