All --
Has anybody thought about how to make use of truly lousy data? There are increasingly sources of public data on subject matters such as weather and (see below) flowers and birds where the quality of the data is truly awful by ordinary standards and yet there is so much of it that it seems a crime not to try to make use of it. So Sally writes in to say that her morning glories are in bloom in April when what she means is her pansies. Her neighbor gets the pansies right but screws up on the tithonia. Is there any way to add this all up and get something? thoughts? nick Nicholas S. Thompson Research Associate, Redfish Group, Santa Fe, NM (nick at redfish.com) Professor of Psychology and Ethology, Clark University (nthompson at clarku.edu) ----- Original Message ----- From: National Science Foundation Update To: nthompson at clarku.edu Sent: 2/15/2008 2:27:26 AM Subject: National Science Foundation Update Daily Digest Bulletin You have requested to receive a Daily Digest e-mail from National Science Foundation Update. Message: 1 From: National Science Foundation Update <[hidden email]> Date: Thu, 14 Feb 2008 10:35:16 -0600 (CST) Subject: Volunteers Across Nation to Track Climate Clues in Spring Flowers Volunteers Across Nation to Track Climate Clues in Spring Flowers A nationwide initiative starting this week will enable volunteers to track climate change by observing the timing of flowers and foliage. Project BudBurst, operated by the University Corporation for Atmospheric Research (UCAR) and a team of partners, allows students, gardeners and other citizen scientists in every state to enter their observations into an online database that will give researchers a detailed picture of our warming climate. The project, which will be launched tomorrow, ... More at http://www.nsf.gov/news/news_summ.jsp?cntn_id=111117&govDel=USNSF_51 This is an NSF News item. Message: 2 From: National Science Foundation Update <[hidden email]> Date: Thu, 14 Feb 2008 14:58:55 -0600 (CST) Subject: Scientists Reveal First-Ever Global Map of Total Human Effect on Oceans Scientists Reveal First-Ever Global Map of Total Human Effect on Oceans More than 40 percent of the world's oceans are heavily affected by human activities, and few if any areas remain untouched, according to the first global-scale study of human influence on marine ecosystems. By overlaying maps of 17 different activities such as fishing, climate change and pollution, the researchers have produced a composite map of the toll that humans have exacted on the seas. The work, published in this week's issue of Science, was conducted at the ... More at http://www.nsf.gov/news/news_summ.jsp?cntn_id=111113&govDel=USNSF_51 This is an NSF News item. Message: 3 From: National Science Foundation Update <[hidden email]> Date: Thu, 14 Feb 2008 15:49:19 -0600 (CST) Subject: A Newly Discovered Solar System Contains Scaled-Down Versions of Saturn and Jupiter A Newly Discovered Solar System Contains Scaled-Down Versions of Saturn and Jupiter A team of international astronomers reports in the Feb. 15 issue of Science the discovery of a solar system nearly 5,000 light years away containing scaled-down versions of Jupiter and Saturn. Their findings suggest that our galaxy could conceivably contain many star systems similar to our own. The National Science Foundation (NSF) sponsored the research. "NSF is delighted to have played a role in enabling such an exciting discovery," said Michael Briley, a ... More at http://www.nsf.gov/news/news_summ.jsp?cntn_id=111093&govDel=USNSF_51 This is an NSF News item. Message: 4 From: National Science Foundation Update <[hidden email]> Date: Thu, 14 Feb 2008 15:57:50 -0600 (CST) Subject: Nanotechnology Undergraduate Education (NUE) in Engineering Nanotechnology Undergraduate Education (NUE) in Engineering Available Formats: HTML: http://www.nsf.gov/pubs/2008/nsf08544/nsf08544.htm?govDel=USNSF_25 TXT: http://www.nsf.gov/pubs/2008/nsf08544/nsf08544.txt?govDel=USNSF_25 PDF: http://www.nsf.gov/pubs/2008/nsf08544/nsf08544.pdf?govDel=USNSF_25 Document Number: nsf08544 This is an NSF Program Announcements and Information item. This e-mail update was generated automatically based on your subscription to the categories listed for each item. Some updates may belong to more than one category, resulting in duplicate notices. You can adjust your National Science Foundation Update subscriptions or delivery preference at any time on your Subscriber Preferences Page. You can also change your e-mail address, or stop subscriptions on this page. You will need to use your e-mail address to log in. If you have questions or problems with the National Science Foundation updates, please contact support at govdelivery.com. National Science Foundation ? 4201 Wilson Boulevard ? Arlington, VA 22230 ? 703-292-5111 |
Run that lousy data through a simulation, and then publish the results as
truth. Works every time! --Doug -- Doug Roberts, RTI International droberts at rti.org doug at parrot-farm.net 505-455-7333 - Office 505-670-8195 - Cell On Fri, Feb 15, 2008 at 8:16 AM, Nicholas Thompson < nickthompson at earthlink.net> wrote: > All -- > > Has anybody thought about how to make use of truly lousy data? There are > increasingly sources of public data on subject matters such as weather and > (see below) flowers and birds where the quality of the data is truly awful > by ordinary standards and yet there is so much of it that it seems a crime > not to try to make use of it. So Sally writes in to say that her morning > glories are in bloom in April when what she means is her pansies. Her > neighbor gets the pansies right but screws up on the tithonia. Is there > any way to add this all up and get something? > > thoughts? > > nick > > > > > > Nicholas S. Thompson > Research Associate, Redfish Group, Santa Fe, NM (nick at redfish.com) > Professor of Psychology and Ethology, Clark University > (nthompson at clarku.edu) > > > > > ----- Original Message ----- > From: National Science Foundation Update > To: nthompson at clarku.edu > Sent: 2/15/2008 2:27:26 AM > Subject: National Science Foundation Update Daily Digest Bulletin > > > You have requested to receive a Daily Digest e-mail from National Science > Foundation Update. > Message: 1 > From: National Science Foundation Update <nsf-update at nsf.gov> > Date: Thu, 14 Feb 2008 10:35:16 -0600 (CST) > Subject: Volunteers Across Nation to Track Climate Clues in Spring Flowers > > Volunteers Across Nation to Track Climate Clues in Spring Flowers > > A nationwide initiative starting this week will enable volunteers to track > climate change by observing the timing of flowers and foliage. Project > BudBurst, operated by the University Corporation for Atmospheric Research > (UCAR) and a team of partners, allows students, gardeners and other > citizen > scientists in every state to enter their observations into an online > database that will give researchers a detailed picture of our warming > climate. > The project, which will be launched tomorrow, ... > > More at > http://www.nsf.gov/news/news_summ.jsp?cntn_id=111117&govDel=USNSF_51 > > This is an NSF News item. > > > > Message: 2 > From: National Science Foundation Update <nsf-update at nsf.gov> > Date: Thu, 14 Feb 2008 14:58:55 -0600 (CST) > Subject: Scientists Reveal First-Ever Global Map of Total Human Effect on > Oceans > > Scientists Reveal First-Ever Global Map of Total Human Effect on Oceans > > More than 40 percent of the world's oceans are heavily affected by human > activities, and few if any areas remain untouched, according to the first > global-scale study of human influence on marine ecosystems. > By overlaying maps of 17 different activities such as fishing, climate > change and pollution, the researchers have produced a composite map of the > toll that humans have exacted on the seas. > The work, published in this week's issue of Science, was conducted at the > ... > > More at > http://www.nsf.gov/news/news_summ.jsp?cntn_id=111113&govDel=USNSF_51 > > This is an NSF News item. > > > > Message: 3 > From: National Science Foundation Update <nsf-update at nsf.gov> > Date: Thu, 14 Feb 2008 15:49:19 -0600 (CST) > Subject: A Newly Discovered Solar System Contains Scaled-Down Versions of > Saturn and Jupiter > > A Newly Discovered Solar System Contains Scaled-Down Versions of Saturn > and > Jupiter > > A team of international astronomers reports in the Feb. 15 issue of > Science > the discovery of a solar system nearly 5,000 light years away containing > scaled-down versions of Jupiter and Saturn. Their findings suggest that > our > galaxy could conceivably contain many star systems similar to our own. The > National Science Foundation (NSF) sponsored the research. > "NSF is delighted to have played a role in enabling such an exciting > discovery," said Michael Briley, a ... > > More at > http://www.nsf.gov/news/news_summ.jsp?cntn_id=111093&govDel=USNSF_51 > > This is an NSF News item. > > > > Message: 4 > From: National Science Foundation Update <nsf-update at nsf.gov> > Date: Thu, 14 Feb 2008 15:57:50 -0600 (CST) > Subject: Nanotechnology Undergraduate Education (NUE) in Engineering > > Nanotechnology Undergraduate Education (NUE) in Engineering > Available Formats: > HTML: http://www.nsf.gov/pubs/2008/nsf08544/nsf08544.htm?govDel=USNSF_25 > TXT: http://www.nsf.gov/pubs/2008/nsf08544/nsf08544.txt?govDel=USNSF_25 > PDF: http://www.nsf.gov/pubs/2008/nsf08544/nsf08544.pdf?govDel=USNSF_25 > > Document Number: nsf08544 > > > This is an NSF Program Announcements and Information item. > > > > This e-mail update was generated automatically based on your subscription > to the categories listed for each item. Some updates may belong to more > than one category, resulting in duplicate notices. > You can adjust your National Science Foundation Update subscriptions or > delivery preference at any time on your Subscriber Preferences Page. You > can also change your e-mail address, or stop subscriptions on this page. > You will need to use your e-mail address to log in. If you have questions > or problems with the National Science Foundation updates, please contact > support at govdelivery.com. > National Science Foundation ? 4201 Wilson Boulevard ? Arlington, VA 22230 > ? > 703-292-5111 > > > > ============================================================ > FRIAM Applied Complexity Group listserv > Meets Fridays 9a-11:30 at cafe at St. John's College > lectures, archives, unsubscribe, maps at http://www.friam.org > An HTML attachment was scrubbed... URL: http://redfish.com/pipermail/friam_redfish.com/attachments/20080215/540bf41e/attachment.html |
In reply to this post by Nick Thompson
Sure Nick
We need to move into the visual world. The same issue you mention is a huge problem in all forms of engineering / architecture as well let alone plants. The data is lousy period when it goes through immutable text variations but at least with the tactile we should be facing in the same direction more fun here http://www.ideapete.com/gwendolyn.htm Add the famous we only see 2D and its ripe for disaster To err is human to really screw up you need text and a computer ( : ( : pete Peter Baston *IDEAS* /www.ideapete.com/ <http://www.ideapete.com/> Nicholas Thompson wrote: > All -- > > Has anybody thought about how to make use of truly lousy data? There are > increasingly sources of public data on subject matters such as weather and > (see below) flowers and birds where the quality of the data is truly awful > by ordinary standards and yet there is so much of it that it seems a crime > not to try to make use of it. So Sally writes in to say that her morning > glories are in bloom in April when what she means is her pansies. Her > neighbor gets the pansies right but screws up on the tithonia. Is there > any way to add this all up and get something? > > thoughts? > > nick > > > > > > Nicholas S. Thompson > Research Associate, Redfish Group, Santa Fe, NM (nick at redfish.com) > Professor of Psychology and Ethology, Clark University > (nthompson at clarku.edu) > > > > > ----- Original Message ----- > From: National Science Foundation Update > To: nthompson at clarku.edu > Sent: 2/15/2008 2:27:26 AM > Subject: National Science Foundation Update Daily Digest Bulletin > > > You have requested to receive a Daily Digest e-mail from National Science > Foundation Update. > Message: 1 > From: National Science Foundation Update <nsf-update at nsf.gov> > Date: Thu, 14 Feb 2008 10:35:16 -0600 (CST) > Subject: Volunteers Across Nation to Track Climate Clues in Spring Flowers > > Volunteers Across Nation to Track Climate Clues in Spring Flowers > > A nationwide initiative starting this week will enable volunteers to track > climate change by observing the timing of flowers and foliage. Project > BudBurst, operated by the University Corporation for Atmospheric Research > (UCAR) and a team of partners, allows students, gardeners and other citizen > scientists in every state to enter their observations into an online > database that will give researchers a detailed picture of our warming > climate. > The project, which will be launched tomorrow, ... > > More at > http://www.nsf.gov/news/news_summ.jsp?cntn_id=111117&govDel=USNSF_51 > > This is an NSF News item. > > > > Message: 2 > From: National Science Foundation Update <nsf-update at nsf.gov> > Date: Thu, 14 Feb 2008 14:58:55 -0600 (CST) > Subject: Scientists Reveal First-Ever Global Map of Total Human Effect on > Oceans > > Scientists Reveal First-Ever Global Map of Total Human Effect on Oceans > > More than 40 percent of the world's oceans are heavily affected by human > activities, and few if any areas remain untouched, according to the first > global-scale study of human influence on marine ecosystems. > By overlaying maps of 17 different activities such as fishing, climate > change and pollution, the researchers have produced a composite map of the > toll that humans have exacted on the seas. > The work, published in this week's issue of Science, was conducted at the > ... > > More at > http://www.nsf.gov/news/news_summ.jsp?cntn_id=111113&govDel=USNSF_51 > > This is an NSF News item. > > > > Message: 3 > From: National Science Foundation Update <nsf-update at nsf.gov> > Date: Thu, 14 Feb 2008 15:49:19 -0600 (CST) > Subject: A Newly Discovered Solar System Contains Scaled-Down Versions of > Saturn and Jupiter > > A Newly Discovered Solar System Contains Scaled-Down Versions of Saturn and > Jupiter > > A team of international astronomers reports in the Feb. 15 issue of Science > the discovery of a solar system nearly 5,000 light years away containing > scaled-down versions of Jupiter and Saturn. Their findings suggest that our > galaxy could conceivably contain many star systems similar to our own. The > National Science Foundation (NSF) sponsored the research. > "NSF is delighted to have played a role in enabling such an exciting > discovery," said Michael Briley, a ... > > More at > http://www.nsf.gov/news/news_summ.jsp?cntn_id=111093&govDel=USNSF_51 > > This is an NSF News item. > > > > Message: 4 > From: National Science Foundation Update <nsf-update at nsf.gov> > Date: Thu, 14 Feb 2008 15:57:50 -0600 (CST) > Subject: Nanotechnology Undergraduate Education (NUE) in Engineering > > Nanotechnology Undergraduate Education (NUE) in Engineering > Available Formats: > HTML: http://www.nsf.gov/pubs/2008/nsf08544/nsf08544.htm?govDel=USNSF_25 > TXT: http://www.nsf.gov/pubs/2008/nsf08544/nsf08544.txt?govDel=USNSF_25 > PDF: http://www.nsf.gov/pubs/2008/nsf08544/nsf08544.pdf?govDel=USNSF_25 > > Document Number: nsf08544 > > > This is an NSF Program Announcements and Information item. > > > > This e-mail update was generated automatically based on your subscription > to the categories listed for each item. Some updates may belong to more > than one category, resulting in duplicate notices. > You can adjust your National Science Foundation Update subscriptions or > delivery preference at any time on your Subscriber Preferences Page. You > can also change your e-mail address, or stop subscriptions on this page. > You will need to use your e-mail address to log in. If you have questions > or problems with the National Science Foundation updates, please contact > support at govdelivery.com. > National Science Foundation ? 4201 Wilson Boulevard ? Arlington, VA 22230 ? > 703-292-5111 > > > > An HTML attachment was scrubbed... URL: http://redfish.com/pipermail/friam_redfish.com/attachments/20080215/a0ef1760/attachment.html |
In reply to this post by Nick Thompson
Nick,
Doesn't sound too tricky - as you describe it, it seems a pretty good candidate for some form of Bayesian analysis: p(A|B) is proportional to p(B|A)p(A), where B="is described as a pansy" and A="is actually a pansy" You can probably get good empirical values for your priors ("what IS the probability of finding a pansy round here?"), which is a pleasant change for Bayesians as they usually guess these values and then spend time trying to convince you that the final result isn't sensitive to the priors anyway. Also I'd expect that you can probably get reasonable values for those conditional probabilities, in consultation with your local flower expert. Robert On 2/15/08, Nicholas Thompson <nickthompson at earthlink.net> wrote: > > All -- > > Has anybody thought about how to make use of truly lousy data? There are > increasingly sources of public data on subject matters such as weather and > (see below) flowers and birds where the quality of the data is truly awful > by ordinary standards and yet there is so much of it that it seems a crime > not to try to make use of it. So Sally writes in to say that her morning > glories are in bloom in April when what she means is her pansies. Her > neighbor gets the pansies right but screws up on the tithonia. Is there > any way to add this all up and get something? > > thoughts? > > nick > > > > > > Nicholas S. Thompson > Research Associate, Redfish Group, Santa Fe, NM (nick at redfish.com) > Professor of Psychology and Ethology, Clark University > (nthompson at clarku.edu) > > An HTML attachment was scrubbed... URL: http://redfish.com/pipermail/friam_redfish.com/attachments/20080216/472d70ac/attachment.html |
Free forum by Nabble | Edit this page |