Fwd: [NICAR-L] Machine learning in reporting example

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Fwd: [NICAR-L] Machine learning in reporting example

Tom Johnson
All:

Perhaps some of you will be interested in these links describing how journalists -- well, at least ONE journalist -- used AI, and specifically the "Random Forest" algorithm, to uncover government agency surveillance activities at home and abroad.  See especially the first and the last link.

Any thoughts on other applications of this methodology?

Tom

============================================
Tom Johnson
Institute for Analytic Journalism   --     Santa Fe, NM USA
505.577.6482(c)                                    505.473.9646(h)
Society of Professional Journalists 
Check out It's The People's Data
http://www.jtjohnson.com                   [hidden email]
============================================


On Mon, Aug 7, 2017 at 12:53 PM, Peter Aldhous <[hidden email]> wrote:
Hi all,

Excuse the shameless self-promotion, but I thought some folks on the list might be interested in this: using the random forest algorithm on flight/aircraft data to identify potential spy planes.

1) https://www.buzzfeed.com/peteraldhous/hidden-spy-planes

Here are the other two recent stories that it spawned:

2) https://www.buzzfeed.com/peteraldhous/us-marshals-spy-plane-over-mexico

3) https://www.buzzfeed.com/christianstork/spy-planes-over-american-cities

And here are the methods/data/code:

4) https://buzzfeednews.github.io/2017-08-spy-plane-finder/

Thanks also to colleagues Christian Stork and Karla Zabludovsky for their excellent reporting on these stories.

Cheers,

Peter

--
Peter Aldhous, PhD
Science journalist
cell: <a href="tel:(415)%20503-7323" value="+14155037323" target="_blank">415 503 7323
[hidden email]
@paldhous
www.peteraldhous.com
==================================================================== To unsubscribe from NICAR-L, please send "unsubscribe NICAR-L" in the body of an e-mail message to "[hidden email]". Please e-mail [hidden email] if you need help or have questions. ====================================================================



--
Jacqueline Kazil | @jackiekazil 

==================================================================== To unsubscribe from NICAR-L, please send "unsubscribe NICAR-L" in the body of an e-mail message to "[hidden email]". Please e-mail [hidden email] if you need help or have questions. ====================================================================


============================================================
FRIAM Applied Complexity Group listserv
Meets Fridays 9a-11:30 at cafe at St. John's College
to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove
Reply | Threaded
Open this post in threaded view
|

Re: Fwd: [NICAR-L] Machine learning in reporting example

Marcus G. Daniels

Tom,


The random forest method is kind of unsatisfying to me.  It says that one can train many simple experts, trained on subsets of a dataset, to vote and thereby predict as well or better as one big integrated expert.  One might hope this could be a mechanism of democracy... A property of recursive partitioning, that underlies random forests -- and which can work remarkably well by itself -- is that it commits each expert to a main effect, secondary effects, tertiary effects and so on.  Some kinds of decision making don't have this structure, e.g. they could have non-linear composition of factors.   But, if the random subsets they learn on happen to be representative of various sub-populations, that do each have simple hierarchical rules, then one could see how different rules per expert apply to, say, different voting communities.   It would be like if one went to expert pollsters in every voting district who also happened to live there, and ask them each for a prediction


Marcus


From: Friam <[hidden email]> on behalf of Tom Johnson <[hidden email]>
Sent: Monday, August 7, 2017 6:56:54 PM
To: Friam@redfish. com
Subject: [FRIAM] Fwd: [NICAR-L] Machine learning in reporting example
 
All:

Perhaps some of you will be interested in these links describing how journalists -- well, at least ONE journalist -- used AI, and specifically the "Random Forest" algorithm, to uncover government agency surveillance activities at home and abroad.  See especially the first and the last link.

Any thoughts on other applications of this methodology?

Tom

============================================
Tom Johnson
Institute for Analytic Journalism   --     Santa Fe, NM USA
505.577.6482(c)                                    505.473.9646(h)
Society of Professional Journalists 
Check out It's The People's Data
http://www.jtjohnson.com                   [hidden email]
============================================


On Mon, Aug 7, 2017 at 12:53 PM, Peter Aldhous <[hidden email]> wrote:
Hi all,

Excuse the shameless self-promotion, but I thought some folks on the list might be interested in this: using the random forest algorithm on flight/aircraft data to identify potential spy planes.

1) https://www.buzzfeed.com/peteraldhous/hidden-spy-planes

Here are the other two recent stories that it spawned:

2) https://www.buzzfeed.com/peteraldhous/us-marshals-spy-plane-over-mexico

3) https://www.buzzfeed.com/christianstork/spy-planes-over-american-cities

And here are the methods/data/code:

4) https://buzzfeednews.github.io/2017-08-spy-plane-finder/

Thanks also to colleagues Christian Stork and Karla Zabludovsky for their excellent reporting on these stories.

Cheers,

Peter

--
Peter Aldhous, PhD
Science journalist
cell: <a href="tel:(415)%20503-7323" value="&#43;14155037323" target="_blank">415 503 7323
[hidden email]
@paldhous
www.peteraldhous.com
==================================================================== To unsubscribe from NICAR-L, please send "unsubscribe NICAR-L" in the body of an e-mail message to "[hidden email]". Please e-mail [hidden email] if you need help or have questions. ====================================================================



--
Jacqueline Kazil | @jackiekazil 

==================================================================== To unsubscribe from NICAR-L, please send "unsubscribe NICAR-L" in the body of an e-mail message to "[hidden email]". Please e-mail [hidden email] if you need help or have questions. ====================================================================


============================================================
FRIAM Applied Complexity Group listserv
Meets Fridays 9a-11:30 at cafe at St. John's College
to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com
FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove