Coronavirus New Mexico numbers.xlsx
Locked
Coronavirus New Mexico numbers.xlsx
 
|
All, particularly the mother church: Don’t you hate it when a perfectly beautiful theory is destroyed by an ugly fact. On to Monday! Nick ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
Coronavirus New Mexico numbers.xlsx (12K)
Re: Coronavirus New Mexico numbers.xlsx
|
|
Which and whose theory is that? ============================================ Tom Johnson - [hidden email] Institute for Analytic Journalism -- Santa Fe, NM USA 505.577.6482(c) 505.473.9646(h) NM Foundation for Open Government Check out It's The People's Data ============================================ On Sun, Mar 29, 2020 at 3:51 PM <[hidden email]> wrote:
============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
Re: Coronavirus New Mexico numbers.xlsx
|
|
On Sun, Mar 29, 2020 at 5:13 PM Tom Johnson <[hidden email]> wrote:
-- Frank Wimberly
140 Calle Ojo Feliz Santa Fe, NM 87505 505 670-9918 ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Re: Coronavirus New Mexico numbers.xlsx
|
|
In reply to this post by Tom Johnson
Oh, just mine. The idea that 14 days after the toilet paper orgy the growth rate would peak. It was also 14 days ago that the schools closed. N Nicholas Thompson Emeritus Professor of Ethology and Psychology Clark University https://wordpress.clarku.edu/nthompson/ From: Friam <[hidden email]> On Behalf Of Tom Johnson Which and whose theory is that?
============================================ On Sun, Mar 29, 2020 at 3:51 PM <[hidden email]> wrote:
============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
Re: Coronavirus New Mexico numbers.xlsx
|
|
The column I added indicates that the derivative is increasing. --- Frank C. Wimberly 505 670-9918 Santa Fe, NM On Sun, Mar 29, 2020, 5:56 PM <[hidden email]> wrote:
============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
Re: Coronavirus New Mexico numbers.xlsx
|
|
Ah yes. The ol' Behavioral Epidemiology theory. ============================================ Tom Johnson - [hidden email] Institute for Analytic Journalism -- Santa Fe, NM USA 505.577.6482(c) 505.473.9646(h) NM Foundation for Open Government Check out It's The People's Data ============================================ On Sun, Mar 29, 2020 at 6:17 PM Frank Wimberly <[hidden email]> wrote:
============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
Re: Coronavirus New Mexico numbers.xlsx
|
|
All-- Actual data for NM follows: Highly recommended and talented volunteer group that could use expert help. (Hint, hint). They act in place of CDC: covidtracking.com Also for the curious: Best to all, Dean Gerber
On Sunday, March 29, 2020, 06:20:01 PM MDT, Tom Johnson <[hidden email]> wrote:
Ah yes. The ol' Behavioral Epidemiology theory. ============================================ Tom Johnson - [hidden email] Institute for Analytic Journalism -- Santa Fe, NM USA 505.577.6482(c) 505.473.9646(h) NM Foundation for Open Government Check out It's The People's Data ============================================ On Sun, Mar 29, 2020 at 6:17 PM Frank Wimberly <[hidden email]> wrote:
============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
Re: Coronavirus New Mexico numbers.xlsx
|
|
In reply to this post by Frank Wimberly-2
The column you added appears to be State-County. Maybe you grabbed the wrong spreadsheet? -- rec -- On Sun, Mar 29, 2020 at 8:17 PM Frank Wimberly <[hidden email]> wrote:
============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
Re: Coronavirus New Mexico numbers.xlsx
|
|
The column i added was simply the differences between adjacent cells of the previous column. That is, the discrete estimate of the time derivative. --- Frank C. Wimberly 505 670-9918 Santa Fe, NM On Mon, Mar 30, 2020, 6:27 AM Roger Critchlow <[hidden email]> wrote:
============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
Re: Coronavirus New Mexico numbers.xlsx
|
|
But it suggests an interesting hypothesis: the number of cases in Torrance County is the derivative of the number of cases in the state of New Mexico. --- Frank C. Wimberly 505 670-9918 Santa Fe, NM On Mon, Mar 30, 2020, 7:02 AM Frank Wimberly <[hidden email]> wrote:
============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
Re: Coronavirus New Mexico numbers.xlsx
|
In reply to this post by thompnickson2
It appears from the code base that covidtracking.com is pulling the data via screenshots and then manually entering the data. Is this possible? Do you think they might want a scraper for that project? ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
|
Don't they already do it semi-auto?
https://github.com/COVID19Tracking/covid-data-pipeline On 3/30/20 9:50 AM, Jon Zingale wrote: > It appears from the code base that covidtracking.com <http://covidtracking.com> > is pulling the data via screenshots and then manually > entering the data. Is this possible? Do you think they > might want a scraper for that project? -- ☣ uǝlƃ ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove
uǝʃƃ ⊥ glen
|
Re: Coronavirus New Mexico numbers.xlsx
|
|
In reply to this post by thompnickson2
Semi-auto is a little like half assed. For what would get the data directly to database or even a csv file in 5 lines, there is a whole lot of node infrastructure setup to take screenshots and post to s3 buckets. And for there to be 27 contributors, the project appears like it could use some direction. ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
|
|
I'll trust your criticism. But the perfect shouldn't be the enemy of the good. If this was the best/first way for them to act, then I wouldn't be too hard on them. If you attempt to help and they get all defensive, then "No Quarter". 8^)
But semi-auto isn't half-assed in the general sense. I think once you get the data into publishable form humans need to do some verification, even if that bottlenecks the process. The last thing you want is some bug in the fully automatic stack to produce misleading output. There may even be an argument for a few eyeball bottlenecks in the toolchain, if for no other reason than scaffolding for when/if the final verification step fails. On 3/30/20 12:04 PM, Jon Zingale wrote: > Semi-auto is a little like half assed. For what would > get the data directly to database or even a csv file > in 5 lines, there is a whole lot of node infrastructure > setup to take screenshots and post to s3 buckets. > And for there to be 27 contributors, the project appears > like it could use some direction. -- ☣ uǝlƃ ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove
uǝʃƃ ⊥ glen
|
Re: Coronavirus New Mexico numbers.xlsx
|
|
In reply to this post by thompnickson2
============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
|
|
Very nice! Does the following indicate they're processing several sites, whose formats may differ?
https://github.com/COVID19Tracking/covid-tracking/blob/master/urls.yaml On 3/30/20 12:51 PM, Jon Zingale wrote: > Perhaps you are right and I should be more helpful. > Here are the 20 lines <https://github.com/jonzingale/jonzingale.github.io/blob/master/covid19/nm_dept_health.rb>. -- ☣ uǝlƃ ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove
uǝʃƃ ⊥ glen
|
Re: Coronavirus New Mexico numbers.xlsx
|
|
In reply to this post by thompnickson2
Glen, I imagine, without looking for it explicitly in the code, they find a `best site at the time` for each state, NM for instance: Best current data source for New Mexico. While it may take 15 minutes or so for a programmer to write a scraper for a state, the hours likely logged on converting daily screenshots to csvs is likely quite a bit more. The entire pipeline, data entry included, is also pretty likely to add noise. ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
|
|
Yes, I understand. The TODO item, here <https://github.com/COVID19Tracking/covid-tracking> implies that they may welcome your Ruby snippet for NM. The question is how to fold it into their workflow.
On 3/30/20 1:25 PM, Jon Zingale wrote: > I imagine, without looking for it explicitly in the code, > they find a `best site at the time` for each state, NM > for instance: Best current data source for New Mexico. <https://cv.nmhealth.org/> > > While it may take 15 minutes or so for a programmer > to write a scraper for a state, the hours likely logged on > converting daily screenshots to csvs is likely quite a bit more. > The entire pipeline, data entry included, is also pretty likely > to add noise. -- ☣ uǝlƃ ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove
uǝʃƃ ⊥ glen
|
Re: Coronavirus New Mexico numbers.xlsx
|
|
In reply to this post by thompnickson2
Glen, They may have some thoughts on how they would like to integrate scraped data into their platform. I just sent them the code and will wait for a reply. It might be fun to flesh out scrapers for the other 49 :) Jon ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove |
|
|
Excellent! Please keep us (or just me, if nobody else cares) updated on if/how they accept help. If there's any way I can help you help them, I will. My Ruby is limited to some playing with the core language back with 1.8 or 1.9, I think. I had no idea "Mechanize" even existed.
On 3/30/20 2:02 PM, Jon Zingale wrote: > They may have some thoughts on how they would like > to integrate scraped data into their platform. I just sent them > the code and will wait for a reply. It might be fun to flesh out > scrapers for the other 49 :) -- ☣ uǝlƃ ============================================================ FRIAM Applied Complexity Group listserv Meets Fridays 9a-11:30 at cafe at St. John's College to unsubscribe http://redfish.com/mailman/listinfo/friam_redfish.com archives back to 2003: http://friam.471366.n2.nabble.com/ FRIAM-COMIC http://friam-comic.blogspot.com/ by Dr. Strangelove
uǝʃƃ ⊥ glen
|
| Free forum by Nabble | Edit this page |