Posted by
Nick Thompson on
Jan 29, 2009; 8:37pm
URL: http://friam.383.s1.nabble.com/Homeostasis-by-Peer-Review-tp2228018p2241149.html
Glen,
OK, but .... No matter how many dimensions of judgment you have, it all
boils down to a one-bit decision: either you are going to read the sucker
or you arent.
If one knows who the reviewers are ... knows their tastes, ete, perhaps
each consumer could rate reviewers and the program could give a stars by
reviewer-weighting customized for each consumer. Software could be
provided to do this. Very close to what Amazon provides right now, except
that each reader could accumulate his own personal judgments of reviewers,
rather than relying on swarm evaluation.
I forgot to say: Let's say the journal has an editorial board that rates
and comments on articles as they are submitted. Let;s say we start a
journal called THE FRIAM JOURNAL OF APPLIED COMPLEXITY. Every article is
sent out to five reviewers. So now we have a possiblity of 25 stars, say.
Now, the editor passes along the ratings and suggestions of the readers
and the author now can make choice. He can carry on publication with a low
rating, or he can revise and resubmit to get a better rating.
this led to another thought. A group such as this one wouldnt need even to
start its own journal. It could just start a rating service of some other
publication. We could, for instance, start by rating JASSS and putting the
ratings up on the web. The trouble is we wouldnt be rating or seeing the
articles that JASSS had rejected. I suppose we could ask JASSS to send us
all their rejected articles!
I am probably too lazy to do anything like this, but I really like thinking
about it.
Nicholas S. Thompson
Emeritus Professor of Psychology and Ethology,
Clark University (
[hidden email])
> [Original Message]
> From: glen e. p. ropella <
[hidden email]>
> To: The Friday Morning Applied Complexity Coffee Group <
[hidden email]>
> Date: 1/29/2009 12:44:00 PM
> Subject: Re: [FRIAM] Homeostasis by Peer Review
>
> Thus spake Nicholas Thompson circa 28/01/09 07:34 PM:
> > [...] why not
> > have every article published and every article rated by a number of
stars,
> > and then everybody could set their browser to the minimum number of
stars
> > we are willing to tolerate. Those of us who don't want to be subject to
> > the "peer review" effect, could simply set their browser to read
everything
> > with any stars at all!
>
> The problem with this is that a number of stars is uni-dimensional,
> while the guidelines for reviewers for any given publication are
> multi-dimensional (and/or vague).
>
> You could still project down to one dimension if you have a strong
> policy of who gets to rate the article, what the criteria are for the
> rating, and the trump power of the editor's opinion.
>
> The ultimate automation would be a multi-dimensional rating measure,
> though. Then you might be able to get rid of the per-publication
> policies. I'm imagining a preference- (or query-) controlled modal
> 5-dimensional 3D space with color and animation. Oooo, we could also
> implement an automated-profiling-controlled physics for the 5D system so
> that articles were, say, attracted to you based on your past interests,
> more elastic where clusters of articles cover much of the same content,
> coefficients of friction were adjusted based on which region of rating
> space you were exploring at the time, colors (of the articles) change
> when your focus shifts from fact to speculation or physics to
> philosophy, etc.
>
> ... or not.
>
> --
> glen e. p. ropella, 971-222-9095,
http://agent-based-modeling.com>
>
> ============================================================
> FRIAM Applied Complexity Group listserv
> Meets Fridays 9a-11:30 at cafe at St. John's College
> lectures, archives, unsubscribe, maps at
http://www.friam.org============================================================
FRIAM Applied Complexity Group listserv
Meets Fridays 9a-11:30 at cafe at St. John's College
lectures, archives, unsubscribe, maps at
http://www.friam.org