Online discussion is better than pre-publication peer review

4 Wei_Dai 05 September 2017 01:25PM

Related: Why Academic Papers Are A Terrible Discussion Forum, Four Layers of Intellectual Conversation

During a recent discussion about (in part) academic peer review, some people defended peer review as necessary in academia, despite its flaws, for time management. Without it, they said, researchers would be overwhelmed by "cranks and incompetents and time-card-punchers" and "semi-serious people post ideas that have already been addressed or refuted in papers already". I replied that on online discussion forums, "it doesn't take a lot of effort to detect cranks and previously addressed ideas". I was prompted by Michael Arc and Stuart Armstrong to elaborate. Here's what I wrote in response:

My experience is with systems like LW. If an article is in my own specialty then I can judge it easily and make comments if it’s interesting, otherwise I look at its votes and other people’s comments to figure out whether it’s something I should pay more attention to. One advantage over peer review is that each specialist can see all the unfiltered work in their own field, and it only takes one person from all the specialists in a field to recognize that a work may be promising, then comment on it and draw others’ attentions. Another advantage is that nobody can make ill-considered comments without suffering personal consequences since everything is public. This seem like an obvious improvement over standard pre-publication peer review, for the purpose of filtering out bad work and focusing attention on promising work, and in practice works reasonably well on LW.

Apparently some people in academia have come to similar conclusions about how peer review is currently done and are trying to reform it in various ways, including switching to post-publication peer review (which seems very similar to what we do on forums like LW). However it's troubling (in a "civilizational inadequacy" sense) that academia is moving so slowly in that direction, despite the necessary enabling technology having been invented a decade or more ago.

Meetup : LW Netherlands

0 toonalfrink 04 September 2017 02:53PM

Discussion article for the meetup : LW Netherlands

WHEN: 03 September 2122 04:52:00PM (+0200)

WHERE: Amsterdam

Discussion article for the meetup : LW Netherlands

Open thread, September 4 - September 10, 2017

1 Thomas 04 September 2017 07:41AM
If it's worth saying, but not worth its own post, then it goes here.

Notes for future OT posters:

1. Please add the 'open_thread' tag.

2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)

3. Open Threads should start on Monday, and end on Sunday.

4. Unflag the two options "Notify me of new top level comments on this article" and "

Meetup : Slate Star Codex

0 robirahman 04 September 2017 05:05AM

Discussion article for the meetup : Slate Star Codex

WHEN: 23 September 2017 07:00:00PM (-0400)

WHERE: 450 Massachusetts Avenue Northwest

The monthly Slate Star Codex discussion group. We'll be meeting in the fourteenth floor lounge.

For details, check the google groups forum: https://groups.google.com/forum/#!forum/dc-slatestarcodex

Discussion article for the meetup : Slate Star Codex

[Link] Minimizing Motivated Beliefs

0 entirelyuseless 03 September 2017 03:56PM

[Link] Debiasing by rationalizing your own motives

1 Kaj_Sotala 03 September 2017 12:20PM

September 2017 Media Thread

1 ArisKatsaris 02 September 2017 09:17PM

This is the monthly thread for posting media of various types that you've found that you enjoy. Post what you're reading, listening to, watching, and your opinion of it. Post recommendations to blogs. Post whatever media you feel like discussing! To see previous recommendations, check out the older threads.

Rules:

  • Please avoid downvoting recommendations just because you don't personally like the recommended material; remember that liking is a two-place word. If you can point out a specific flaw in a person's recommendation, consider posting a comment to that effect.
  • If you want to post something that (you know) has been recommended before, but have another recommendation to add, please link to the original, so that the reader has both recommendations.
  • Please post only under one of the already created subthreads, and never directly under the parent media thread.
  • Use the "Other Media" thread if you believe the piece of media you want to discuss doesn't fit under any of the established categories.
  • Use the "Meta" thread if you want to discuss about the monthly media thread itself (e.g. to propose adding/removing/splitting/merging subthreads, or to discuss the type of content properly belonging to each subthread) or for any other question or issue you may have about the thread or the rules.

Simplified Anthropic Doomsday

0 Stuart_Armstrong 02 September 2017 08:37PM

Here is a simplified version of the Doomsday argument in Anthropic decision theory, to get easier intuitions.

Assume a single agent A exists, an average utilitarian, with utility linear in money. Their species survives with 50% probability; denote this event by S. If the species survives, there will be 100 people total; otherwise the average utilitarian is the only one of its kind. An independent coin lands heads with 50% probability; denote this event by H.

Agent A must price a coupon CS that pays out €1 on S, and a coupon CH that pays out €1 on H. The coupon CS pays out only on S, thus the reward only exists in a world where there are a hundred people, thus if S happens, the coupon CS is worth (€1)/100. Hence its expected worth is (€1)/200=(€2)/400.

But H is independent of S, so (H,S) and (H,¬S) both have probability 25%. In (H,S), there are a hundred people, so CH is worth (€1)/100. In (H,¬S), there is one person, so CH is worth (€1)/1=€1. Thus the expected value of CH is (€1)/4+(€1)/400 = (€101)/400. This is more than 50 times the value of CS.

Note that C¬S, the coupon that pays out on doom, has an even higher expected value of (€1)/2=(€200)/400.

So, H and S have identical probability, but A assigns CS and CH different expected utilities, with a higher value to CH, simply because S is correlated with survival and H is independent of it (and A assigns an ever higher value to C¬S, which is anti-correlated with survival). This is a phrasing of the Doomsday Argument in ADT.

Meetup : Instrumental rationality meetup - Manchester UK

0 bendini 01 September 2017 01:33PM

Discussion article for the meetup : Instrumental rationality meetup - Manchester UK

WHEN: 09 September 2017 03:00:00PM (+0100)

WHERE: The Wharf, Manchester, M15 4ST, UK

Discussion article for the meetup : Instrumental rationality meetup - Manchester UK

Meetup : San Francisco Meetup: Deep Questions

0 rocurley 31 August 2017 10:56PM

Discussion article for the meetup : San Francisco Meetup: Deep Questions

WHEN: 04 September 2017 06:15:00PM (-0700)

WHERE: 140 S Van Ness Ave, San Francisco, CA 94103-2519, United States

We’re trying a new format this week!

How Deep Questions works: We’ll break into pairs. Each pair will take turns answering one of a selected list of open-ended meaningful questions (e.g. “What in life gets you really excited?”, “What’s one thing you’ve never told someone before about yourself that you feel comfortable sharing with a stranger?”, “What do you hope they say in your obituary?”, “Who do you admire most, and why do you admire that person so much?”). Each pair gets 12 minutes for both people to answer the question; after 12 minutes, the pairs rotate to take on the next question with a new person.

This meetup is more structured than usual; at the recent meta-meetup, we got feedback that more structured interaction might help shy people integrate better into the group. Please let us know what you think of this meetup format.

For help getting into the building, please call (or text, with a likely-somewhat-slower response rate): 301-458-0764.

Format:

We meet and start hanging out at 6:15, but don’t officially start doing the meetup topic until 6:45-7 to accommodate stragglers. Usually there is a food order that goes out before we start the meetup topic.

About these meetups:

The mission of the SF LessWrong meetup is to provide a fun, low-key social space with some structured interaction, where new and non-new community members can mingle and have interesting conversations. Everyone is welcome.

We explicitly encourage people to split off from the main conversation or diverge from the topic if that would be more fun for them (moving side conversations into a separate part of the space if appropriate). Meetup topics are here as a tool to facilitate fun interaction, and we certainly don’t want them to inhibit it.

Discussion article for the meetup : San Francisco Meetup: Deep Questions

View more: Next