Online discussion is better than pre-publication peer review
Related: Why Academic Papers Are A Terrible Discussion Forum, Four Layers of Intellectual Conversation
During a recent discussion about (in part) academic peer review, some people defended peer review as necessary in academia, despite its flaws, for time management. Without it, they said, researchers would be overwhelmed by "cranks and incompetents and time-card-punchers" and "semi-serious people post ideas that have already been addressed or refuted in papers already". I replied that on online discussion forums, "it doesn't take a lot of effort to detect cranks and previously addressed ideas". I was prompted by Michael Arc and Stuart Armstrong to elaborate. Here's what I wrote in response:
My experience is with systems like LW. If an article is in my own specialty then I can judge it easily and make comments if it’s interesting, otherwise I look at its votes and other people’s comments to figure out whether it’s something I should pay more attention to. One advantage over peer review is that each specialist can see all the unfiltered work in their own field, and it only takes one person from all the specialists in a field to recognize that a work may be promising, then comment on it and draw others’ attentions. Another advantage is that nobody can make ill-considered comments without suffering personal consequences since everything is public. This seem like an obvious improvement over standard pre-publication peer review, for the purpose of filtering out bad work and focusing attention on promising work, and in practice works reasonably well on LW.
Apparently some people in academia have come to similar conclusions about how peer review is currently done and are trying to reform it in various ways, including switching to post-publication peer review (which seems very similar to what we do on forums like LW). However it's troubling (in a "civilizational inadequacy" sense) that academia is moving so slowly in that direction, despite the necessary enabling technology having been invented a decade or more ago.
Meetup : LW Netherlands
Discussion article for the meetup : LW Netherlands
To see the actual agenda, go to https://www.facebook.com/groups/RationalityMeetupNL/events/
Discussion article for the meetup : LW Netherlands
Open thread, September 4 - September 10, 2017
If it's worth saying, but not worth its own post, then it goes here.
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should start on Monday, and end on Sunday.
4. Unflag the two options "Notify me of new top level comments on this article" and "
Meetup : Slate Star Codex
Discussion article for the meetup : Slate Star Codex
The monthly Slate Star Codex discussion group. We'll be meeting in the fourteenth floor lounge.
For details, check the google groups forum: https://groups.google.com/forum/#!forum/dc-slatestarcodex
Discussion article for the meetup : Slate Star Codex
September 2017 Media Thread
This is the monthly thread for posting media of various types that you've found that you enjoy. Post what you're reading, listening to, watching, and your opinion of it. Post recommendations to blogs. Post whatever media you feel like discussing! To see previous recommendations, check out the older threads.
Rules:
- Please avoid downvoting recommendations just because you don't personally like the recommended material; remember that liking is a two-place word. If you can point out a specific flaw in a person's recommendation, consider posting a comment to that effect.
- If you want to post something that (you know) has been recommended before, but have another recommendation to add, please link to the original, so that the reader has both recommendations.
- Please post only under one of the already created subthreads, and never directly under the parent media thread.
- Use the "Other Media" thread if you believe the piece of media you want to discuss doesn't fit under any of the established categories.
- Use the "Meta" thread if you want to discuss about the monthly media thread itself (e.g. to propose adding/removing/splitting/merging subthreads, or to discuss the type of content properly belonging to each subthread) or for any other question or issue you may have about the thread or the rules.
Simplified Anthropic Doomsday
Here is a simplified version of the Doomsday argument in Anthropic decision theory, to get easier intuitions.
Assume a single agent A exists, an average utilitarian, with utility linear in money. Their species survives with 50% probability; denote this event by S. If the species survives, there will be 100 people total; otherwise the average utilitarian is the only one of its kind. An independent coin lands heads with 50% probability; denote this event by H.
Agent A must price a coupon CS that pays out €1 on S, and a coupon CH that pays out €1 on H. The coupon CS pays out only on S, thus the reward only exists in a world where there are a hundred people, thus if S happens, the coupon CS is worth (€1)/100. Hence its expected worth is (€1)/200=(€2)/400.
But H is independent of S, so (H,S) and (H,¬S) both have probability 25%. In (H,S), there are a hundred people, so CH is worth (€1)/100. In (H,¬S), there is one person, so CH is worth (€1)/1=€1. Thus the expected value of CH is (€1)/4+(€1)/400 = (€101)/400. This is more than 50 times the value of CS.
Note that C¬S, the coupon that pays out on doom, has an even higher expected value of (€1)/2=(€200)/400.
So, H and S have identical probability, but A assigns CS and CH different expected utilities, with a higher value to CH, simply because S is correlated with survival and H is independent of it (and A assigns an ever higher value to C¬S, which is anti-correlated with survival). This is a phrasing of the Doomsday Argument in ADT.
Meetup : Instrumental rationality meetup - Manchester UK
Discussion article for the meetup : Instrumental rationality meetup - Manchester UK
Facebook event: https://www.facebook.com/events/1523828371014192/
Discussion article for the meetup : Instrumental rationality meetup - Manchester UK
Meetup : San Francisco Meetup: Deep Questions
Discussion article for the meetup : San Francisco Meetup: Deep Questions
We’re trying a new format this week!
How Deep Questions works: We’ll break into pairs. Each pair will take turns answering one of a selected list of open-ended meaningful questions (e.g. “What in life gets you really excited?”, “What’s one thing you’ve never told someone before about yourself that you feel comfortable sharing with a stranger?”, “What do you hope they say in your obituary?”, “Who do you admire most, and why do you admire that person so much?”). Each pair gets 12 minutes for both people to answer the question; after 12 minutes, the pairs rotate to take on the next question with a new person.
This meetup is more structured than usual; at the recent meta-meetup, we got feedback that more structured interaction might help shy people integrate better into the group. Please let us know what you think of this meetup format.
For help getting into the building, please call (or text, with a likely-somewhat-slower response rate): 301-458-0764.
Format:
We meet and start hanging out at 6:15, but don’t officially start doing the meetup topic until 6:45-7 to accommodate stragglers. Usually there is a food order that goes out before we start the meetup topic.
About these meetups:
The mission of the SF LessWrong meetup is to provide a fun, low-key social space with some structured interaction, where new and non-new community members can mingle and have interesting conversations. Everyone is welcome.
We explicitly encourage people to split off from the main conversation or diverge from the topic if that would be more fun for them (moving side conversations into a separate part of the space if appropriate). Meetup topics are here as a tool to facilitate fun interaction, and we certainly don’t want them to inhibit it.
Discussion article for the meetup : San Francisco Meetup: Deep Questions
View more: Next
= 783df68a0f980790206b9ea87794c5b6)
Subscribe to RSS Feed
= f037147d6e6c911a85753b9abdedda8d)