gwern comments on Open Thread April 8 - April 14 2014 - Less Wrong

3 Post author: Tenoke 08 April 2014 11:11AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (242)

You are viewing a single comment's thread.

Comment author: gwern 13 April 2014 03:01:23AM *  1 point [-]

Have LWers ever used Usenet? By that, I mean: connected to a NNTP server (not Google Groups) with a newsreader to read discussions and perhaps comment (not solely download movies & files).

Your age is:

I am curious about the age-distribution of Usenet use: I get the feeling that there is a very sharp fall in Usenet age such that all nerds who grew up in the '70s-'80s used Usenet, but nerd teens in the mid-'90s to now have zero usage of it except for a rare few who know it as a better BitTorrent.

Submitting...

Comment author: JayDee 15 April 2014 07:54:22AM 1 point [-]

Hmm, I'm not entirely sure. I can find old usenet comments - like my nethack YAFAP - from 2005 to 2008, but as far I can tell they were all made with Google Groups. I do vaguely recall using a newsreader, maybe trying to set up Thunderbird? It certainly would have been in character, "real men use newsreaders, and never top-post" kind of thing was a big part of the appeal. Possibly I could only get read-only access through whatever free provider I found.

At the time, the communities discussing interactive fiction and roguelike games were still centered on usenet (rec.arts.int-fiction and rec.games.roguelikes.* respectively) although iirc half the conversations were on the need to move on, to web forums or whatnot.

Comment author: JayDee 15 April 2014 07:56:55AM 0 points [-]

LessWrong tends to remind me more of usenet. Probably just due to the threaded comments.

I'd happily read this site with a newsreader.

Comment author: gwern 27 February 2015 02:30:35AM *  0 points [-]

A belated analysis: hypothesis confirmed to my satisfaction - as expected, age is strongly related to Usenet-familiarity. (There's even a hint of a quick shift in the histograms.)

# <https://www.dropbox.com/s/d5kddi1ckl3qbxk/2015-02-26-lw-usenet.csv>
usenet <- read.csv("2015-02-26-lw-usenet.csv", header=FALSE)
usenet2 <- data.frame(Usenet=usenet[1:67,]$V3, Age=usenet[68:134,]$V3)
## the default LW poll encoding is yes=0, no=1; this is very confusing, so let's reverse it
usenet2$Usenet <- (usenet2$Usenet==0)
wilcox.test(Age ~ Usenet, data=usenet2)
#
# Wilcoxon rank sum test with continuity correction
#
# data: Age by Usenet
# W = 183.5, p-value = 3.893e-06
g <- glm(Usenet ~ Age, data=usenet2, family="binomial"); summary(g)
# ...Coefficients:
# Estimate Std. Error z value Pr(>|z|)
# (Intercept) -7.33329350 1.93381008 -3.79215 0.00014935
# Age 0.24311715 0.06695693 3.63095 0.00028238
## alternative plot:
# with(usenet2, plot(Age,Usenet,xlab="Age",ylab="Probability of Usenet familiarity"))
# curve(predict(g,data.frame(Age=x),type="resp"),add=TRUE)
# points(usenet2$Age,fitted(g),pch=20)
library(popbio)
with(usenet2, logi.hist.plot(Age,Usenet,boxp=FALSE,type="hist",col="gray"))
## <https://i.imgur.com/W6DT9Tu.png>

Histograms of distribution of age split by Usenet-familiarity, with overlaid logistic regression line

## specific example: 51yo vs 20yo probabilities based on the model: predict(g, data.frame(Age=51), type="response")
# 1
# 0.9937299491
predict(g, data.frame(Age=20), type="response")
# 1
# 0.07791991187

(If anyone is curious, my original motive was wondering about Satoshi Nakamoto & Nick Szabo - both are familiar with and have used Usenet. We already know Szabo is old and very similar to LWers, so being Usenet-familiar turns out to be entirely ordinary as I guessed, but if Satoshi Nakamoto were a young college student as some people thought, then being Usenet-familiar is pretty surprising.)

Comment author: ChristianKl 15 April 2014 04:20:11PM 0 points [-]

I might have used it a bit but I voted "no" because I didn't use it in a significant amount to be able to say for sure that I used it.

Comment author: CronoDAS 13 April 2014 06:10:33AM *  0 points [-]

Me, I used USENET a lot back in the late 1990s, mostly hanging out on alt.games.final-fantasy. Sad to say, my internet service provider back then was AOL. (The first newsgroup I tried reading was alt.barney.dinosaur.die.die.die...)

My impression is that USENET died because it lacked reasonable spam prevention measures?

Comment author: RichardKennaway 13 April 2014 07:47:59AM 2 points [-]

My impression is that USENET died because it lacked reasonable spam prevention measures?

Spam started on Usenet. The Canter & Siegel visa spam! The anatomically correct chocolate heart! Ah, memories.

So yes, a lot of it was overrun by spam for a while, but countermeasures were developed, and eventually the spam was brought down to the level we see today. My impression is that Usenet faded because blogging and web forums were invented, and most people voted with their feet. And then public access to the Internet exploded, the general public never even knew there was such a thing, and USENET faded into an obscure backwater of old-timers, which has probably contributed to it lingering on for as long as it has, under the benign neglect of Google and whatever sysadmins still run nntp servers. I've just looked into rec.arts.sf.fandom and it's still going, but I recognise nearly all of the posters' names, which implies that it's the same people as it was years ago, perhaps thinned by age. I've nothing against them, but I'm not going back.

Is USENET still USENET, even? That is, are there still nntp servers propagating the messages to "thousands of machines throughout the entire civilized world"? Or does everyone go to Google Groups to use it?

USENET developed as it did because of the technological and social environment of the time, and faded when that environment changed. No-one would invent it today, except in the form of a heavily decentralised and encrypted medium for secret discussion.

Comment author: gwern 13 April 2014 04:26:26PM *  2 points [-]

Is USENET still USENET, even? That is, are there still nntp servers propagating the messages to "thousands of machines throughout the entire civilized world"? Or does everyone go to Google Groups to use it?

Yes, it's still possible to use Usenet independent of GG.

For example, in the early 2000s, I was doing a lot of reading of early Web/Internet sociology, nerd culture, etc, got very curious about what Usenet was really like (I understood all the basics and a lot of details like scoring files, but there's nothing like using something to get a feel for it) and discovered my local ISP had a NNTP server up for a decent chunk of Usenet (the main omission being the bin hierarchy). A few hours of meddling with Thunderbird and later, mutt...

It worked reasonably well and I understood why it was so dominant in its day, but spam was still a big problem compared to regular mailing lists and if my ISP didn't have a server up, I'm not sure how I would have gotten onto Usenet at all - there are few free servers these days.

No-one would invent it today, except in the form of a heavily decentralised and encrypted medium for secret discussion.

Still works pretty well for that. A fascinating example from 2005+: https://web.archive.org/web/20130119025623/http://dee.su/uploads/baal.html

Comment author: garabik 15 April 2014 06:36:09AM 1 point [-]

Yes, it's still possible to use Usenet independent of GG.

Indeed. I regularly participate in some groups. While just a shadow of its former self, USENET (the text part, never mind the binary groups – those are much used for ahem, redistribution of multimedia content) is still alive and certain groups are rather vibrant.

While the number of ISPs and universities that carry USENET declined almost to zero, several public news servers (aioe, ethernal-september) moved to fill this niche.

Comment author: Lumifer 15 April 2014 03:10:58PM 1 point [-]

What's the relationship between Usenet and Google Groups nowadays? I thought that at some point Google rebadged much of Usenet forums as Google Groups?

Comment author: gwern 15 April 2014 05:02:08PM 3 points [-]

It's something like that. As I understand it, Google Groups runs thousands of normal email mailing lists with no connection to Usenet, but it also offers a bidirectional gateway to Usenet - GG'll show Usenet posts that it can download or which it has copies of in its huge archive, and it'll let GG users post to Usenet as well.

Comment author: Lumifer 15 April 2014 05:29:27PM 1 point [-]

So, basically, Google forked Usenet? X-)

Comment author: gwern 15 April 2014 10:27:45PM 4 points [-]

'Extend, Embrace, Extinguish.'

Comment author: RichardKennaway 14 April 2014 07:57:10PM 1 point [-]

For anyone who has never read USENET and is wondering what it was, I could say it was a completely decentralised collection of discussion forums in which every message posted was automatically replicated to every other participating machine, with nobody in charge of the whole thing, because before the web and broadband and instant global communications that was the only way you could implement a global discussion forum.

But that isn't what it was.

This is what it was.

The technology is still there, still running, but like an aged relative with a glorious career now over, it's not what it was.

Comment author: gwern 27 February 2015 02:04:21AM 1 point [-]

The technology is still there, still running, but like an aged relative with a glorious career now over, it's not what it was.

One sad minor consequence is that A Fire Upon The Deep is less funny and interesting now that most/all new readers will have no personal experience with Usenet.