= 27d567bc2d48d9f40e9ccc20ea370b15)
whpearson comments on Frequentist Statistics are Frequently Subjective - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (81)
Bittorrent? You can publish shasums of the data sets in the paper so you know it is the data you are looking for.
Bittorrent specializes in short-term, spiky mass downloading. It's not so hot for the long tail of years or decades. How many large torrents are alive after a few years?
This is exactly the problem that archive.org was set up to deal with. They've been doing an excellent job of it, and their cost-per-gigabyte-month is only going to drop as storage and bandwidth become cheaper.
Yes, they have been doing an excellent job. I've donated to them more than once because I find myself using the IA on a nigh-daily basis.
But the IA is no panacea. It can only store some categories of content reliably, and the rest is inaccessible. Nor have I seen them hold & distribute the truly enormous datasets that much research will use - the biggest files I've seen the IA offer for public download are in the single gigabytes or hundreds of megabytes range.