[LINK] Sign up for DAGGRE to improve science and technology forecasting

Qiaochu_Yuan

In When Will AI Be Created?, I named four methods that might improve our forecasts of AI and other important technologies. Two of these methods were explicit quantification and leveraging aggregation, as exemplified by IARPA's ACE program, which aims to “dramatically enhance the accuracy, precision, and timeliness of… forecasts for a broad range of event types, through the development of advanced techniques that elicit, weight, and combine the judgments of many analysts.

GMU's DAGGRE program, one of five teams participating in ACE, recently announced a transition from geopolitical forecasting to science & technology forecasting:

DAGGRE will continue, but it will transition from geo-political forecasting to science and technology (S&T) forecasting to better use its combinatorial capabilities. We will have a brand new shiny, friendly and informative interface co-designed by Inkling Markets, opportunities for you to provide your own forecasting questions and more!

Another exciting development is that our S&T forecasting prediction market will be open to everyone in the world who is at least eighteen years of age. We’re going global!

If you want help improve humanity’s ability to forecast important technological developments like AI, please register for DAGGRE’s new S&T prediction website here.

Experienced PredictionBook veterans should do well.

Link:

In When Will AI Be Created?, I named four methods that might improve our forecasts of AI and other important technologies. Two of these methods were explicit quantification and leveraging aggregation, as exemplified by IARPA's ACE program, which aims to “dramatically enhance the accuracy, precision, and timeliness of… forecasts for a broad range of event types, through the development of advanced techniques that elicit, weight, and combine the judgments of many analysts.

GMU's DAGGRE program, one of five teams participating in ACE, recently announced a transition from geopolitical forecasting to science & technology forecasting:

DAGGRE will continue, but it will transition from geo-political forecasting to science and technology (S&T) forecasting to better use its combinatorial capabilities. We will have a brand new shiny, friendly and informative interface co-designed by Inkling Markets, opportunities for you to provide your own forecasting questions and more!

Another exciting development is that our S&T forecasting prediction market will be open to everyone in the world who is at least eighteen years of age. We’re going global!

If you want help improve humanity’s ability to forecast important technological developments like AI, please register for DAGGRE’s new S&T prediction website here.

Experienced PredictionBook veterans should do well.

I couldn't believe the registration "questions".

"A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost?"
"If it takes 5 machines 5 minutes to make 5 widgets, how long would it take 100 machines to make 100 widgets?"
"In a lake, there is a patch of lily pads. Every day, the patch doubles in size. If it takes 48 days for the patch to cover the entire lake, how long would it take for the patch to cover half the lake?"

These are the exact questions from this blog post, to the letter (and are also all very well known outside that, but sometimes in different orders). What?

Then there were a few that state "Discontinued", including one with the answers (this was multiple choice), "Completely a Fox", "In between a Fox and a Hedgehog", and "Completely a Hedgehog" (with a few others in between). Why these questions were not just removed from the form is beyond me. I'm also really interested in how, at least for a while, they may have assumed readers knew about this dichotomy, especially readers who they assumed did not know the 3 most popular analysis/rationality questions on the internet.

The main site seems to be written in Ember or Backbone.js or something, and yet it's really tough to use and is very buggy in chrome. (Closer inspection shows they may have done it without a MVC js framework. Also, they haven't minified their main JS files for some reason.)

The existing platform has all the markings of a big bureaucratic project combined with recent web and prediction market trends. Bizarre.

Whoa whoa whoa! That's the old registration site. Go to signup.daggre.org to register for the S&T market (like the original post said).

And, er, sorry about the disrepair of the old intake questions. I thought that had been taken care of ages ago. (But the Cognitive Reflectance Test questions are actually a pretty good screen. Fewer than half the people answer them correctly.) Anyway, the main site is going down shortly while we retool. Use signup.daggre.org to get in the queue for the Science & Technology forecasting site. We're going to ta... (read more)

8Qiaochu_Yuan13y

Having a very low bar to cross might still be helpful. Answering those questions correctly might not tell you much, but answering them incorrectly is a bad sign. I agree the "Discontinued" questions were weird.

2ozziegooen13y

On that note, seriously, check out IARPA if you get a chance. It seems to be a recent (2008) offshoot of DARPA, that's like "Darpa, but for Spies". Their mission is to "invest in high-risk/high-payoff research programs that have the potential to provide the United States with an overwhelming intelligence advantage over future adversaries." link Basically, it seems like they are the government's bleeding edge of spying and internet security. Some of their researchers seem to be doing projects focussed on quantum computing and computer security. Others on using public big data to predict possible threats. Others to train people to understand their cognitive biases by playing games. It's almost as if someone cloned LessWrong and had them work for the government but closed sourced and significantly less idealistic. It's really a pity that it's all closed, with the mission itself implying a zero-sum game. However, there is a surprising amount of public information on their website. For example, check out the complete sirius page. Not only can you find a pretty precise documentation of how the IARPA is trying to make this game to reduce cognitive biases, but you can also find all of the proposals by different agencies to get this contract. Really interesting stuff.