Comment author: dougclow 01 May 2014 10:26:37AM *  18 points [-]

I spent quite a lot of time many years ago doing my own independent checks on astronomy.

I started down this line after an argument with a friend who believed in astrology. It became apparent that they were talking about planets being in different constellations to the ones I'd seen them in. I forget the details of their particular brand of astrology, but they had an algorithm for calculating a sort-of 'logical' position of the planets in the 12 zodiacal signs, and this algorithm did not match observation, even given that the zodiacal signs do not line up neatly with modern constellations. They were scornful that I was unable to tell them where, say, Venus would be in 12 years time, or where it was when I was born.

So challenged, I set to.

The scientific algorithms for doing this are not entirely trivial. I got hold of a copy of Jean Meeus' Astronomical Algorithms, and it took me quite a lot of work to understand them, and then even longer to implement them so I could answer that sort of question. They are hopelessly and messily empirical (which I take as a good sign) - there is a daunting number of coefficients. Eventually I got it working, and could match observation to prediction of planetary positions to my satisfaction - when I looked at them, the planets were where my calculations said they should be, more or less.

It's hard with amateur equipment to measure accurate locations in the sky (e.g. how high and in which direction is a particular star at a particular time), but relative ones are much easier (e.g. how close is Venus to a particular star at a particular time). The gold standard for this sort of stuff is occultations - where you predict that a planet will occult (pass in front of) a star. There weren't any of those happening around the time I was doing it, but I was able to verify the calculations for other occultations that people had observed (and photographed) at the date and times I had calculated.

These days, software to calculate this stuff - and to visualise it, which I never managed - is widely available. There are many smartphone apps that will show you these calculations overlaid on to the sky when you hold your phone up to it. (Although IME their absolute accuracy isn't brilliant, which I think is due to the orientation sensors being not that good.) This makes checking these sorts of predictions very, very easy. Although of course you can't check that there isn't, say, a team of astronomers making observations and regularly adjusting the data that gets to your phone.

I was also able to independently replicate enough of Fred Espenak's NASA eclipse calculations to completely convince me he was right. (After I found several bugs in my own code.) Perhaps the most spectacular verification was replicating the calculations for the solar eclipse of 11 August 1999. I was also able to travel to the path of totality in France, and it turned up slap on time and in place. This was amazing, and I strongly urge anyone reading this to make the effort to travel to the path of totality of any eclipse they can.

Until I'd played around with these calculations, I hadn't appreciated just how spectacularly accurate they have to be. You only need a teeny-tiny error in the locations of the Sun/Moon/Earth system for the shadow cast by the moon on the Earth to be in a very different place.

I also replicated the calculations for the transit of Venus in 2004. I was able to observe it, and it took place exactly as predicted so far as I was able to measure - to within, say, 10 seconds or so. (I didn't replicate the calculations for the transit in 2012 - no time and I'd forgotten about how my ghastly mess of code worked - and I wasn't able to observe it either, since it was cloudy where I was at the time.)

More recently, you can calculate Iridium flares and ISS transits. Again, you have to be extremely accurate in calculations to be able to predict where they will occur, and they turn up as promised (except when it's cloudy). And again, there are plenty of websites and apps that will do the calculations for you. With a pair of high-magnification binoculars you can even see that the ISS isn't round.

All this isn't complete and perfect verification. But it's pretty good Bayesian evidence in the direction that all that stuff about orbits and satellites is true.

Comment author: dougclow 01 May 2014 11:03:01AM *  6 points [-]

One thing I should mention where I wasn't able to get a very good match between my own observations and mainstream science.

The Sun and the Moon are very, very close in their apparent diameter in the sky. They are almost exactly the same size. You can measure them yourself and compare, although this is a bit fiddly; I certainly got well within my own measurement errors, although those errors were large. However, you can verify it very easily and directly at the time of solar eclipses. They are so near in size that the wobbliness of the Moon's orbit means that sometimes the Sun is just-smaller than the Moon (when you get a total eclipse) and sometimes it is just-bigger (when you get an annular eclipse).

But they are very, very different in their actual size, and in their distance from the Earth. In Father Ted terms, the Moon is small and close; the Sun is large and far away. In rough terms, the Moon is 400,000 km away and 3,400 km across, and the Sun is 150m km away and 1.4m km across. You don't have to change any one of those four measurements much for them to be quite different apparent sizes from the Earth. Indeed, if you do the calculations (which I can personally attest to), if you go back far enough in time they weren't the same apparent size, and nor are they if you go forward a long way in to the future.

Why? Why this coincidence? And why is it only happening at just the times when humans are around to observe it?

So far as I know, we have no good theories apart from "it just happened to work out that way". This is pretty unsatisfying.

Comment author: leplen 29 April 2014 09:55:51PM *  1 point [-]

Do you think that human beings will allow a single corporation to control a significant fraction of the world's resources? How will the company avoid anti-monopoly laws? Does a an AI CEO actually have control over a corporation, or does it only have the freedom to act within the defined social roles of what a "CEO" is allowed to do? I.e. it can negotiate a merger but can't hire a bunch of scientists and tell them to start mass producing nerve gas.

The U.S. government spends more money in a single year than the combined market capitalization of the 10 largest companies in the world.

In what sense does google "control a very large proportion of the world's computing resources"? Google maybe has the compute power equivalent to a handful of supercomputers, but even that isn't organized in a particularly useful way for an AI looking to do something dramatically different from performing millions of internet searches. For the vast majority of problems, I'd rather use ORNL's Titan than literally every computer google owns.

Comment author: dougclow 01 May 2014 10:44:39AM *  8 points [-]

An AI controlling a company like Google would be able to, say, buy up many of the world’s battle robot manufacturers, or invest a lot of money into human-focused bioengineering, despite those activities being almost entirely unrelated to their core business, and without giving any specific idea of why.

Indeed, on the evidence of the press coverage of Google's investments, it seems likely that many people would spend a lot of effort inventing plausible cover stories for the AI.

Comment author: leplen 29 April 2014 09:55:51PM *  1 point [-]

Do you think that human beings will allow a single corporation to control a significant fraction of the world's resources? How will the company avoid anti-monopoly laws? Does a an AI CEO actually have control over a corporation, or does it only have the freedom to act within the defined social roles of what a "CEO" is allowed to do? I.e. it can negotiate a merger but can't hire a bunch of scientists and tell them to start mass producing nerve gas.

The U.S. government spends more money in a single year than the combined market capitalization of the 10 largest companies in the world.

In what sense does google "control a very large proportion of the world's computing resources"? Google maybe has the compute power equivalent to a handful of supercomputers, but even that isn't organized in a particularly useful way for an AI looking to do something dramatically different from performing millions of internet searches. For the vast majority of problems, I'd rather use ORNL's Titan than literally every computer google owns.

Comment author: dougclow 01 May 2014 10:40:29AM *  4 points [-]

I'll grant that "a very large proportion of the world's computing resources" was under-specified and over-stated. Sorry.

Comment author: Douglas_Knight 30 April 2014 10:44:21PM 2 points [-]

It is odd that you highlight the Bedford Level Experiment, rather than other methods that have been used for thousands of years. The new experiment has the advantage that it can be performed by a single person in a single afternoon. It has the disadvantage that it shows that the Earth is flat.

Eratosthenes measured the north-south curvature of the Earth by making observations separated by hundreds of miles. It could be applied east-west with good clocks, or, as you suggest, with the simultaneity of telephones. Since I'd have to travel hundreds of miles anyway to reach the straight canal in Bedford, it has little advantage over Eratosthenes's method. I suppose you could make a similar observation by climbing a mast on a ship the right distance from shore, but the ocean waves add noise not present on the canal. It does have the advantage of requiring less geometry. Since the Bedford experiment used 1/100 the distance, it required 100x the accuracy of angular measurement. This is easy to overlook, since the measurement is not phrased that way, but I think this is why it encounters new sources of error.

Older experiments are generally easier. While everything is easier to measure today, the main advance is in measuring time.

Comment author: dougclow 01 May 2014 10:38:29AM *  2 points [-]

Bedford Level Experiment [...] has the disadvantage that it shows that the Earth is flat.

I love this. As it happens, I live quite near Bedford and am terribly tempted to actually try it one day. (Edit Looking closer, turns out the Bedford Level is in Norfolk, not Bedfordshire, so a little less nearby than I thought.)

There are loads of fun ways of verifying that the Earth isn't flat. Some of these were easily available to the ancients - e.g. the shape of the shadow of the Earth on the Moon during a lunar eclipse (it's always a curve). Others are easier now than they used to be - e.g. the variations in the constellations you can see as you travel north-south (it's much easier to travel far enough to see this than it used to be).

Some, however, simply weren't available.

My favourite explanation for how we know for sure the Earth is round is that we've been up in to space and looked. You can even verify this yourself with a GoPro and a high-altitude balloon, which many hobbyists have done.

Comment author: dougclow 01 May 2014 10:26:37AM *  18 points [-]

I spent quite a lot of time many years ago doing my own independent checks on astronomy.

I started down this line after an argument with a friend who believed in astrology. It became apparent that they were talking about planets being in different constellations to the ones I'd seen them in. I forget the details of their particular brand of astrology, but they had an algorithm for calculating a sort-of 'logical' position of the planets in the 12 zodiacal signs, and this algorithm did not match observation, even given that the zodiacal signs do not line up neatly with modern constellations. They were scornful that I was unable to tell them where, say, Venus would be in 12 years time, or where it was when I was born.

So challenged, I set to.

The scientific algorithms for doing this are not entirely trivial. I got hold of a copy of Jean Meeus' Astronomical Algorithms, and it took me quite a lot of work to understand them, and then even longer to implement them so I could answer that sort of question. They are hopelessly and messily empirical (which I take as a good sign) - there is a daunting number of coefficients. Eventually I got it working, and could match observation to prediction of planetary positions to my satisfaction - when I looked at them, the planets were where my calculations said they should be, more or less.

It's hard with amateur equipment to measure accurate locations in the sky (e.g. how high and in which direction is a particular star at a particular time), but relative ones are much easier (e.g. how close is Venus to a particular star at a particular time). The gold standard for this sort of stuff is occultations - where you predict that a planet will occult (pass in front of) a star. There weren't any of those happening around the time I was doing it, but I was able to verify the calculations for other occultations that people had observed (and photographed) at the date and times I had calculated.

These days, software to calculate this stuff - and to visualise it, which I never managed - is widely available. There are many smartphone apps that will show you these calculations overlaid on to the sky when you hold your phone up to it. (Although IME their absolute accuracy isn't brilliant, which I think is due to the orientation sensors being not that good.) This makes checking these sorts of predictions very, very easy. Although of course you can't check that there isn't, say, a team of astronomers making observations and regularly adjusting the data that gets to your phone.

I was also able to independently replicate enough of Fred Espenak's NASA eclipse calculations to completely convince me he was right. (After I found several bugs in my own code.) Perhaps the most spectacular verification was replicating the calculations for the solar eclipse of 11 August 1999. I was also able to travel to the path of totality in France, and it turned up slap on time and in place. This was amazing, and I strongly urge anyone reading this to make the effort to travel to the path of totality of any eclipse they can.

Until I'd played around with these calculations, I hadn't appreciated just how spectacularly accurate they have to be. You only need a teeny-tiny error in the locations of the Sun/Moon/Earth system for the shadow cast by the moon on the Earth to be in a very different place.

I also replicated the calculations for the transit of Venus in 2004. I was able to observe it, and it took place exactly as predicted so far as I was able to measure - to within, say, 10 seconds or so. (I didn't replicate the calculations for the transit in 2012 - no time and I'd forgotten about how my ghastly mess of code worked - and I wasn't able to observe it either, since it was cloudy where I was at the time.)

More recently, you can calculate Iridium flares and ISS transits. Again, you have to be extremely accurate in calculations to be able to predict where they will occur, and they turn up as promised (except when it's cloudy). And again, there are plenty of websites and apps that will do the calculations for you. With a pair of high-magnification binoculars you can even see that the ISS isn't round.

All this isn't complete and perfect verification. But it's pretty good Bayesian evidence in the direction that all that stuff about orbits and satellites is true.

Comment author: Emile 30 April 2014 08:47:57PM 8 points [-]

Is there an easily visible consequence of special relativity that you can see without specialized equipment?

A working GPS receiver.

I only believe that depends on special relativity because I was told so; if I'm so skeptical I suspect that scientist lied to me about special relativity, then I should be equally suspectful of engineers telling me GPSes have to take special relativity into account to work right.

Comment author: dougclow 01 May 2014 09:48:51AM 0 points [-]

If you are at all mathematical, you can verify that relativity affects GPS signals by calculating what difference both special relativity (satellite clock moving faster than clock on Earth, hence slower) and general relativity (satellite clock higher up the gravitational field than clock on Earth) would make to timekeeping and hence accuracy of location. The effects work against each other, but one is larger than the other.

You can verify accuracy of location of a GPS yourself. IME this is almost always considerably less accurate than published estimates by the device manufacturer, but still impressive. However, you need to be careful - most smartphones use multiple technologies to determine their location, not just GPS, so will be more accurate than the GPS signal can possibly be.

Comment author: Jayson_Virissimo 01 May 2014 01:59:23AM *  6 points [-]

This is a very interesting game. At a meta-level though, my belief in a lot of science is grounded in its usefulness. If people who believe in Newtonian physics can make me float in the air in a gigantic metal tube hurtling at 500 miles/hr while I sip my Coke, I suspect their belief is well-justified.

Yes, and many a medieval could have reasoned thusly:

If these people can contruct such a magnificent thing as Amiens Cathedral, I suspect their beliefs are well-justified.

Comment author: dougclow 01 May 2014 09:41:24AM 8 points [-]

To be fair to the medieval, their theories about how one can build large, beautiful buildings were pretty sound.

Comment author: XiXiDu 29 April 2014 11:56:17AM *  0 points [-]

Could the NSA, the security agency of the most powerful country on Earth, implement any of these schemes?

Er, yes, very easily.

Do you believe that if Obama were to ask the NSA to take over Russia, that the NSA could easily do so? If so, I am speechless.

Let's look at one of the most realistic schemes, creating a bioweapon. Yes, an organization like the NSA could probably design such a bioweapon. But how exactly could they take over the world that way?

They could either use the bioweapon to kill a huge number of people, or use it to blackmail the world into submission. I believe that the former would cause our technological civilization, on which the NSA depends, to collapse. So that would be stupid. The latter would maybe work for some time, until the rest of the world got together, in order to make a believable threat of mutual destruction.

I just don't see this to be a viable way to take over the world. At least not in such a way that you would gain actual control.

Now I can of course imagine a different world, in which it would be possible to gain control. Such as a world in which everyone important was using advanced brain implants. If these brain implants could be hacked, even the NSA could take over the world. That's a no-brainer.

I can also imagine a long-term plan. But those are very risky. The longer it takes, the higher the chance that your plan is revealed. Also, other AI's, with different, opposing utility-functions, will be employed. Some will be used to detect such plans.

Anyway, the assumption that an AI could understand human motivation, and become a skilled manipulator, is already too far-fetched for me to take seriously. People around here too often confound theory with practice. That all this might be physically possible does not prove that it is at all likely.

Comment author: dougclow 29 April 2014 07:54:06PM *  2 points [-]

Do you believe that if Obama were to ask the NSA to take over Russia, that the NSA could easily do so?

No. I think the phrase "take over" is describing two very different scenarios if we compare "Obama trying to take over the world" and "a hypothetical hostile AI trying to take over the world". Obama has many human scruples and cares a lot about continued human survival, and specifically not just about the continued existence of the people of the USA but that they thrive. (Thankfully!)

I entirely agree that killing huge numbers of people would be a stupid thing for the actual NSA and/or Obama to do. Killing all the people, themselves included, would not only fail to achieve any of their goals but thwart (almost) all of them permanently. I was treating it as part of the premises of the discussion that the AI is at least indifferent to doing so: it needs only enough infrastructure left for it to continue to exist and be able to rebuild under its own total control.

a long-term plan. But those are very risky. The longer it takes, the higher the chance that your plan is revealed.

Yes, indeed, the longer it takes the higher the chance that the plan is revealed. But a different plan may take longer but still have a lower overall chance of failure if its risk of discovery per unit time is substantially lower. Depending on the circumstances, one can imagine an AI calculating that its best interests lie in a plan that takes a very long time but has a very low risk of discovery before success. We need not impute impatience or hyperbolic discounting to the AI.

But here I'll grant we are well adrift in to groundless and fruitless speculation: we don't and can't have anything like the information needed to guess at what strategy would look best.

Anyway, the assumption that an AI could understand human motivation, and become a skilled manipulator, is already too far-fetched for me to take seriously.

I wouldn't say I'm taking the idea seriously either - more taking it for a ride. I share much of your skepticism here. I don't think we can say that it's impossible to make an AI with advanced social intelligence, but I think we can say that it is very unlikely to be achievable in the near to medium term.

This is a separate question from the one asked in the OP, though.

Comment author: XiXiDu 28 April 2014 08:40:14AM 3 points [-]

For a fully-capable sophisticated AGI, the question is surely trivial and admits of many, many possible answers.

Could the NSA, the security agency of the most powerful country on Earth, implement any of these schemes?

The NSA not only has thousands of very smart drones (people), all of which are already equipped with manipulative abilities, but it also has huge computational resources and knows about backdoors to subvert a lot of systems. Does this enable the NSA to implement your plan without destroying or decisively crippling itself?

If not, then the following features are very likely insufficient in order to implement your plan: (1) being in control of thousands of human-level drones, straw men, and undercover agents in important positions (2) having the law on your side (3) access to massive computational resources (4) knowledge of heaps of loopholes to bypass security.

If your plan cannot be implemented by an entity like the NSA, which already features most of the prerequisites that your hypothetical artificial general intelligence first needs to acquire by some magical means, then what is it that makes your plan so foolproof when executed by an AI?

Comment author: dougclow 28 April 2014 10:03:17AM 4 points [-]

Could the NSA, the security agency of the most powerful country on Earth, implement any of these schemes?

Er, yes, very easily.

Gaining effective control of the NSA would be one route to the AI taking over. Through, for example, subtle man-in-the-middle attacks on communications and records to change the scope of projects over time, steathily inserting its own code, subtle manipulation of individuals, or even straight-up bribery or blackmail. The David Petraeus incident suggests op sec practice at the highest levels is surprisingly weak. (He had an illicit affair when he was Director of the CIA, which was stumbled on by the FBI in the course of a different investigation as a result of his insecure email practices.)

We've fairly-recently found out that the NSA was carrying out a massive operation that very few outsiders even suspected - including most specialists in the field - and that very many consider to be actively hostile to the interests of humanity in general. It involved deploying vast quantities of computing resources and hijacking those of almost all other large owners of computing resources. I don't for a moment believe that this was an AI takeover plan, but it proves that such an operation is possible.

That the NSA has the capability to carry out such a task (though, mercifully, not the motivation) seems obvious to me. For instance, some of the examples posted elsewhere in the comments to this post could easily be carried out by the NSA if it wanted to. But I'm guessing it seems obvious to you that it does not have this capability, or you wouldn't have asked this question. So I've reduced my estimate of how obvious this is significantly, and marginally reduced my confidence in the base belief.

Alas, I'm not sure we can get much further in resolving the disagreement without getting specific about precise and detailed example scenarios, which I am very reluctant to do, for the reasons mentioned above. any many besides. (It hardly lives up to the standards of responsible disclosure of vulnerabilities.)

your hypothetical artificial general intelligence

It's not mine. :-) I am skeptical of this premise - certainly in the near term.

Comment author: dougclow 28 April 2014 07:47:24AM 12 points [-]

Another class of routes is for the AI to obtain the resources entirely legitimately, through e.g. running a very successful business where extra intelligence adds significant value. For instance, it's fun to imagine that Larry Page and Sergey Brin's first success was not a better search algorithm, but building and/or stumbling on an AI that invented it (and a successful business model) for them; Google now controls a very large proportion of the world's computing resources. Similarly, if a bit more prosaically, Walmart in the US and Tesco in the UK have grown extremely large, successful businesses based on the smart use of computing resources. For a more directly terrifying scenario, imagine it happening at, say, Lockheed Martin, BAE Systems or Raytheon.

These are not quick, instant takeovers, but I think it is a mistake to imagine that it must happen instantly. An AI that thinks it will be destroyed (or permanently thwarted) if it is discovered would take care to avoid discovery. Scenarios where it can be careful to minimise the risk of discovery until its position is unassailable will look much more appealing than high-risk short-term scenarios with high variance in outcomes. Indeed, it might sensibly seek to build its position in the minds of people-in-general as an invaluable resource for humanity well before its full nature is revealed.

View more: Prev | Next