Comment author: Houshalter 29 August 2015 07:54:03PM *  0 points [-]

I'm very confused. Of course if φ is provable then it's true. That's the whole point of using proofs.

Comment author: RolfAndreassen 31 August 2015 05:30:37AM 0 points [-]

Yes, but it may be true without being provable.

Comment author: Houshalter 26 August 2015 06:31:34AM *  1 point [-]

I'm very confused about something related to the Halting Problem. I discussed this on the IRC with some people, but I couldn't get across what I meant very well. So I wrote up something a bit longer and a bit more formal.

The gist of it is, the halting problem lets us prove that, for a specific counter example, there can not exist any proof that it halts or not. A proof that it does or does not halt, causes a paradox.

But if it's true that there doesn't exist a proof that it halts, then it will run forever searching for one. Therefore I've proved that the program will not halt. Therefore a proof that it doesn't halt does exist (this one), and it will eventually find it. Creating a paradox.

Just calling the problem undecidable doesn't actually solve anything. If you can prove it's undecidable, it creates the same paradox. If no Turing machine can know whether or not a program halts, and we are also Turing machines, then we can't know either.

Comment author: RolfAndreassen 31 August 2015 05:30:20AM 0 points [-]

But if it's true that there doesn't exist a proof that it halts, then it will run forever searching for one.

No; provable and true are not the same thing. It may be the case that the program halts, but it is nevertheless impossible to prove that it halts except by "run it and see", which doesn't count.

Comment author: Stuart_Armstrong 26 August 2015 01:46:59PM 0 points [-]

I have to be honest: I hadn't considered that angle yet (I tend to create ideas first, then hone them and remove issues).

The first point is that this was just an example, the first one to occur to me, and we can certainly find safer examples or improve this one.

The second is that torture is very unlikely - death, maybe painful death, but not deliberate torture.

The third is that I know some people who might be willing to go through with this, if it cured cancer through the world.

But I will have to be more careful in these issues in future, thanks.

Comment author: RolfAndreassen 31 August 2015 04:08:46AM 1 point [-]

I admit I was using the word 'torture' rather loosely. However, unless the AI is explicitly instructed to use anesthesia before any cutting is done, I think we can safely replace it with "extended periods of very intense pain".

As a first pass at a way of safely boxing an AI, though, it's not bad at all. Please continue to develop the idea.

Comment author: RolfAndreassen 26 August 2015 04:39:36AM 6 points [-]

If the excellent simulation of a human with cancer is conscious, you've created a very good torture chamber, complete with mad vivisectionist AI.

Comment author: shminux 16 August 2015 04:44:05PM 0 points [-]

Do you still get to do some science?

Comment author: RolfAndreassen 19 August 2015 06:37:54AM 0 points [-]

I sold out to the Dark Side in 2014. This was a move between industry jobs. But, actually, the new one is somewhat more in the direction of data-gathering than the old one was.

Comment author: SolveIt 04 August 2015 01:05:43PM 3 points [-]

I think the point of the quote is that in the first case you have five methods you can use to attack different problems. In the second case you only have one method, and you have to hope every problem is a nail.

Comment author: RolfAndreassen 06 August 2015 04:39:19AM 2 points [-]

Nu, but a method that has already been used on five problems seems to be pretty good at converting problems into nails. :)

Comment author: Sarunas 03 August 2015 01:39:35PM *  7 points [-]

It is better to solve one problem five different ways, than to solve five problems one way

George Pólya, or at least attributed to him, as I am unable to find the exact source, despite its being widely quoted in texts related to mathematics education or problem solving in general.

Comment author: RolfAndreassen 04 August 2015 04:56:46AM 1 point [-]

Not sure that generalises outside of math. Is it really better to solve one problem really, really thoroughly, than to have a good-enough fix for five? Depends on the problems, perhaps - but without knowing anything else, I'd rather solve five than one.

Comment author: Jiro 14 July 2015 09:44:42PM 0 points [-]

That assertion isn't actually true, in the strong form in which he intends it. Even if you rely on the vagueness of "morals", it's certainly not true for legislation.

Comment author: RolfAndreassen 03 August 2015 02:12:30AM 2 points [-]

Bentham is using Enlightenment shorthand; he means "good, just, natural-law-following legislation". He's not talking about the actual sausages that we get from real legislatures.

Comment author: RolfAndreassen 02 August 2015 05:39:42AM 16 points [-]

I got a new job! Which pays better than the old one.

Comment author: redding 28 July 2015 12:20:02PM 1 point [-]

There are different levels of impossible.

Imagine a universe with an infinite number of identical rooms, each of which contains a single human. Each room is numbered outside: 1, 2, 3, ...

The probability of you being in the first 100 rooms is 0 - if you ever have to make an expected utility calculation, you shouldn't even consider that chance. On the other hand, it is definitely possible in the sense that some people are in those first 100 rooms.

If you consider the probability of you being in room Q, this probability is also 0. However, it (intuitively) feels "more" impossible.

I don't really think this line of thought leads anywhere interesting, but it definitely violated my intuitions.

Comment author: RolfAndreassen 29 July 2015 02:15:28AM 3 points [-]

I opine that you are equivocating between "tends to zero as N tends to infinity" and "is zero". This is usually a very bad idea.

View more: Prev | Next