All of Olivier Coutu's Comments + Replies

Charlie is correct in saying that GPT-4 does not actively learn based on its input. But a related question is whether we are missing key technical insights for AGI, and Stampy has an answer for that. He also has an answer explaining scaling laws.

These are interesting questions that modern philosophers have been pondering. Stampy has an answer on forcing people to change faster than they would like and we are working on adding more answers that attempt to guess what an (aligned) superintelligence might do.

These are great questions! Stampy does not currently have an answer for the first one, but its answer on prosaic alignment could get you started on ways that some people think might work without needing additional breakthroughs.

Regarding the second question, the plan seems to be to use less powerful AIs to align more powerful AIs and the hope would be that these helper AIs would not be powerful enough for misalignment to be an issue.

These question-answering AIs are often called Oracles, you can find some info on them here. Their cousin tool AI is also relevant here. You'll discover that they are probably safer but by no means entirely safe.

We are working on an answer for the safety of Oracles for Stampy, keep your eyes peeled it should show up soon.

I feel like the adjective "accidentally" still makes sense to convey "not on purpose", and the "naked on the porch" situation is a good example of that. This distinction can be made regardless of the level of blame (or here shame) that should be inflicted. I don't feel like this applies to the noun "accident" and I doubt that the radio hosts would have called this "an accident where a man was locked outside naked".

Regarding the kid, I agree with you that it suggests "I should be blamed less (or not at all)" and the level of blame should somewhat depend on ... (read more)

In the field of road safety, the term "accident" is being depreciated. My understanding is that "It was an accident" suggests "It wasn't done on purpose, I didn't see it coming and I shouldn't be blamed for it", as a child would say to a parent after breaking a vase through negligence. In my mind, people get blamed for failures, not accidents, and your example sentences suggest someone attempting to dodge the responsibility for their actions.

With this framing, I can't currently think of an event that I would label "an accident", although "an accidental col... (read more)

2Steven Byrnes
As a datapoint, I was listening to the radio during the 2-minute drive back from preschool drop-off this morning—a station with music & casual / humorous chat. They used the word “accidentally” once, to report a story where somebody’s 20yo kid accidentally locked themselves outside on the porch naked, and then a neighbor called the police. Despite using the word “accidentally”, the radio hosts were very much treating the kid as a blameworthy idiot and were laughing at his expense. For your example: When the kid breaks the vase and says “but it was an accident!”, I interpret that as conveying the relevant information that it wasn’t intentional. That’s not a claim “I shouldn’t be blamed for it” as you say; rather it is a claim “I should be blamed for it much less than if it had been intentional, and plausibly not at all depending on the circumstances.” Then if the parents responded to the kid: “No, you’re lying, that wasn’t an accident”, I think everyone would interpret that statement as the parents’ making a counter-claim that it was in fact intentional. Right? More likely, after the kid says “but it was an accident!”, the parents would reply “Well you should have been more careful!”, thus tacitly conceding the claim that it was an accident. Right? Another example on my side is the fact that wikipedia calls it the Three Mile Island Accident, and Jimmy Carter called it that too (cf. “President's Commission on the Accident at Three Mile Island”), but I don’t think that anyone takes that name to be a bold and contentious claim that nobody should be blamed for it. The commission’s report definitely assigned lots of blame. If Jimmy Carter had called it the “President’s Commission on the Surprise Unforeseeable Failure at Three Mile Island”, people would have been up in arms about that, I think! I concede that the forbes article you link supports your claim: they write “The word “accident” suggests no-one is to blame for a crash.” I feel like my life experience outweig