jasp81

I think that the "most" in the sentence "most philosophers and AI people do think that neurol networks can be conscious if they run the right algorithm" is an overstatement, though I do not know to what extent. 

I have no strong view on that, primarly because I think I lack some deep ML knowledge (I would weigh far more the view of ML experts than the view of philosophers on this topic). 

Anyway, even accepting that neural networks can be conscious with the right algorithm, I think I disagree about "the fact that it's a language model doesn't seem relevant". In a LLM language is not only the final layer, you have also... (read more)

Thank you, 

I agree with your reasoning strictly logically speaking, but it seems to me that a LLM cannot be sentient or have thoughts, even theoritically, and the burden of proof seems strongly on the side of someone who would made opposite claims.

And for someone who do not know what is a LLM, it is of course easy to anthropomorphize the LLM for obvious reasons (it can be designed to sound sentient or to express 'thoughts'), and it is my feeling that this post was a little bit about that.

Overall, I find the arguments that I received after my first comment more convincing in making me feel what could be the problem, than... (read more)

Thank you for your answers.

Unfortunately I have to say that it did not help me so far to have a stronger feeling about ai safety.

(I feel very sympathetic with this post for example https://forum.effectivealtruism.org/posts/ST3JjsLdTBnaK46BD/how-i-failed-to-form-views-on-ai-safety-3 )

To rephrase,  my prior is that LLM just predict next words (it is their only capability). I would be worried when a LLM does something else (though I think it cannot happen), that would be what I would call "misalignment".

On the meantime , what I read a lot about people worrying about ChatGPT/Bing sounds just like anthropomorphizing the AI with the prior that it can be sentient, have "intents"   / and to me it is just not... (read more)

I am new to this website. I am also not a english native speaker so pardon me in advance. I am very sorry if it is considered as rude on this forum to not starting by a post for introducing ourselves.

I am here because I am curious about the AI safety thing, and I do have a (light) ML background (though more in my studies than in my job). I have read this forum and adjacent ones for some weeks now but despite all the posts I read I have failed so far to have a strong opinion on p(doom). It is quite frustrating to be honest and I would like to have one.

I... (read more)