All of astralbrane's Comments + Replies

Aren't attention networks and MLPs both subsets of feedforward networks already?  What you really mean is "Attention can implement fully-connected MLPs"?

1Robert_AIZI
Calling fully-connected MLPs "feedforward networks" is common (e.g. in the original transformer paper https://arxiv.org/pdf/1706.03762.pdf), so I tried to use that language here for the sake of the transformer-background people. But yes, I think "Attention can implement fully-connected MLPs" is a correct and arguably more accurate way to describe this.

Do you really think AdeptAI, DeepMind, OpenAI, and Microsoft are the AIs to worry about?  I'm more worried about what nation-states are doing behind closed doors.  We know about China's Wu Dao, for instance; what else are they working on?  If the NRO had Sentient in 2012, what do they have now?

The Chinese government has a bigger hacking program than any other nation in the world. And their AI program is not constrained by the rule of law and is built on top of massive troves of intellectual property and sensitive data that they've stolen ove

... (read more)
1ErickBall
If the NRO had Sentient in 2012 then it wasn't even a deep learning system. Probably they have something now that's built from transformers (I know other government agencies are working on things like this for their own domain specific purposes). But it's got to be pretty far behind the commercial state of the art, because government agencies don't have the in house expertise or the budget flexibility to move quickly on large scale basic research.

"do whatever the majority says" is not democracy.

True democracy finds the solution that maximizes the utility of all the voters, not maximizing the utility of half while completely ignoring the other half.

-1jeronimo196
As do true communism. Has there ever been such a democracy? How did it found out the utility for all its voters? Sounds to me like a "no true Scotsman" encompassing all known government systems. I think you should modify your statement to something like "A democracy should try and protect the interests of its minorities, as well as those of the majority."