= 27d567bc2d48d9f40e9ccc20ea370b15)
skeptical_lurker comments on SRG 4: Biological Cognition, BCIs, Organizations - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (139)
I disagree. By analogy, understanding of agriculture has increased greatly without the creation of an artificial photosynthetic cell. And yes, I know that photovoltic panels exist, but only a long time later.
Do you mind spelling out the analogy? (including where it breaks) I didn't get it.
Reading my comment I feel compelled to clarify what I meant:
Katja asked: in which worlds should we worry about what 'intelligence' designates not being what we think it does?
I responded: in all the worlds where increasing our understanding of 'intelligence' has the side effect of increasing attempts to create it - due to feasibility, curiosity, or an urge for power. In these worlds, expanding our knowledge increases the expected risk, because of the side effects.
Whether intelligence is or not what we thought will only be found after the expected risk increased, then we find out the fact, and the risk either skyrockets or plummets. In hindsight, if it plummets, having learned more would look great. In hindsight, if it skyrockets, we are likely dead.