= 27d567bc2d48d9f40e9ccc20ea370b15)
zslastman comments on Request for Advice : A.I. - can I make myself useful? - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (34)
Norman Borlaug is the poster child of how to use genetic manipulation for large-scale impact as an individual, so I don't think your degree is pointed in the wrong direction. But it is the nature of established institutions to fail at revolutionary thinking, so a survey of the 'heavyweights' in your field will tend to be disappointing.
We have only crappy guesses about the completion date for the AGI project, and the success of FAI in particular is contingent on how well our civilization runs in the interim. For example, wartime research might involve risky choices in AGI development, because they have a more urgent need for rapid deployment- an arms race for the 'first' AGI would be terrible for our chances of FAI. Genomics won't help us build a mind, but it can help foster an environment where that research is more likely to go well (see Borlaug again). You might, say, investigate the regulatory networks surrounding genes correlated with sociability or IQ.
Do you believe that you can reliably distinguish 'problems that cannot be solved by humans' from 'problems that humans could solve in principle but haven't yet'? Personally, I'm very bad at this, especially when the solutions involve unexpected lateral thinking. While I do agree that AGI is more or less the last human invention, I doubt that it's the next one- we haven't run out of other things to invent, and I'd be surprised if that was the case in the narrower area of genomics.
It's probably worth pointing out that you are at the exact stage in your PhD that is most known for general burnout. This looks suspiciously like such an event, with an atypical LW filter. So, this: "I think a large part of my lack of enthusiasm comes from my belief that advances in artificial intelligence..." is likely to be false, since many of your colleagues are experiencing similar feelings at a similar time.
I don't mean to come across as super optimistic with respect to strong A.I., or even A.I. in general. I should have written '50 years give or take 50'. It's just that i think my field's progress rate is determined by the inflow of methods from other fields, and that the current problems it faces are insoluble using current ones. I think people who aren't immersed in the field get a mistaken impression about this because papers and press releases must communicate an artificial sense of progress and certainty to succeed. Word in the trenches is that we're mired in an intractable mess of unknowns.
As an example - take Aubrey de Grey's SENS program. He lays out all these alterations he thinks he can make to fix the problem of aging. But he seems to think of biology as modular and easily mutable. A biologist expects each individual step he proposes to face dozens of unforeseen problems, and to have many, many unpredictable knock-on effects, over a wide range of detectability and severity. Dealing with them all isn't doable right now, while single grad students take 5 year to determine a few of each genes many interactions and functions.
As for burnout - I'd agree with you if this was a recent development. But I've felt this way for years. It's just that now action is required. It's possible I've been burnt out for years. This has been suggested to me - my working environment is exceptionally poor - which is something I can say semi-objectively due to the number of people who have quit and/or echoed my feelings on the matter. I'm trying not to let those feelings influence me too much however.