I think a very important application of AI safety ideas is self driving cars. This is a domain where traditional AI methods aren't straightforwardly applied. You can't merely have an algorithm take in input and predict what a human would do. Otherwise it will just drive like it predicts a human would. You can't have it get in accidents, so training data is limited.