It seem to me like to make major contributions to human knowledge you need to do a lot more than say: "Hey PCA is really great". You actually have to understand reasons of why people aren't using it and fixing those reasons.
Have you read my speed dating project posts? I haven't yet written up the most important one on demographics (I can do that soon, just many conflicting priorities), but the one on individual variation in revealed preferences for attractiveness vs intelligence and sincerity starts to get at what I'm talking about.
My project gives a proof of concept for what I'm talking about in the context of social psychology. I've never seen such an application. So no, it's not just the realization that it could be applied, it's also giving a proof of concept: that's why it took ~1500 hours rather than ~10 hours.
As far as I can tell, the situation is simply that deep knowledge of the technique hasn't yet percolated into the social psychology community, and people who do have the relevant background knowledge haven't actually tried doing social psychology research. All you need is to notice something that's been missed. There are many such things (see Peter Thiel's discussion of how there are still secrets in his book "From Zero To One.")
If I recall correctly, Freeman Dyson has indicated that his demonstration of the equivalence of the two different formulations of quantum electrodynamics isn't as amazing as people believe, but was largely a function of him being one of the first people to learn both formulations! :-)
So I'd strongly encourage you to pursue your ideas more. I've been looking some at the General Social Survey data, where I haven't yet found something highly nontrivial (maybe I'm looking at the data the wrong way, or maybe it's just not a good dataset for this). I'd be happy to share my code with you / a cleaned form of the data, if you're interested in exploring factors for political labels.
It might be that I have gotten to cynic but if you measure 6 variables it's more likely that one of them get a statistical significant result then if you first turn those 6 variables into 2 variables via PCA.
My project gives a proof of concept for what I'm talking about in the context of social psychology. I've never seen such an application. So no, it's not just the realization that it could be applied, it's also giving a proof of concept: that's why it took ~1500 hours rather than ~10 hours.
That probably where there's something I don't understand. I ...
tl;dr: If you struggle with motivational problems, it's likely that the problem is not intrinsic to you, but instead that you haven't yet found work that you find very interesting.
How I discovered how to do great work
Last winter I did something that I had never done before. I spent ~1500 hours working on genuinely original scientific research.
I had done research for my PhD in pure math, but faced squarely, the problems that I worked on were of very little interest to anyone outside of the fields, and I was not very engaged with my research. Pure math is very heavily stacked with talent, and the low hanging fruit has been plucked, so unless you're one of the most talented people in the world, your prospects for doing anything other than derivative work are very poor.
What I did last fall was entirely different. As I trained to be a data scientist, I found that there's far more low hanging fruit in the field than there is in pure math, and found myself working on novel problems that are of broad interest almost immediately.
Having very high intrinsic motivation made a huge difference. I found myself spending all waking hours (~90 hours / week) working on it obsessively, almost involuntarily. Once I emerged, I realized that what I had done over the past ~3.5 months was far more significant than all of the other work that I had done over the span of my entire life combined. I was astonished to find myself having ascended to the pantheon of those who have made major contributions to human knowledge, something that I hadn't imagined possible in my wildest dreams.
The problem isn't "laziness"
Many of the most interesting people who I know are achieving at a level far below their potential. They often have major procrastination problems, and believe this to correspond to them having a character flaw of "laziness". I've become convinced that these people's problems don't come from them being insufficiently disciplined.
Their problems come from them spending their time trying to do work that they find boring. If you find your work boring, it's very likely that you should be doing something else.
References
My position is not unique to me: it's common to extremely high functioning people.
[1] Steve Jobs created Apple, which owns ~0.1%+ of the world's wealth. In his 2005 Stanford commencement address he said:
[2] Bill Thurston is one of the greatest mathematicians of the 20th century. He formulated the geometrization conjecture, which subsumes the 100 year old Poincare conjecture, considered one of the ~7 most important unsolved problems. He describes his own character as follows:
[3] Scott Alexander / Yvain is widely regarded as a great writer. Political celebrity Ezra Klein characterized his blog as fantastic. Scott wrote:
[4] Paul Graham is the co-founder of Y-Combinator, a seed funder with a portfolio of combined value exceeding $30 billion (with investees including Dropbox, AirBnB and Stripe). In What You'll Wish You Had Known he wrote