Use massive test-time compute to improve the test-time algorithm.
If test-time scaling right now is only bound by computation, then OpenAI could potentially invest billions, or even tens of billions, in test-time computation for a very specific purpose - solving test-time algorithm problem, e.g. improve CoT search. In another sentence, while improving efficiency is important, we just need it to be efficient enough to be able to run it on a huge cluster disregarding the test-time cost, then we can use that extremely expensive but very smart intelligence to i... (read more)
Use massive test-time compute to improve the test-time algorithm.
If test-time scaling right now is only bound by computation, then OpenAI could potentially invest billions, or even tens of billions, in test-time computation for a very specific purpose - solving test-time algorithm problem, e.g. improve CoT search. In another sentence, while improving efficiency is important, we just need it to be efficient enough to be able to run it on a huge cluster disregarding the test-time cost, then we can use that extremely expensive but very smart intelligence to i... (read more)