Better algorithms maybe are known to exist, but these itself can't ultimately be selected by an algorithm, as you would have an infinite regress of picking algorithms then.

This is fallacious.

Correct conclusion: you would then have a 1-step regress of picking algorithms.

Watch that slippery slope.