Tweet

Replying to @gfodor

My bet is on opportunity cost. It makes me think of https://fabien.benetou.fr/ReadingNotes/Epistemetrics namely can we assume infinite linear growth or is it becoming a sigmoid that flattens regardless of the amount of resources, both compute and novel datasets left to train on, thrown at the problem.

(original)