LLM training data mixture optimization breaks when training pools shift — every prior proxy experiment becomes stale.
Present-day LLMs, such as ChatGPT and Claude, can perform complex tasks, such as writing poetry and solving difficult algebra ...