Talkie-1930, an AI with 13B parameters trained on 260B tokens before 1931. It tests generalization by preventing data pollution. The model that suggests railways during a financial crisis doesn't k...