In the experiments, content words are replaced by invented tokens while grammatical structure is preserved. A human reader sees gibberish. The model, however, often reconstructs the original meaning ...