💭 text rot by having a basemodel infill random snips of a text. Too bad I haven't seen infill text since gpt3.