Not training data but fine-tuning explains formal stuckness on rhyme in LLMs
Continued from LLM-generated verse is formally stuck on rhyme and regular meter.
I investigate whether training data can explain this effect, and find some evidence that it cannot. Instead, I find that “instruction-tuning” and Reinforcement Learning Human Feedback—designed to produce “helpful” chatbots—may instill conservative, “idealizing” aesthetic tendencies in the models.


Finally, I speculate whether generative AI secretly encodes an aesthetics of its own—as if internalizing Cicero’s goals for art to “delight” & “instruct” to an obsessive, historically unprecedented degree. I propose “generative formalism” as a method for studying this hyper-historical aesthetics.
Most of all, I recommend you check out all the incredible articles in this special issue (culturalanalytics.org/issue/12788), with work by Tess McNulty, Laura Chapot, @jeddobson.bsky.social, Alexandre Miller et al, and @katelelkins.bsky.social.
Part of Generative Formalism.
Originally posted on Bluesky.