I've sort of accepted the gimmick of LLMs being a bit of a plateau in training. It has always been that we teach AI to learn, but currently the public has been exposed to what they perceive to be magic and that's "good enough". Like, being wrong so often due to bad information, bad interpretation of information, and bias within information is acceptable now, apparently. So teaching to learn isn't a high mainstream priority compared to throwing in mass information instead—it's far less exciting working on infrastructure.

But here's the cool thing about AI, it's pretty fucking easy to learn. If you have patience and creativity to put toward training, you can do what you want. Give it a crack! But always be working on refining it. I'm sure out there right now someone's been inspired enough to do what you're talking about and in a few years of tears and insane electricity bills, there'll be a viable model.