We built this framework to manage increasingly complex prompts and tool calls for LLM conversations with hot swappable models. We implement this framework for our AI engineering platform at enginelabs.ai.

It allows us to guardrail and extend LLMs for different software stacks with varying degrees of restriction in a relatively clean and manageable way.

We're interested to see if this framework is useful in other applications or for custom software development configurations.