Every second week LLM space is hit by a major announcement of new models and improved AI capabilities. Given this breakneck progress, do we need a layer of LLM orchestration tools? I argue that the answer is yes, and I'll use Bosquet - an LLM tooling library - to illustrate my point. I will show that going beyond simple LLM apps you will need support for complex promoting and workflows, model swapping, memory management, and similar functionality offered by LLM tools like Bosquet.
13 сен 2024