New ask Hacker News story: Ask HN: Browser-UI with multi-LLM for the team?
Ask HN: Browser-UI with multi-LLM for the team?
2 by tobwen | 2 comments on Hacker News.
I'm looking to provide our 4-person team access to various LLMs, including OpenAI, Anthropic, Meta's Llama, and some others. I want to have browser-based UI (like ChatGPT) to upload files, get Markdown-reponses and have price control to avoid unexpected high costs at the end of the month. My current plan is to purchase API keys from different LLM providers and use LiteLLM as a proxy to setup cost limits OR to use OpenRouter.ai (potentially still using LiteLLM). LibreChat currently doesn't support "passing through" uploads, but this feature is expected to be implemented this week: https://ift.tt/m7gsqn6 My Questions: 1. Is my approach using LiteLLM or OpenRouter with a UI a viable solution? I believe this could be more cost-effective than purchasing monthly chat accounts for each of the four users. 2. Are there other UIs similar to ChatGPT and Anthropic's interfaces, for the case that the new LibreChat attachment feature is too instable? Update: It would be great to run a self-hosted open source stack.
2 by tobwen | 2 comments on Hacker News.
I'm looking to provide our 4-person team access to various LLMs, including OpenAI, Anthropic, Meta's Llama, and some others. I want to have browser-based UI (like ChatGPT) to upload files, get Markdown-reponses and have price control to avoid unexpected high costs at the end of the month. My current plan is to purchase API keys from different LLM providers and use LiteLLM as a proxy to setup cost limits OR to use OpenRouter.ai (potentially still using LiteLLM). LibreChat currently doesn't support "passing through" uploads, but this feature is expected to be implemented this week: https://ift.tt/m7gsqn6 My Questions: 1. Is my approach using LiteLLM or OpenRouter with a UI a viable solution? I believe this could be more cost-effective than purchasing monthly chat accounts for each of the four users. 2. Are there other UIs similar to ChatGPT and Anthropic's interfaces, for the case that the new LibreChat attachment feature is too instable? Update: It would be great to run a self-hosted open source stack.
Comments
Post a Comment