New ask Hacker News story: Ask HN: Browser-Based LLM Models?

Ask HN: Browser-Based LLM Models?
3 by lulzury | 2 comments on Hacker News.
Does anyone know if there are there any plans for browsers to natively integrate LLMs, LLM APIs, or LLM models like Llama for local use by web applications? I feel there's a large opportunity here for a more privacy-friendly, on-device solution that doesn't send the user's data to OpenAI. Is RAM the current main limitation?

Comments