New ask Hacker News story: Locally hosted LLM use cases?
Locally hosted LLM use cases?
2 by donji | 1 comments on Hacker News.
I’m curious what interesting use cases people on here have thought of for locally hosted llms. I’m also curious what form factor will need to be supported to make you use case. I think because of the large amount of ram that’s needed, something phone sized could not be that useful. But I could be wrong, maybe there is a use case for a really dumb small model that can be used to great effect. Thoughts?!
2 by donji | 1 comments on Hacker News.
I’m curious what interesting use cases people on here have thought of for locally hosted llms. I’m also curious what form factor will need to be supported to make you use case. I think because of the large amount of ram that’s needed, something phone sized could not be that useful. But I could be wrong, maybe there is a use case for a really dumb small model that can be used to great effect. Thoughts?!
Comments
Post a Comment