New ask Hacker News story: Ask HN: Why isn’t it possible to train LLMs on idle resource like SETI home?
Ask HN: Why isn’t it possible to train LLMs on idle resource like SETI home?
4 by uptownfunk | 0 comments on Hacker News.
What makes using volunteer compute resource not practical for training large scale LLMs. Something similar to the SETI@home project or the Mersenne prime number search which enabled users to effectively pool available compute resource together to solve some large problem. It seems like compute resources are quickly becoming a bottleneck and moat preventing ML researchers to train and use LLM type language models. Would be great to see a more publicly available solution to this, to break down the dam so to speak and give everyone access to SOTA LLMs
4 by uptownfunk | 0 comments on Hacker News.
What makes using volunteer compute resource not practical for training large scale LLMs. Something similar to the SETI@home project or the Mersenne prime number search which enabled users to effectively pool available compute resource together to solve some large problem. It seems like compute resources are quickly becoming a bottleneck and moat preventing ML researchers to train and use LLM type language models. Would be great to see a more publicly available solution to this, to break down the dam so to speak and give everyone access to SOTA LLMs
Comments
Post a Comment