New ask Hacker News story: Ask HN: GPT-4 has 1.7T parameters. What's a parameter?
Ask HN: GPT-4 has 1.7T parameters. What's a parameter?
6 by herodoturtle | 3 comments on Hacker News.
Hi folks, AI newbie here. Can those of you that are well versed in AI please help me understand what exactly constitutes a parameter? I often see LLMs being compared / ranked based on their number of parameters, so I'm hoping to better understand this metric. I have a rudimentary understanding of artificial neural networks (in terms of inputs -> functions -> outputs), and by extension, a very basic understanding of deep learning. But when it comes to defining a parameter, my google searches thus far have led me to concepts such as 'AI model behaviour' and 'adjustable settings' which, whilst interesting, are still too complex for me to distil into simple terms. If I were to explain what a parameter is to my child, what might I say? Thanks!
6 by herodoturtle | 3 comments on Hacker News.
Hi folks, AI newbie here. Can those of you that are well versed in AI please help me understand what exactly constitutes a parameter? I often see LLMs being compared / ranked based on their number of parameters, so I'm hoping to better understand this metric. I have a rudimentary understanding of artificial neural networks (in terms of inputs -> functions -> outputs), and by extension, a very basic understanding of deep learning. But when it comes to defining a parameter, my google searches thus far have led me to concepts such as 'AI model behaviour' and 'adjustable settings' which, whilst interesting, are still too complex for me to distil into simple terms. If I were to explain what a parameter is to my child, what might I say? Thanks!
Comments
Post a Comment