New ask Hacker News story: Apple adds matmul acceleration to A19 Pro GPU
Apple adds matmul acceleration to A19 Pro GPU
6 by aurareturn | 0 comments on Hacker News.
It's equivalent to Tensor cores from Nvidia. This means prompt processing will get a significant boost on Apple devices, making local LLMs far more viable on future Macs (as soon as M5).
6 by aurareturn | 0 comments on Hacker News.
It's equivalent to Tensor cores from Nvidia. This means prompt processing will get a significant boost on Apple devices, making local LLMs far more viable on future Macs (as soon as M5).
Comments
Post a Comment