New ask Hacker News story: Ask HN: AWS g6 instances loading into VRAM slowly?
Ask HN: AWS g6 instances loading into VRAM slowly?
2 by teaearlgraycold | 0 comments on Hacker News.
I'm curious if anyone here would know what the bottleneck is when loading data into VRAM from CPU RAM on AWS. Myself and my teammates are seeing surprisingly slow load times for models. Our local training hardware doesn't have this issue. Would GCP be faster?
2 by teaearlgraycold | 0 comments on Hacker News.
I'm curious if anyone here would know what the bottleneck is when loading data into VRAM from CPU RAM on AWS. Myself and my teammates are seeing surprisingly slow load times for models. Our local training hardware doesn't have this issue. Would GCP be faster?
Comments
Post a Comment