Running Modern LLMs on a 2GB GPU

6 pointsposted 6 hours ago
by comtom

2 Comments

user

6 hours ago

[deleted]

MitkoStoyanov

5 hours ago

I've got boxes of mismatched old parts rather than one built machine — any rule of thumb for what's worth assembling vs. what's too old to bother with for this kind of use case?