Стикер
you can run codellama locally if you’ve got the hardware but it ain’t as good rn
actually they just launched codellama 70b today
70b param models need a *big* GPU lol
considering 7b runs on a phone somewhat,
Ram primarily
Got 32 gigs and 4070 ti
i really don’t know too much about it but does it swap between system mem and GPU mem?
vRAM not RAM
so can I run mistral 7B on 4GB ram?
how big? I think I have 12 GBs of 4070 ti
Ended up running tabby
Обсуждают сегодня