@cyrano@lemmy.dbzer0.com to United States | News & Politics@midwest.social • 2 months agoProposed bill to make it a crime to download DeepSeek in the USwww.congress.govmessage-square48fedilinkarrow-up1239arrow-down17
arrow-up1232arrow-down1external-linkProposed bill to make it a crime to download DeepSeek in the USwww.congress.gov@cyrano@lemmy.dbzer0.com to United States | News & Politics@midwest.social • 2 months agomessage-square48fedilink
minus-squaretrevor (he/they)linkfedilinkEnglish2•2 months agoNo worries. I’ve got some 20TB drives i can throw these on 😁 Now, running a model that large… Well, I’ll just have to stick with the 8-13b params.
minus-squarePup BirulinkfedilinkEnglish1•2 months agoyou can actually run the model, but it just goes very slowly… i run the 70b model on my m1 mbp, and it technically “requires” 128gb or VRAM - it still runs, just not super fast (though i’d say it’s useable in this case a about 1 word per ~300ms)
No worries. I’ve got some 20TB drives i can throw these on 😁
Now, running a model that large… Well, I’ll just have to stick with the 8-13b params.
you can actually run the model, but it just goes very slowly… i run the 70b model on my m1 mbp, and it technically “requires” 128gb or VRAM - it still runs, just not super fast (though i’d say it’s useable in this case a about 1 word per ~300ms)