QuantumSpecter@lemmy.world to Technology@lemmy.worldEnglish · 2 months agoOpenAI boss and Elon Musk back calls to put brakes on ‘reckless’ AI developmentwww.theguardian.comexternal-linkmessage-square34linkfedilinkarrow-up1121arrow-down115
arrow-up1106arrow-down1external-linkOpenAI boss and Elon Musk back calls to put brakes on ‘reckless’ AI developmentwww.theguardian.comQuantumSpecter@lemmy.world to Technology@lemmy.worldEnglish · 2 months agomessage-square34linkfedilink
minus-squarefloquant@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up5·2 months agoAt what quantisation? You’re most likely better off running 27b dense or 35 moe
minus-squaremelfie@lemmy.ziplinkfedilinkEnglisharrow-up1·edit-22 months ago3 bit and it performed like Opus 5 according to his tests, though likely not at that level on every task.
At what quantisation? You’re most likely better off running 27b dense or 35 moe
3 bit and it performed like Opus 5 according to his tests, though likely not at that level on every task.