eicker@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoFederal Reserve Says AI Data Center Buildout Is Making Everything More Expensive: "I’m getting increasingly nervous that that’s just straight, old-fashioned overheating demand."futurism.comexternal-linkmessage-square18linkfedilinkarrow-up1177arrow-down16
arrow-up1171arrow-down1external-linkFederal Reserve Says AI Data Center Buildout Is Making Everything More Expensive: "I’m getting increasingly nervous that that’s just straight, old-fashioned overheating demand."futurism.comeicker@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square18linkfedilink
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up6·2 days agoAnother factor is that model capabilities are topping out, but inference costs of cheaper models are absolutely plummeting. In other words, it’s a race to the bottom. And inference will become a dirt cheap commodity. …And what do we need all those datacenters for if inference is dirt cheap?
Another factor is that model capabilities are topping out, but inference costs of cheaper models are absolutely plummeting.
In other words, it’s a race to the bottom. And inference will become a dirt cheap commodity.
…And what do we need all those datacenters for if inference is dirt cheap?