Inference is two-thirds of all AI compute. Almost all of it still runs on chips designed for training. The market is finally noticing the mismatch.
  • Optional@lemmy.worldEnglish
    1·
    1 day ago

    Very interesting. Although in the final conclusions we readvthe author’s company is uniquely suited to this challenge. 😝