The future of hardware is unified memory on a chip
Quote
a discrete GPU connected by PCIe. It's moving to unified memory with an, with an APU or NPU built on the package.
Episode 248: Thingamajigger (episode page, opens in a new tab) 00:42:08 (play audio from this timestamp, opens in a new tab)
Voice-matched
Summary
Dave thinks the future of AI is local. Hardware is moving from a CPU plus a discrete GPU on PCIe to a system-on-chip with unified memory shared by CPU and GPU/NPU, as in Apple silicon, new Ryzen parts and Nvidia's DGX Spark. Expect machines with 128 GB of unified memory capable of running strong local models.
Not in the audio. The setup ('system on a chip with') is in an Unknown cue just before. Adam's 'Like Apple stuff, you mean?' (Unknown cue) right after shows the other host is asking, so this speaker is Dave.