Sam Altman Says DRAM Sitting in Personal Computers Is a Poor Use of Scarce Memory
BREAKING: OpenAI CEO Sam Altman says having RAM in personal computers is an inefficient use of the world’s limited DRAM supply, arguing it would be better allocated to data centers, per Tom’s Hardware
Context
The OpenAI chief is arguing that scarce memory should serve the cloud rather than local AI on personal machines, as AI demand drives up memory prices for consumers.
Altman made the remarks on Cheeky Pint, an interview show on YouTube, while discussing local inference, meaning running AI models on your own computer. Memory makers have reserved much of their output for AI data centers, which has pushed up prices for PCs and phones.
Deep dive
Unusual Whales posted on Friday that OpenAI CEO Sam Altman says having RAM in personal computers is an inefficient use of the world's limited DRAM supply, citing Tom's Hardware.
According to Tom's Hardware, Altman made the comments in an interview with the YouTube channel Cheeky Pint, about 29 minutes in. Discussing the hope that open models will let people run AI at home, he said that from a global allocation perspective it is quite terrible for everybody to have a bunch of the world's limited supply of DRAM sitting in their own computer and being used 5 percent of the time. He added that you want maximum utilization in the cloud in a very supply constrained environment, and that many people's intuition is the opposite.
The Verge, quoting the same interview, notes that the remarks came in answer to a question about supply shortages, and that memory makers have long term deals with cloud operators and projects like OpenAI's Stargate. PC Gamer and others pointed out that Altman was talking about local AI inference rather than gaming PCs.
The comment drew a strong reaction online, since rising memory prices are already hitting PC builders and device buyers. It also fits OpenAI's business, which mainly sells access to models that run in its own data centers.
What to expect next
Watch whether Altman or OpenAI clarifies the remark, and how the debate over local versus cloud AI develops as open models improve. Memory prices are the practical issue: if AI demand keeps absorbing DRAM supply, consumer devices will stay expensive. New memory factories from Samsung, SK Hynix and Micron will decide how long the squeeze lasts. Device makers may also respond by shipping less memory in new products.