Sam Altman says local AI inference wastes scarce memory

Share

Sam Altman estimates that personal devices use only about 5% of their resources, leaving DRAM idle when a user is not running a chatbot. According to OpenAI’s chief executive, centralized data centers make better use of the available memory as shortages are intensified by rising demand for artificial intelligence. OpenAI has secured supply agreements with Samsung and SK Hynix that could increase its purchases to as many as 900,000 high-bandwidth DRAM wafers per month, representing roughly 40% of global output. The strategy benefits memory manufacturers but is expected to shrink the supply available to laptop makers, computer manufacturers and competing artificial intelligence labs, while OpenAI continues investing in custom chips and approximately 3.2 GW of power capacity.

Source: Read the original article

Disclaimer: this content is for information purposes only and is not financial advice. Cryptocurrencies are highly volatile: you may lose all of your capital. Always do your own research. Legal notice
Telemac
Telemachttp://cryptoinfo.ch
Passionné de nouvelles technologies, j’explore l’univers de la blockchain et des cryptomonnaies pour partager l’actualité et les innovations du secteur.

Read More

Items