Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

>The memory and compute requirements to develop and run these models make no sense

There is the story that von Neumann flew off the handle the first time he saw an assembler.

>>How dare you waste compute cycles on this frivolity? Just use machine code like everyone else.



There is the story that von Neumann flew off the handle the first time he saw an assembler.

That was in the 1940s when labour was very cheap and compute was insanely expensive. We’re talking hundreds to thousands of programmers’ salaries for the cost of one computer.


How much did the hardware to train gpt4 cost?


I’d expect $50-$100m. 1/40 the value of Rockstar energy drinks.


The hardware costs tens of billions. The electricity cost is around what you guessed.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: