Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?
This is your opportunity to ask questions. No question too simple or too silly.
Culture war topics are accepted, and proposals for a better intro post are appreciated.
Jump in the discussion.
No email address required.
Notes -
Moore's law, strictly interpreted as "number of transistors you can fit on a 2d die doubles every two years", will be running into physical limitations soon. Moore's law, loosely interpreted as "amount of compute you get for a given monetary or energy budget doubles every two years" is still relatively far from physical limits - Landauer is still about 6 OOMs away, so there's some headroom even without reversible computing. 6 OOMs of continuing halving of energy cost every two years would take us to 2065.
I'd expect further architectural changes to be required before then, because I don't expect the compute to be shaped optimally for the ML techniques of 2025, but "the SOTA ML algos are the ones that are able to take advantage of the hardware available at the time" is nothing new.
More options
Context Copy link