TLDR Tech / Opinion
Software Development Favors Poorly Scaling Hardware Aspects
The author proposes that software development tends to follow hardware characteristics that scale poorly, like interconnect latency and memory bandwidth, instead of focusing on computational speed. With increasing layers of abstraction and diverse accelerators from different manufacturers, the movement of data emerges as the main system limitation. The author suggests that resolving this issue necessitates programming languages that directly manage and indicate data placement, rather than depending on compilers or runtime systems to conceal these details.
Read the full story