TLDR Tech / Practical
AI energy consumption tied to prompt construction, Neuralwatt reveals
Neuralwatt's findings suggest that the primary source of energy inefficiency in AI is the method used to construct prompts, not the AI model itself or the hardware. Minor adjustments in prompt formulation early in extended operations can necessitate the recalculation of numerous tokens, effectively doubling the energy required for a given task.
Read the full story