Wired

Noman Bashir, a fellow with the MIT Climate and Sustainability Consortium and a postdoc at CSAIL, speaks with Wired reporter Molly Taft about AI and energy consumption. Bashir explains that how quickly a model answers a question has a big impact on its energy use. “The goal is to provide all of this inference the quickest way possible so that you don’t leave their platform,” Bashir says. “If ChatGPT suddenly starts giving you a response after five minutes, you will go to some other tool that is giving you an immediate response.”