Scientists are attempting to replicate the brain's frugality to make deep learning less polluting. — monsitj / Istock.com pic via AFP
However, above and beyond these technological breakthroughs, it is important to bear in mind that the creation of this new tool generated an enormous amount of pollution.The extent to which deep learning and computing are polluting is often overlooked. A recent study by the University of Massachusetts has shown that the training of a deep learning machine, which can take several hours or even days, can produce up to 283,000 kilograms of greenhouse gas.
Cutting back on the quantity of data they require will reduce the energy used by deep learning machines and make them less polluting. At the same time, researchers are seeking to create more economical models using an automated process called neural architecture search.