Deep learning isn't new, but the amount of compute and the volume of data that’s become available is growing.
In the 1980s, Geoffrey Hinton and a team of researchers at Carnegie Mellon University hypothesized a back propagation-based training method that could someday lead to an unsupervised A.I. network.
It took a few decades to build and train the massive data sets, recognition algorithms and powerful computer systems that could make good on that idea.
Last year, Facebook’s Yann LeCun, the University of Montreal’s Yoshua Bengio and Hinton (now at Google) won the Turing Award for their research in deep learning, and this subfield of A.I. is finally taking off in earnest. Programmers use special deep learning algorithms alongside a corpus of data—typically many terabytes of text, images, videos, speech and the like—and the system is trained to learn on its own.
Though conceptually deep learning isn’t new, what’s changed recently is the amount of compute and the volume of data that’s become available. In practical terms, this means that more and more human processes will be automated, including the writing of software, which computers will soon start to do themselves.
Deep learning (DL) has been limited by the processing power of computer networks, however new chipsets and faster processors will help DNNs perform at superhuman speeds. (See trend #7: Advanced AI chipsets.)
This trend is part of our section on Artificial Intelligence. Other trends in this section include:
Advertising and Public Relations, Aerospace, Agriculture, Airlines, Alternative Energy Production & Services, Architectural Services, Auto Manufacturers, Banking, Beauty, Broadcasters, Radio and TV, Builders/General Contractors, Cable & Satellite TV Production & Distribution, Casinos/Gambling, Chemical & Related Manufacturing, Civil Servants/Public Officials, Clothing Manufacturing, Commercial TV & Radio Stations, Construction, Covid-19/ coronavirus, CPG, Cruise Ships & Lines, Defense, Doctors & Other Health Professionals, Drug Manufacturers, Education Colleges & Universities, Education Online, Education Trades, Electric Utilities, Entertainment Industry, Environment, Finance, Foreign & Defense Policy, Gas & Oil, Government - International, Government - National, Government - State and Local, Health Professionals, Hedge Funds, Human Resources, Information Technology, Infrastructure, Insurance, Law Enforcement, Lawyers/Law Firms/Legal Industry, Luxury Retail, Magazines, Manufacturing, National Security, News Media, Online Media, Pharmaceuticals/Health Products, Private Equity, Professional Services, Professional Sports, Radio/TV Stations, Real Estate, Retail, Telecommunications, Trade Associations, Travel Industry, TV Production, TV/Movies/Music, Utilities, Venture Capital, Waste Management, Work (Future of)