A.I.-powered recognition tools have well-documented blind spots.
A.I.-powered recognition tools have well-documented blind spots. They often return incorrect results for people of color and for trans, queer and nonbinary individuals.
In November 2019, researchers at the University of Colorado-Boulder showed how scoring tools—including Clarifai, Amazon’s Rekognition system, IBM Watson, Megvii’s Face++ and Microsoft facial analysis systems—habitually misidentified non-cisgender people.
Another study, this one from the MIT Media Lab, found that 33% of the time, Rekognition misidentified women of color as men. Even so, companies and government agencies continue to score vulnerable communities.
Law enforcement, immigration officials, banks, universities and even religious institutions now use scoring systems. The Charlottesville Police Department was publicly criticized early this year for placing smart cameras in communities with public housing and using A.I. systems to monitor activity.
This trend is part of our section on Scoring. Other trends in this section include:
Accountants, Advertising and Public Relations, Aerospace, Agriculture, Airlines, Alternative Energy Production & Services, Architectural Services, Auto Manufacturers, Banking, Bars & Restaurants, Beer, Wine and Liquor, Book Publishers, Broadcasters, Radio and TV, Builders/General Contractors, Cable & Satellite TV Production & Distribution, Casinos/Gambling, Chemical & Related Manufacturing, Civil Servants/Public Officials, Clergy & Religious Organizations, Clothing Manufacturing, Commercial TV & Radio Stations, Construction, Corporate Boards & Directors, Covid-19/ coronavirus, CPG, Cruise Ships & Lines, Defense, Doctors & Other Health Professionals, Drug Manufacturers, Education Colleges & Universities, Education K-12, Education Online, Education Trades, Electric Utilities, Entertainment Industry, Environment, Finance, Foreign & Defense Policy, Gas & Oil, Government - International, Government - National, Government - State and Local, Health Professionals, Heavy Industry, Hedge Funds, Hospitality, Hotels/Motels/Tourism, Human Resources, Information Technology, Insurance, Law Enforcement, Lawyers/Law Firms/Legal Industry, Lobbyists, Luxury Retail, Magazines, Manufacturing, National Security, News Media, Non-profits/Foundations/Philanthropists, Online Media, Pharmaceuticals/Health Products, Private Equity, Professional Services, Professional Sports, Radio/TV Stations, Real Estate, Retail, Technology Company, Telecommunications, Trade Associations, Transportation, Travel Industry, TV Production, TV/Movies/Music, Utilities, Venture Capital, Waste Management, Work (Future of)