Courtesy of Trevor PaglenScience & Tech / NewsScience & Tech / NewsViral AI selfie app gets thousands of racist images pulled from internetThe move comes after artist Trevor Paglen exposed the discriminatory nature of face classificationShareLink copied ✔️October 1, 2019October 1, 2019Text Günseli Yalcinkaya Remember that face-classifying algorithm that went viral last month for its reductive, and downright discriminatory categorisation of people? Well, as it happens, the Internet Powers That Be have actually taken note and removed 600,000 racist images from the online database used in the project. Artist Trevor Paglen’s ImageNet Roulette – a site that lets users upload photos of themselves to be categorised by an object recognition database called ImageNet – went viral last month, revealing the reductive and discriminatory ways artificial intelligence uses biased data to categorise faces. Since the popularity of Paglen’s art project, ImageNet has addressed the claims of bias, and removed the problematic images from its database. Created by Princeton and Stanford University in 2009, ImageNet is the world’s most-cited object recognition database. The system uses a 10-point Caffe model of person classification, which bases its information on 14 million images that are organised into 20,000 categories with around 1,000 images per category. Widely used to train machines on face classification, this information can be used by law enforcement agencies, schools, employers, or basically anywhere using facial-recognition technologies for ‘security’ purposes. But, as demonstrated by Paglen’s ImageNet Roulette, these categories can be wildly inaccurate, and sometimes, downright discriminatory. When we applied the database to some of our favourite celebrities, it labelled FKA twigs a “weirdo”, and Lana Del Rey, a “missy”. “This exhibition shows how these images are part of a long tradition of capturing people’s images without their consent, in order to classify, segment, and often stereotype them in ways that evokes colonial projects of the past,” Paglen told the Art Newspaper. Escape the algorithm! Get The DropEmail address SIGN UP Get must-see stories direct to your inbox every weekday. Privacy policy Thank you. You have been subscribed Privacy policy Expand your creative community and connect with 15,000 creatives from around the world.TrendingIlia Malinin breaks the ice – and his silenceHe does things on a skating rink that were once thought impossible. But the ‘Quad God’s’ setback at this year’s Winter Olympics brought new fire and energy to a skater seen by many as the greatest of all time Life & CultureBeautyThe rise of the intellectual tattoo Nike FashionNike celebrates the culture of soccer ahead of a summer shaped by the gameLife & CultureWhy so many young people are training to be death doulasLife & Culture5 times ‘Quad God’ Ilia Malinin did the impossible on the iceBeautyHoroscopes June 2026: The stars say love deeply and risk embarrassmentFilm & TV7 sex worker-approved films about sex workBeauty10 of the hottest Instagram accounts fusing art, sex and eroticaBeautyNude awakening: Meet the young people embracing naturismEscape the algorithm! Get The DropEmail address SIGN UP Get must-see stories direct to your inbox every weekday. Privacy policy Thank you. You have been subscribed Privacy policy