Identify, link to and describe error-laden experience

Short description of above experience

Black users take a photo of themselves and upload it to the Google Photos App. The app’s automatic image labeling process labels the photo of the users into the ‘gorillas’ category. The users are rightfully shocked by the label.

Our design process

We identified where in the original process the error occurred. We then branched off before the error occurred and implemented an alternate solution. We also maintained the flow of the original application but with the correct (intended) output instead.

Description of proposed intervention

Black users take a photo of themselves and upload it to the Google Photos App. An anthropologist hired by Google has already identified a series of sensitive labels. The automatic imaging label process labels the photos of users into the gorillas category. Since this label is sensitive, the photo goes through an additional, more advanced, screening process. The users are correctly labeled as ‘people’ and are content.