Their founders, managers, engineers are not only not well-versed in these experiences, but, as stories that now regularly punctuate the news cycle show, are sometimes perpetrating the abuses.That systems reinforce the stereotypes and implicit biases of the people who are designing them is old news.But change “doktor” to “hemsire”, meaning nurse, in the same sentence and this is translated as “she is a nurse”.Last year, a Microsoft chatbot called Tay was given its own Twitter account and allowed to interact with the public.This link was stronger than the non-controversial findings that musical instruments and flowers were pleasant and weapons and insects were unpleasant.Female names were also strongly associated with artistic terms, while male names were found to be closer to maths and science ones.
The team took their case one-step further and used the same terms from a study in 2004 that sent thousands of resumes to employers – some had white-sounding names and others black-sounding names.
There were strong associations, known as word “embeddings”, between European or American names and pleasant terms, and African-American names and unpleasant terms. For example Google Translate, which learns what words mean by the way people use them, translates the Turkish sentence “O bir doktor” into “he is a doctor” in English, even though Turkish pronouns are not gender specific.
So, it can actually mean “he is a doctor” or “she is a doctor”.
“From when I was like 12, I used to think about that all the time.” I ask the groom-to-be how he knew his girlfriend was the one.
They met at work, he says, and by the time he came out to her, they were already in love.