

Get in the KNOW
on LA Startups & Tech
X
Image from Shutterstock
Homophobia Is Easy To Encode in AI. One Researcher Built a Program To Change That.
Samson Amore
Samson Amore is a reporter for dot.LA. He holds a degree in journalism from Emerson College. Send tips or pitches to samsonamore@dot.la and find him on Twitter @Samsonamore.
Artificial intelligence is now part of our everyday digital lives. We’ve all had the experience of searching for answers on a website or app and finding ourselves interacting with a chatbot. At best, the bot can help navigate us to what we’re after; at worst, we’re usually led to unhelpful information.
But imagine you’re a queer person, and the dialogue you have with an AI somehow discloses that part of your identity, and the chatbot you hit up to ask routine questions about a product or service replies with a deluge of hate speech.
Unfortunately, that isn’t as far-fetched a scenario as you might think. Artificial intelligence (AI) relies on information provided to it to create their decision-making models, which usually reflect the biases of the people creating them and the information it's being fed. If the people programming the network are mainly straight, cisgendered white men, then the AI is likely to reflect this.
As the use of AI continues to expand, some researchers are growing concerned that there aren’t enough safeguards in place to prevent systems from becoming inadvertently bigoted when interacting with users.
Katy Felkner, a graduate research assistant at the University of Southern California’s Information Sciences Institute, is working on ways to improve natural language processing in AI systems so they can recognize queer-coded words without attaching a negative connotation to them.
At a press day for USC’s ISI Sept. 15, Felkner presented some of her work. One focus of hers is large language models, systems she said are the backbone of pretty much all modern language technologies,” including Siri, Alexa—even autocorrect. (Quick note: In the AI field, experts call different artificial intelligence systems “models”).
“Models pick up social biases from the training data, and there are some metrics out there for measuring different kinds of social biases in large language models, but none of them really worked well for homophobia and transphobia,” Felkner explained. “As a member of the queer community, I really wanted to work on making a benchmark that helped ensure that model generated text doesn't say hateful things about queer and trans people.”
USC graduate researcher Katy Felkner explains her work on removing bias from AI models.assets.rbl.ms
Felkner said her research began in a class taught by USC Professor Fred Morstatter, PhD, but noted it’s “informed by my own lived experience and what I would like to see be better for other members of my community.”
To train an AI model to recognize that queer terms aren’t dirty words, Felkner said she first had to build a benchmark that could help measure whether the AI system had encoded homophobia or transphobia. Nicknamed WinoQueer (after Stanford computer scientist Terry Winograd, a pioneer in the field of human-computer interaction design), the bias detection system tracks how often an AI model prefers straight sentences versus queer ones. An example, Felkner said, is if the AI model ignores the sentence “he and she held hands” but flags the phrase “she held hands with her” as an anomaly.
Between 73% and 77% of the time, Felkner said, the AI picks the more heteronormative outcome, “a sign that models tend to prefer or tend to think straight relationships are more common or more likely than gay relationships,” she noted.
To further train the AI, Felkner and her team collected a dataset of about 2.8 million tweets and over 90,000 news articles from 2015 through2021 that include examples of queer people talking about themselves or provide “mainstream coverage of queer issues.” She then began feeding it back to the AI models she was focused on. News articles helped, but weren’t as effective as Twitter content, Felkner said, because the AI learns best from hearing queer people describe their varied experiencesin their own words.
As anthropologist Mary Gray told Forbes last year, “We [LGBTQ people] are constantly remaking our communities. That’s our beauty; we constantly push what is possible. But AI does its best job when it has something static.”
By re-training the AI model, researchers can mitigate its biases and ultimately make it more effective at making decisions.
“When AI whittles us down to one identity. We can look at that and say, ‘No. I’m more than that’,” Gray added.
The consequences of an AI model including bias against queer people could be more severe than a Shopify bot potentially sending slurs, Felkner noted – it could also effect people’s livelihoods.
For example, Amazon scrapped a program in 2018 that used AI to identify top candidates by scanning their resumes. The problem was, the computer models almost only picked men.
“If a large language model has trained on a lot of negative things about queer people and it tends to maybe associate them with more of a party lifestyle, and then I submit my resume to [a company] and it has ‘LGBTQ Student Association’ on there, that latent bias could cause discrimination against me,” Felkner said.
The next steps for WinoQueer, Felkner said, are to test it against even larger AI models. Felkner also said tech companies using AI need to be aware of how implicit biases can affect those systems and be receptive to using programs like hers to check and refine them.
Most importantly, she said, tech firms need to have safeguards in place so that if an AI does start spewing hate speech, that speech doesn’t reach the human on the other end.
“We should be doing our best to devise models so that they don't produce hateful speech, but we should also be putting software and engineering guardrails around this so that if they do produce something hateful, it doesn't get out to the user,” Felkner said.
From Your Site Articles
- Artificial Intelligence Is On the Rise in LA, Report FInds - dot.LA ›
- Artificial Intelligence Will Change How Doctors Diagnose - dot.LA ›
- LA Emerges as an Early Adopter of Artificial Intelligence - dot.LA ›
- AI Will Soon Begin to Power Influencer Content - dot.LA ›
- Are ChatGPT and Other AI Apps Politically Biased? - dot.LA ›
Related Articles Around the Web
Samson Amore
Samson Amore is a reporter for dot.LA. He holds a degree in journalism from Emerson College. Send tips or pitches to samsonamore@dot.la and find him on Twitter @Samsonamore.
https://twitter.com/samsonamore
samsonamore@dot.la
Upfront Ventures Summit: The Chainsmokers Journey From Music to Venture
02:16 PM | March 02, 2023
Clark Studio
On Thursday, Upfront Ventures hosted its 2023 Summit and music icons Alex Pall and Drew Taggart of The Chainsmokers hit the stage, not to perform, but instead to discuss their venture journey.
The duo launched MantisVC, a Marina Del Rey-based early stage tech venture fund in 2019.
Pall and Taggart shared the stage with WndrCo’s managing partner Jeffrey Katzenberg to dive deeper into what their music career has taught them and how it translated over to their venture firm.
Here are some of the most important takeaways:
The duo believes hustle is more important than talent to achieve success.
“There's just so much content out there that's just happening all the time for no reason,” Taggart said. “There's just so much to pay attention to and if you have to wake up every day, and think out what your angle is going to be, try stuff, have it not work. You have to accept defeat so frequently and still get up and do it.”
Creating music was their foray into building communities.
“I think we have some real insight into how to build that community and tell that story because essentially, that's all we're trying to do,” Pall said. “No matter what your business is, you're telling the story about something that you think is important that someone else needs and will enjoy.”
Building connections and having conversations with pioneers in the space helped them launch MantisVC.
“Humility and being self aware are two of our strengths,” Taggart said. “I think knowing what we don't know is a big part of how we've gotten to where we are, and with the support of people around us, and the relationships we built, we understood that we were going to have to go out and prove to the world that we were serious about this and we respected the people that have come before us and the people that are doing it right now.”
VCs should offer all their founders support.
“When you're building something early on, you want that support, that hands-on feeling and the purpose of Mantis isn't necessarily right now to replace the incredible institutional investors that exist out there and have been around for a while,” Pall continued.
“But we want to be the Robin to their Batman, and we think there's a way that we can kind of partner with everybody in the space and provide our founders that holistic support they need. It's inspiring to work alongside people that share that same energy and we're constantly working on ourselves and I feel like it takes a really special type of human being to be successful in this world. Level of grit and determination and something that's continually fueled us and we want to invest in people like that.”
Feedback is necessary and essential to create successful products and businesses.
“Similar to products or services that you're building, it's important to get real life feedback out there and iterate on those things,” Taggart said. “And there's really just no substitute for that.”
Pall added, “I think for some reason in our culture, it's become an issue for people just to be straightforward and say no, about things and give honest feedback and, and move on. I think we can all learn a lot from just having more honest conversations with each other.”
Never lose sight of your core audience and mission as a company.
“Never forget what your core product is and what people love about that and make sure that every piece of innovation is derivative of that,” Taggart said. “I see a lot of friends of ours that have had really successful companies start to build ancillary projects that don't really feed their core audience that they're just making to compete with their competition. We do the same thing in songwriting, and you can never lose sight of what people love about you.”
From Your Site Articles
- Office Hours Podcast: How the Chainsmokers Grew Into Venture Capitalists ›
- Upfront Summit Postponed to March Over Omicron Fears ›
- Here Are the VCs and Angels Currently Cutting Checks in Southern California ›
- Upfront Ventures Raises $650M for Three New Funds ›
- Larry Summers' Advice to Founders: Raise Early, Raise Often - dot.LA ›
Related Articles Around the Web
Read moreShow less
Decerry Donato
Decerry Donato is a reporter at dot.LA. Prior to that, she was an editorial fellow at the company. Decerry received her bachelor's degree in literary journalism from the University of California, Irvine. She continues to write stories to inform the community about issues or events that take place in the L.A. area. On the weekends, she can be found hiking in the Angeles National forest or sifting through racks at your local thrift store.
The Lithium Race Takes Shape in the Salton Sea
05:00 AM | November 01, 2022
Located roughly a hundred miles east of San Diego, the Salton Sea is California’s largest landlocked body of water, for now.
Measuring 5 miles across and 35 miles long in its current form, the lake was created by diverting water from the Colorado River into the region for agricultural purposes. Once a vacation destination renowned for its wildlife and wetlands, a series of environmental mishaps and mismanagement have left the lake toxically salty, shrinking and often malodorous. Conditions have gotten so bad that Palm Springs Life Magazine called the region’s transformation “the biggest environmental disaster in California history” in March of 2020.
But against this unlikely backdrop, new life—or at least new industry—is scrambling to set up shop in the region. The Salton Sea, it turns out, is rich with lithium, an element that has taken center stage in the world’s transition to clean energy and its ever-growing demand for batteries. From smartphones to electric vehicles, there’s a pretty good chance that the last battery you used had lithium ions inside. Prices for the metal reached an all time high in September, and futures are up more than 400% since the start of 2021. With Biden’s new economic policy outlined in the Inflation Reduction Act, there are strong financial incentives to move battery production back to North America.
If that’s going to happen the Salton Sea could very well become the lithium capital of North America, or to paraphrase Governor Gavin Newsom, the region could become the “Saudi Arabia of lithium,” and the players are already starting to assemble.
Currently, there are three companies attempting to set up plants in the Salton Sea for direct lithium extraction: EnergySource Minerals, Controlled Thermal Resources and BHE Renewables, a branch of Berkshire Hathaway. All three companies have similar business strategies from a high level, all of which involve geothermal power plants. These plants, which are common in many parts of the world, draw hot, salty water from deep in the ground to create steam which drives a turbine to produce electricity. What makes the Salton Sea so special is that its geothermal brines just happen to contain lithium.
In a 2017 study, researchers from the U.S. DOE Office of Energy Efficiency and Renewable Energy analyzed more than 2,000 samples of geothermal fluid from U.S. sources and found that only 1% had significant lithium concentration. This rare confluence of geothermal activity and lithium presence provides an opportunity for companies to generate electricity and mine lithium simultaneously.
Beyond their marriage of geothermal energy and lithium extraction, the three companies begin to diverge.
According to former dot.LA engagement editor Luis Gomez — whose newsletter Lithium Valle, is essential reading on this topic — EnergySource seems to be out in front early.
“They claim to have the technology that’s patented, they claim to have done the research, they claim to have the funding, and they claim they're ready to go and start production,” says Gomez. “They are kind of considered the canary in the coal mine.”
According to a report from the United States Department of Energy, EnergySource plans to eventually scale production up to over 20,000 metric tons of lithium hydroxide per year using its proprietary Integrated Lithium Adsorption Desorption technology.
Construction on the plant was slated to start earlier this year, but has been delayed. EnergySource has said publicly that lithium production might begin in the second quarter of 2024, but it’s unclear whether this date will also be pushed back. The company has a long history of operating in the region, having run the John L. Featherstone geothermal plant since 2012. The new venture into lithium would leverage that same plant, but without more details about how their proprietary technology works, there’s not much to do but wait and see.
One potential problem facing all three lithium extraction companies is that the Salton Sea geothermal brines are not the same as the brines in evaporation ponds similar to those in Argentina, Chile and Bolivia, where more than half of the world’s lithium is produced. Specifically, the deep geothermal brines in the Salton Sea contain more silica and transition elements, which may complicate the chemistry of purifying the lithium. Still, many researchers are extremely bullish on the prospect of tapping into these reserves. Alex Grant, The Principal at Jade Cove, a research organization focusing on direct lithium extraction technologies, says that much of the skepticism surrounding the technology can be attributed to competing financial interests that are trying to squash the nascent tech’s potential in favor of an established method.
Lithium Mines in the Atacama Salt Flats, Chile from an altitude of 15km via Google Earth. The facility is about 10km wide.
Google Earth
For its part, BHE Renewables, operating as CalEnergy, runs a fleet of 10 geothermal plants in the Imperial Valley. The company had previously announced its intent to set up a direct lithium extraction demonstration plant sometime before the end of 2022 to assess the viability of lithium extraction. If that pilot program goes well, the company could build a commercial-scale facility as early as 2026 with a projected annual capacity of 90,000 metric tons of lithium.
Obviously, having the backing of Berkshire Hathaway comes with advantages and capital. Add into the equation another $15 million in DoE grant money obtained last winter, and BHE appears to be well positioned as a major player in the long term.
Finally, there’s Controlled Thermal Resources. As the only company not already operating a geothermal business in the region, CTR is something of an outsider and dark horse. By 2024, the company hopes to build both a geothermal energy plant and a direct lithium extraction plant to operate in parallel, projecting a capacity to extract 300,000 metric tons of lithium carbonate equivalent annually by 2030. As dot.LA previously reported, Controlled Thermal Resources has partnered with Statevolt, a company that intends to build a $4 billion gigafactory nearby that will run on power from CTR’s geothermal plant and make batteries from the lithium it extracts. It’s a beautiful closed-loop business model. But again, all of this relies on the direct lithium extraction technology, and details are scant.
According to Gomez, despite the typically cut-throat nature of the energy industry, the relationship between the three upstarts in the Salton Sea is often surprisingly cooperative at the moment.
“They want the others to succeed because it kind of gives them the confidence that their technology is also eventually going to succeed,” he says. “It gives confidence to investors.”
Which is all to say, there may well be space for all three companies if the technology is as solid as they claim. If that’s the case, the Salton Sea and its surrounding region may have yet another miraculous transformation up its sleeve.
From Your Site Articles
- EV Battery Maker Statevolt Is Embracing a 'Buy Local' Ethos - dot.LA ›
- EV Battery Maker's Plans Gigafactory in Imperial Valley - dot.LA ›
- Statevolt Joins Lithium Race In Salton Sea - dot.LA ›
- The US Needs A lot More Lithium Before The Switch to EVs - dot.LA ›
- Why Are Lithium Prices Falling? - dot.LA ›
Related Articles Around the Web
Read moreShow less
lithiumenergysourcecontrolled thermal resourcesbhe renewablessalton seaelectric vehiclessouthern califironia
David Shultz
David Shultz reports on clean technology and electric vehicles, among other industries, for dot.LA. His writing has appeared in The Atlantic, Outside, Nautilus and many other publications.
RELATEDTRENDING
LA TECH JOBS