A Virtual Reality Look at a COVID-19 Patient's Lungs: No 'MD' Needed to Read These Scans
Tami Abdollah
Tami Abdollah is dot.LA's senior technology reporter. She was previously a national security and cybersecurity reporter for The Associated Press in Washington, D.C. She's been a reporter for the AP in Los Angeles, the Los Angeles Times and for L.A.'s NPR affiliate KPCC. Abdollah spent nearly a year in Iraq as a U.S. government contractor. A native Angeleno, she's traveled the world on $5 a day, taught trad climbing safety classes and is an avid mountaineer. Follow her on Twitter.
It's one thing to know a patient's lungs are infected with COVID-19. But it's an entirely different thing to see it through a virtual reality walk into those now damaged lungs.
The L.A.-based company Surgical Theater is using its high-tech VR platform, developed 10 years ago to allow surgeons to take an immersive look at patient imaging, to help doctors and patients get an in-depth look at the impact the novel coronavirus has on lungs, said Alon Zuckerman, the company's president and chief operating officer.
It is one of a slew of companies in Los Angeles and beyond that is working to help in the fight against COVID-19, in this case by giving medical staff and patients a closer look at the disease caused by the novel virus and a better view of the damage through virtual reality.
"There is such a stark contrast between the virus-infected abnormal lung and the more healthy, adjacent lung tissue," said Dr. Keith Mortman, chief of thoracic surgery at GW Hospital, on the hospital's podcast. "And it's such a contrast that you do not need an MD after your name to understand these images."
Surgical Theater first teamed up with George Washington University Hospital in Washington, D.C., which was the first in the nation to use VR tech for thoracic cases four years ago to use its 360 degree view for surgical planning and patient education. Now, the hospital is using the same tech to assess COVID-19.
"This is something the general public can take a look at and really start to comprehend how severe the amount of damage this is causing the lung tissue," Mortman said. "The damage we're seeing is not isolated to any one part of the lung. This is severe damage to both lungs diffusely."
Dr. Mortman GWUH - COVID-19 Patient VR Flythrough 2 www.youtube.com
Two ex-Israeli Air Force officers created the VR platform after their experience with flight simulation to help with mission planning.
The FDA-cleared tech has been used in the operating room to help support complex surgeries with its 3D technology, and has been used in 10,000 procedures including in hospitals at Stanford; the University of California, Los Angeles; at Hoag in Orange County; and in New York hospitals, including NYU and Mt. Sinai, among institutes across the nation, Zukerman said.
The company is working with existing hospitals to offer help in VR-alizing the CT scans of patient lungs to help assess the surge of COVID-19 cases.
Mortman, who is using the VR platform, said he's especially concerned with possibly enduring damage to lungs as a result of these infections.
"When that inflammation does not subside with time, then it becomes essentially scarring in the lungs, creating long-term damage," he said. "It could impact somebody's ability to breathe in the long term."
__
Do you have a story that needs to be told? My DMs are open on Twitter @latams. You can also email me at tami(at)dot.la, or ask for my Signal.
From Your Site Articles
- Los Angeles' Tech and Startup Scene is Growing. - dot.LA ›
- Los Angeles Venture Capital is Funding More Israeli Startups - dot.LA ›
- dot.LA/Pitchbook 50 Hottest Los Angeles Companies - dot.LA ›
- medtech - dot.LA ›
- los-angeles-startups - dot.LA ›
- Zwift's Raises $450M to Build Fitness Hardware - dot.LA ›
Related Articles Around the Web
Subscribe to our newsletter to catch every headline.
It's never been a better time to "murder your thirst."
Seven months after raising more than $9 million in Series A funding, Santa Monica-based canned water startup Liquid Death has raised $23 million in Series B funding.
The round was led by an unnamed consumer-focused family office and participated in by Convivialité Ventures, Fat Mike (NOFX), Pat McAfee, existing investor in Velvet Sea Ventures and others.
<p>Co-founded by a former Netflix-linked creative director Mike Cessario, the Science Inc.-backed company said in a statement that it is going through a high-growth period and "setting online records every month" after rolling out to more than 1,700 new stores, including Whole Foods Markets, since its last raise. Cessario said that "the funding will go to fuel that growth."</p><p>Their water that sells for $15.99 for a 12 pack is carried in thousands of stores nationally, including bars, tattoo parlors, cafes, liquor stores and more than 1,000 7-Elevens in Southern California. A company representative said their canned tallboys are the fastest growing water brand in Whole Foods and it has broken its own record on overall sales monthly since March.</p><p class="shortcode-media shortcode-media-rebelmouse-image">
<img type="lazy-image" data-runner-src="https://dot.la/media-library/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNDQzOTk5MS9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTY0NDMzMjA4NH0.dmPPTdwLqWgXtMo4n2RuxAOJ_8WdzV3lNGvAPPPiYxY/image.jpg?width=980" id="cf1eb" class="rm-shortcode" data-rm-shortcode-id="0b7e5d045f61a05a5c8dab7f01dc790e" data-rm-shortcode-name="rebelmouse-image" />
</p><p>Liquid Death has positioned its tallboys of still and sparkling canned water as an environmentally-friendly alternative to plastic water bottles — with a bad-boy panache. Along those lines, as part of its #DeathToPlastics initiative, the company gives 10% of profits on every can sold to nonprofits helping to fight plastic pollution and bring clean drinking water to people in need.<br/></p><p>Liquid Death has also upped the ante on its infamous "murder your thirst" tagline, <a href="https://dot.la/liquid-death-metal-album-2645888623.html" target="_self">releasing a heavy metal album of hateful comments</a> its product has received, and giving people the chance to <a href="https://liquiddeath.com/pages/sell-your-soul" rel="noopener noreferrer" target="_blank">sell their soul</a> "for real. Legally binding for eternity" to join its Liquid Death Country Club. It touts more than 5,000 recurring monthly subscribers. The company uses dark humor and an irreverency to drive marketing -—for example, by offering a "fuck Corona special."</p><p>The Securities and Exchange Commission filing shows the company aimed to raise $23 million but was shy $1.9 million. A company spokeswoman said the last two wires didn't come through until after the filing.</p><p><span></span>__</p><p><em>Do you have a story that needs to be told? My DMs are open on </em><a href="https://twitter.com/latams" target="_blank"><em>Twitter @latams</em></a><em>. You can also email me, or ask for my Signal.</em></p>
From Your Site Articles
Related Articles Around the Web
Read more
Show less
- Super Hi-Fi's AI transports the skills of a trained radio DJ to digital music playlists. Spotify's former head of research Tristan Jehan recently joined as an advisor
- Founded in 2018 by veterans of the digital music business, the company's customers include iHeartMedia, Sonos, Peloton and Octave Music Group
- Its leaders envision a new audio listening experience — where everyone has a personalized, curated playlist, with artful, AI-generated sequences and layers of music, voice clips (e.g. news and podcasts), and branded messaging that drives new revenues to the music industry
Before the beat from "Baby Got Back" that underpins Nicki Minaj's "Anaconda" fades to silence at the song's end, a sound clip pops up, right on rhythm and with a similar energy, telling the listener what streaming service they're listening to. A new track seamlessly takes the baton from the Minaj song before the brief branded message concludes, and continues the upbeat mood as a music bed for a rapid sequence of audio clips – first a voice imploring listeners to get hyped, then a word from Kanye about his interview with Beyoncé, a snippet from that interview, and another in-the-spirit advert – before blending into the intro of the next song, Kanye's "Stronger": all of it interwoven as if it were a single track produced in a recording studio.
<p>
It is the automation of this art, once the preserve of skilled radio DJs, that Super Hi-Fi is bringing to the digital music industry. In doing so, the L.A.-based company thinks it can help music services and artists make more money, and give listeners a new and improved way of experiencing audio.
</p>
<img lazy-loadable="true" src="https://dot.la/media-library/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNDQyNzEwMi9vcmlnaW4ucG5nIiwiZXhwaXJlc19hdCI6MTY1MTQ5MDE4M30.vHz6v4XR0Q3fab2Ib5MuA3LGG5ijBqHFr8Aotphm46g/image.png?width=980" id="d9148" class="rm-shortcode" data-rm-shortcode-id="7dd17e26f68405e9c7c838980d51ef96" data-rm-shortcode-name="rebelmouse-image" />
Super Hi-Fi's customers include iHeartMedia,
<p>Founded in 2018 by a group of digital music business veterans, with customers that include iHeartMedia and Sonos, SHF recently announced that Tristan Jehan – a pioneer of applying AI and machine learning to music, most recently as head of Spotify's research team – has joined the company as an advisor.</p><p>Streaming, which has been powered in part by Jehan's work on recommendation algorithms, may have saved the music industry from piracy-fueled devastation, but Super Hi-Fi's founders believe companies like Spotify, Apple and Amazon have missed the mark in some important ways.</p><p>"We think digital services forgot that the primary user interface is your eardrums, not your eyeballs," Zack Zalon, Super Hi-Fi's chief executive, told dot.LA.</p><p>As a result, a listener cannot readily distinguish one service from another, he said. Visual branding can help, but especially as smart speakers grow more popular, listeners will have an increasingly difficult time knowing whether they are tuned in to Spotify, Apple Music, Pandora or any other service.</p><p>Zalon and Brendon Cassidy, another co-founder and Super Hi-Fi's chief technology officer, both built digital radio services for CBS, AOL, Yahoo and Cricket Wireless. They contrast the uniformity of streaming services to broadcast radio stations. Two stations in the same city, focusing on the same type of music, still tend to have their own personality, they say.<br></p><p>"It's not just the music," Zalon said. "It's the space between the songs that the radio stations are filling and (thereby) connecting with listeners in an emotional way."<br></p>
<p>
<span style="background-color: initial;">Beyond differentiating the source of the sound, SHF believes that using the space between songs — as radio stations do — can transform the listening experience. Leaving aside stitching in voice clips and layering in all other kinds of audio, they say that even sequencing songs together is fraught with issues.</span>
</p><p>
The two most common types of transitions that digital services use between songs are crossfading and brief pauses.
</p><p>
Pauses create dead air, which iHeartMedia's chief product officer Chris Williams told dot.LA is the "enemy of radio," because it takes listeners out of their flow and puts them in a position to make a decision: namely, whether to keep listening or not. "I want to minimize that," Williams said.
</p><p>
As for crossfading – which Zalon said tends to be applied uniformly across tracks, such as a six-second blend of the end of one song with the start of the next, irrespective of the songs' particulars – it doesn't always work. Williams said crossfading can be done without jarring the user or disrespecting the songs about 50% of the time, and ever less so as
<a href="https://www.economist.com/finance-and-economics/2019/10/05/the-economics-of-streaming-is-changing-pop-songs" rel="noopener noreferrer" target="_blank">longer song lead-ins give way to snappy intros</a> aimed at grabbing listeners' attention from the first note.
</p><p>
"Crossfades create crashes," he said.
</p><p>
A radio DJ, by contrast, is trained to avoid these issues.
</p><p>
"The techniques of trained radio DJs are pretty complicated," Zalon said. "Super Hi-Fi is AI that has all the skills of a trained radio DJ."
</p><p>
This AI is designed to help customers like iHeart provide listeners with custom playlists that artfully blend one song with the next – no matter which song it is – and incorporate additional sonic elements like branded logos, interview clips, voice segments and more to eliminate dead air while respecting the artistry of the underlying songs, and to potentially drive streaming revenues
<a href="https://www.musicbusinessworldwide.com/the-global-recorded-music-industry-generated-over-20bn-last-year-but-streaming-growth-slowed/" rel="noopener noreferrer" target="_blank">back up to or beyond the levels that CDs generated in their peak</a>.
</p><h2>How Does It Work?
</h2><p>
As Super Hi-Fi's first customer, iHeartMedia helped the company fine tune its AI model and algorithms.
</p><p>
"Their pool of some of the world's best music programmers and on-air DJs became in a way like our QA partners," Zalon said.
</p><p>
By now Super Hi-Fi has "fingerprinted" iHeart's entire music catalog – tens of millions of tracks, Williams said – to identify the songs' underlying characteristics: features like volume, rhythm, mood, vocal texture, tempo and more. Lots more.
</p><p>
"The data we have on the music takes up more file space than the music itself," Zalon said.
</p><p>
Super Hi-Fi's AI has also fingerprinted each of iHeart's 700 styles of sonic logo; there's a country version of the "You are listening to iHeart…", a hip-hop version, a reggae version, and so on.
</p><p>
So, too, with any audio file that any customer may want to include in a playlist.
</p><p>
"The real power of the AI is to understand all the content with enough depth to make pretty much any output decision that any service might want," Zalon said.
</p><p>
Results have been good for iHeart. Williams reported that since they've rolled out Super Hi-Fi across their streaming services, the company has seen listening durations double.
</p><p>
"That increases ad impressions," he said. "There are clear business upside reasons beyond aesthetically creating a better experience...and [achieving] clear differentiation [from competitors]."
</p><p class="shortcode-media shortcode-media-vimeo">
<iframe src="https://player.vimeo.com/video/426344593" width="100%" height="480" frameborder="0" scrolling="no" class="rm-shortcode" data-rm-shortcode-id="dda51804020460e2470cdbeb11109bb4"></iframe>
</p><h2>The Next Song
</h2><p>
After having recently reeled in Sonos and its new streaming service as a customer, Super Hi-Fi has its sights set on bigger streaming fish. Jehan may help them get to Spotify, and they'll also look to Apple Music.
</p><p>
Chief business officer John Bolton told dot.LA that Spotify's expansion into podcasts makes them a prime candidate to benefit from Super Hi-Fi's service. He pointed to their "Your Daily Drive" product – a mix of music they know listeners like and relevant news – and said he could see that sort of playlist growing to include podcast snippets, the weather, and various other forms of audio, all tailored to the listener's preferences and location.
</p><p>
"If we see this happen at scale you'll start to see listening experiences become something very different," said Bolton, who helped found Super Hi-Fi after leaving ByteDance, which acquired his social media-meets-music startup Flipagram.
</p><p>
Streaming platforms may well be working on their own blended-audio AI solutions, but Williams says iHeart has benefited by getting in with Super Hi-Fi early.
</p><p>
"Two years from now everyone should have this solution or some version but we'll have already taken this to the next step, so it gives me the opportunity to get ahead," he said.
</p><p>
Music lawyer Ed Buggé, partner at L.A.-based entertainment law firm Hertz Lichtenstein & Young, thinks Super Hi-Fi "could be an attractive target for digital streaming platforms (DSPs) as they look to differentiate their platform offerings."
</p><p>
Spotify's former chief economist agreed. Will Page said a major audio streamer could look to Super Hi-Fi as a way to stand out in a market of look-alike services competing for the same customers.
</p><p>
"All these services offer the same 60 million tracks for the same $9.99 price point. With so much similarity, the value of distinctiveness goes up," he said. "The end game could see it being acquired by a DSP."
</p><h2>
More than Music
</h2><p>Even if Super Hi-Fi doesn't lure the big catches in streaming, it can serve other verticals, including digital fitness. Peloton is already a customer.</p><p>
"They wanted something different," Zalon said. "They want to make sure there's no loss of energy between songs; there's nothing worse than having music drop off in the middle of a workout. So we've been working with them on the roadmap to use the AI to help create an exercise experience that never loses its energy." In addition to blending songs, this will include voice-over instructions from Peloton's instructors.
</p><p>
Retail music is another area the company's targeting. Octave Music Groups, which operates Apple Music for Business and manages the music that customers hear at Starbucks, along with many other bars, restaurants and stores throughout North America and Europe, is another Super Hi-Fi customer.
</p><p>
Just as a radio station manager works with a DJ to set ground rules for branding the station
<a href="https://en.wikipedia.org/wiki/Voice-tracking#cite_ref-Geller2009_4-0" rel="noopener noreferrer" target="_blank">through its sonic choices</a> – running a branded message every 15 minutes, a news break every 30, and keeping segues tight but breezy, for example – each customer works with Super Hi-Fi to customize the AI to fit its desired style.
</p><p>
In exchange for this
<a href="https://en.wikipedia.org/wiki/Voice-tracking#cite_ref-Geller2009_4-0" rel="noopener noreferrer" target="_blank">AI-plus-support service</a>, Super Hi-Fi receives a licensing fee. The company would not disclose its prices or finances, though Bolton said Super Hi-Fi has not raised any outside funding.
</p><p>
He thinks using AI to bring a new level of real-time curation, presentation and personalization can attract more advertising and subscription revenues to the music industry. That's all the more important in
<a href="https://dot.la/music-startups-2647008629.html" target="_self">an era when live performance has evaporated</a>.
</p><ul class="ee-ul"></ul><p>
"We have a big, bold vision and tech that can transform playlists into listening experiences that we think will eventually make the industry much more money and provide a much better product for consumers," he said.
</p><p>---</p><p><em>Sam Blake primarily writes about media and entertainment for dot.LA. Find him on Twitter at @hisamblake and email him at samblake@dot.LA</em><br></p>Related Articles Around the Web
Read more
Show less
RELATEDEDITOR'S PICKS