
How LA-Based Super Hi-Fi Hopes to Change Streaming Audio Using AI
Sam primarily covers entertainment and media for dot.LA. Previously he was Marjorie Deane Fellow at The Economist, where he wrote for the business and finance sections of the print edition. He has also worked at the XPRIZE Foundation, U.S. Government Accountability Office, KCRW, and MLB Advanced Media (now Disney Streaming Services). He holds an MBA from UCLA Anderson, an MPP from UCLA Luskin and a BA in History from University of Michigan. Email him at samblake@dot.LA and find him on Twitter @hisamblake
- Super Hi-Fi's AI transports the skills of a trained radio DJ to digital music playlists. Spotify's former head of research Tristan Jehan recently joined as an advisor
- Founded in 2018 by veterans of the digital music business, the company's customers include iHeartMedia, Sonos, Peloton and Octave Music Group
- Its leaders envision a new audio listening experience — where everyone has a personalized, curated playlist, with artful, AI-generated sequences and layers of music, voice clips (e.g. news and podcasts), and branded messaging that drives new revenues to the music industry
Before the beat from "Baby Got Back" that underpins Nicki Minaj's "Anaconda" fades to silence at the song's end, a sound clip pops up, right on rhythm and with a similar energy, telling the listener what streaming service they're listening to. A new track seamlessly takes the baton from the Minaj song before the brief branded message concludes, and continues the upbeat mood as a music bed for a rapid sequence of audio clips – first a voice imploring listeners to get hyped, then a word from Kanye about his interview with Beyoncé, a snippet from that interview, and another in-the-spirit advert – before blending into the intro of the next song, Kanye's "Stronger": all of it interwoven as if it were a single track produced in a recording studio.
It is the automation of this art, once the preserve of skilled radio DJs, that Super Hi-Fi is bringing to the digital music industry. In doing so, the L.A.-based company thinks it can help music services and artists make more money, and give listeners a new and improved way of experiencing audio.
Super Hi-Fi's customers include iHeartMedia,
Founded in 2018 by a group of digital music business veterans, with customers that include iHeartMedia and Sonos, SHF recently announced that Tristan Jehan – a pioneer of applying AI and machine learning to music, most recently as head of Spotify's research team – has joined the company as an advisor.
Streaming, which has been powered in part by Jehan's work on recommendation algorithms, may have saved the music industry from piracy-fueled devastation, but Super Hi-Fi's founders believe companies like Spotify, Apple and Amazon have missed the mark in some important ways.
"We think digital services forgot that the primary user interface is your eardrums, not your eyeballs," Zack Zalon, Super Hi-Fi's chief executive, told dot.LA.
As a result, a listener cannot readily distinguish one service from another, he said. Visual branding can help, but especially as smart speakers grow more popular, listeners will have an increasingly difficult time knowing whether they are tuned in to Spotify, Apple Music, Pandora or any other service.
Zalon and Brendon Cassidy, another co-founder and Super Hi-Fi's chief technology officer, both built digital radio services for CBS, AOL, Yahoo and Cricket Wireless. They contrast the uniformity of streaming services to broadcast radio stations. Two stations in the same city, focusing on the same type of music, still tend to have their own personality, they say.
"It's not just the music," Zalon said. "It's the space between the songs that the radio stations are filling and (thereby) connecting with listeners in an emotional way."
Beyond differentiating the source of the sound, SHF believes that using the space between songs — as radio stations do — can transform the listening experience. Leaving aside stitching in voice clips and layering in all other kinds of audio, they say that even sequencing songs together is fraught with issues.
The two most common types of transitions that digital services use between songs are crossfading and brief pauses.
Pauses create dead air, which iHeartMedia's chief product officer Chris Williams told dot.LA is the "enemy of radio," because it takes listeners out of their flow and puts them in a position to make a decision: namely, whether to keep listening or not. "I want to minimize that," Williams said.
As for crossfading – which Zalon said tends to be applied uniformly across tracks, such as a six-second blend of the end of one song with the start of the next, irrespective of the songs' particulars – it doesn't always work. Williams said crossfading can be done without jarring the user or disrespecting the songs about 50% of the time, and ever less so as longer song lead-ins give way to snappy intros aimed at grabbing listeners' attention from the first note.
"Crossfades create crashes," he said.
A radio DJ, by contrast, is trained to avoid these issues.
"The techniques of trained radio DJs are pretty complicated," Zalon said. "Super Hi-Fi is AI that has all the skills of a trained radio DJ."
This AI is designed to help customers like iHeart provide listeners with custom playlists that artfully blend one song with the next – no matter which song it is – and incorporate additional sonic elements like branded logos, interview clips, voice segments and more to eliminate dead air while respecting the artistry of the underlying songs, and to potentially drive streaming revenues back up to or beyond the levels that CDs generated in their peak.
How Does It Work?
As Super Hi-Fi's first customer, iHeartMedia helped the company fine tune its AI model and algorithms.
"Their pool of some of the world's best music programmers and on-air DJs became in a way like our QA partners," Zalon said.
By now Super Hi-Fi has "fingerprinted" iHeart's entire music catalog – tens of millions of tracks, Williams said – to identify the songs' underlying characteristics: features like volume, rhythm, mood, vocal texture, tempo and more. Lots more.
"The data we have on the music takes up more file space than the music itself," Zalon said.
Super Hi-Fi's AI has also fingerprinted each of iHeart's 700 styles of sonic logo; there's a country version of the "You are listening to iHeart…", a hip-hop version, a reggae version, and so on.
So, too, with any audio file that any customer may want to include in a playlist.
"The real power of the AI is to understand all the content with enough depth to make pretty much any output decision that any service might want," Zalon said.
Results have been good for iHeart. Williams reported that since they've rolled out Super Hi-Fi across their streaming services, the company has seen listening durations double.
"That increases ad impressions," he said. "There are clear business upside reasons beyond aesthetically creating a better experience...and [achieving] clear differentiation [from competitors]."
The Next Song
After having recently reeled in Sonos and its new streaming service as a customer, Super Hi-Fi has its sights set on bigger streaming fish. Jehan may help them get to Spotify, and they'll also look to Apple Music.
Chief business officer John Bolton told dot.LA that Spotify's expansion into podcasts makes them a prime candidate to benefit from Super Hi-Fi's service. He pointed to their "Your Daily Drive" product – a mix of music they know listeners like and relevant news – and said he could see that sort of playlist growing to include podcast snippets, the weather, and various other forms of audio, all tailored to the listener's preferences and location.
"If we see this happen at scale you'll start to see listening experiences become something very different," said Bolton, who helped found Super Hi-Fi after leaving ByteDance, which acquired his social media-meets-music startup Flipagram.
Streaming platforms may well be working on their own blended-audio AI solutions, but Williams says iHeart has benefited by getting in with Super Hi-Fi early.
"Two years from now everyone should have this solution or some version but we'll have already taken this to the next step, so it gives me the opportunity to get ahead," he said.
Music lawyer Ed Buggé, partner at L.A.-based entertainment law firm Hertz Lichtenstein & Young, thinks Super Hi-Fi "could be an attractive target for digital streaming platforms (DSPs) as they look to differentiate their platform offerings."
Spotify's former chief economist agreed. Will Page said a major audio streamer could look to Super Hi-Fi as a way to stand out in a market of look-alike services competing for the same customers.
"All these services offer the same 60 million tracks for the same $9.99 price point. With so much similarity, the value of distinctiveness goes up," he said. "The end game could see it being acquired by a DSP."
More than Music
Even if Super Hi-Fi doesn't lure the big catches in streaming, it can serve other verticals, including digital fitness. Peloton is already a customer.
"They wanted something different," Zalon said. "They want to make sure there's no loss of energy between songs; there's nothing worse than having music drop off in the middle of a workout. So we've been working with them on the roadmap to use the AI to help create an exercise experience that never loses its energy." In addition to blending songs, this will include voice-over instructions from Peloton's instructors.
Retail music is another area the company's targeting. Octave Music Groups, which operates Apple Music for Business and manages the music that customers hear at Starbucks, along with many other bars, restaurants and stores throughout North America and Europe, is another Super Hi-Fi customer.
Just as a radio station manager works with a DJ to set ground rules for branding the station through its sonic choices – running a branded message every 15 minutes, a news break every 30, and keeping segues tight but breezy, for example – each customer works with Super Hi-Fi to customize the AI to fit its desired style.
In exchange for this AI-plus-support service, Super Hi-Fi receives a licensing fee. The company would not disclose its prices or finances, though Bolton said Super Hi-Fi has not raised any outside funding.
He thinks using AI to bring a new level of real-time curation, presentation and personalization can attract more advertising and subscription revenues to the music industry. That's all the more important in an era when live performance has evaporated.
"We have a big, bold vision and tech that can transform playlists into listening experiences that we think will eventually make the industry much more money and provide a much better product for consumers," he said.
---
Sam Blake primarily writes about media and entertainment for dot.LA. Find him on Twitter at @hisamblake and email him at samblake@dot.LA
Subscribe to our newsletter to catch every headline.
Los Angeles is home to around 5,000 startups, the majority of which are in their young, formative years.
Which of those thousands are poised for a breakout in 2021? We asked dozens of L.A.'s top VCs to weigh in. We wanted to know which companies they would have invested in if they could go back and do it all over again.
Boiling
<img lazy-loadable="true" src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vbWVkaWEucmJsLm1zL2ltYWdlP3U9JTJGaW1hZ2VzJTNGcSUzRHRibiUzQUFOZDlHY1EwRjdlRzlxY3JFd1lNVS12T2VTWng1NFd6VFdWUktaMFpyQSUyNnVzcXAlM0RDQVUmaG89aHR0cHMlM0ElMkYlMkZlbmNyeXB0ZWQtdGJuMC5nc3RhdGljLmNvbSZzPTEwMDImaD1jOGIyM2Y5YWNhNGNhNDY3NzZhNmUzNTU3MWI2YzAzNjcwOTU1Nzg0ODQxZDdiZGIyZjAxMzUxNjdkN2I5NWY2JnNpemU9OTgweCZjPTE2MDM4MjI5MTgiLCJleHBpcmVzX2F0IjoxNjY1MTY5NTcxfQ.iTVRhSe0UulUxSyMUZ4QA7_0njADdWe3QEJ28-xW6m0/img.jpg" id="a03b9" class="rm-shortcode" data-rm-shortcode-id="03faa4898896a9ce5be09d51dc104b73" alt="Pipe logo" />Pipe
<p><a href="https://www.pipe.com/" target="_blank">Pipe</a> provides financial services to help cloud service companies tap into their deferred cash flows, allowing them to continue growing without taking on debt or giving up ownership. For subscription-based businesses, this makes it "as if all of your customers converted to annual plans overnight," according to the company.</p><p>Founded by Harry Hurst, Josh Mangel and Zain Allarakhia, the company <a href="https://dot.la/pipe-taps-60-million-seed-extension-2646245409.html" data-linked-post="2646245409" target="_blank">raised $66 million of seed funding earlier this year</a> in a deal led by Craft Ventures and Fin Venture Capital.</p>Clash App Inc.
<p>Created by former Vine-r Brendon McNerney and entrepreneur and marketing expert P.J. Leimgruber, <a href="https://www.clashapp.co/" target="_blank">Clash App</a> is a short form video platform similar to TikTok, but without built-in sound libraries. It's geared toward empowering creators with innovative monetization options and inclusive communities.</p>XCLAIM
<p><a href="https://www.x-claim.com/" target="_blank">XCLAIM</a> has created an electronic platform where bankruptcy claims that take a notoriously long time to process can be digitally traded. Founded in 2018 by Matthew Sedigh, who has operated in the corporate restructuring field for more than a decade, the company says "rather than wait years for the bankruptcy court process to issue payment distributions, creditors can now access immediate liquidity by selling their claim to interested buyers." Earlier this year, it raised a $4 million seed round led from Luma Launch, First Round Capital and Freestyle Capital.</p>Simmering
<img lazy-loadable="true" src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vbWVkaWEucmJsLm1zL2ltYWdlP3U9JTJGaW1hZ2VzJTNGcSUzRHRibiUzQUFOZDlHY1JlR3QzLWlHSmFtYVJnLXNwSXVYcDc5N0xOdnpTYWhYYVloQSUyNnVzcXAlM0RDQVUmaG89aHR0cHMlM0ElMkYlMkZlbmNyeXB0ZWQtdGJuMC5nc3RhdGljLmNvbSZzPTYwNiZoPWU3NzNhYTkwODZkNmE4OWQwMWU0ZjZkODk0ODU1ZWEyZDIzMmU3YTYyNzJjYTU3Mzk3MmI0NmQ0NjAxMDY3YzMmc2l6ZT05ODB4JmM9MjQ3NDg5MDE0MiIsImV4cGlyZXNfYXQiOjE2NzAzMzU0NjB9.iqCUfvVUI22AGAz-QYPiS7XFb26sw3mGaU8seorLqxQ/img.jpg" id="44f84" class="rm-shortcode" data-rm-shortcode-id="cbdc9b0cdf21d3873eef2a40647ae810" alt="Freck Beauty logo" />Freck Beauty
<p><a href="https://freckbeauty.com/" target="_blank">Freck Beauty</a> manufactures beauty products intended to make the user feel seen. Remi Brixton, the company's chief executive officer, founded the startup in 2015 when she was in search of a freckle makeup product. When she couldn't find one, she launched her own, the FRECK OG. The East Los Angeles-based company raised an undisclosed amount of seed funding in a deal led by KarpReilly and Stage 1 Fund earlier this year.</p>The Skills
<p><a href="https://www.theskills.com/" target="_blank">The Skills</a> wants to be the <a href="https://dot.la/the-skills-2649267338.html" target="_self">master class on sports </a>and life. The Los Angeles-based startup launched two months ago and offers classes from gold medal Olympians — including swimmer Michael Phelps and volleyball player Kerri Walsh Jennings — and Grand Slam tennis Champion Maria Sharapova. In December, it closed a $5 million seed round backed by Boston-based Will Ventures, Global Founders Capital, 8VC, Maveron, Hack VC and Correlation VC.</p>Mapped
<p>Founded by Shaun Cooley, former chief technology officer of Cisco's Internet-of-Things (IoT) and Industries division, <a href="https://www.mapped.com/" target="_blank">Mapped</a> provides IoT services in El Segundo.</p><p>The company raised $3 million of seed funding in a deal led by Greycroft earlier this year, putting its pre-money valuation at $9 million. </p>DataPlor
<p>Created in 2016 by Geoffrey Michener, <a href="https://www.dataplor.com/" target="_blank">Dataplor</a> indexes micro-businesses in Mexico (and will soon be expanding to other countries in Central and South America) and sells the data to larger companies.The company relies on contractors in those countries to collect the information from local businesses. It raised $4 million from ff Venture Capital, Quest Venture Partners and Space Capital earlier this year and expects to use it to expand into more Latin American countries. </p>Grow Credit
<p>Launched by serial entrepreneur <a href="https://joebayen.medium.com/a-black-founders-guide-to-raising-a-2m-institutional-seed-round-a8687f95087f" target="_blank" rel="noopener noreferrer">Joe Bayen</a>, <a href="https://growcredit.com/" target="_blank">Grow Credit</a> helps customers improve their credit score by providing credit for subscription services like Netflix and Spotify. Their MasterCard can help consumers with thin or damaged credit scores and the small line of credit can be upgraded for a fee. The company closed a $2 million seed round earlier this year with participation from Mucker Labs.</p>Outer
<p>The two-year-old Santa Monica-based company has seen business boom during the pandemic as retail stores shut down and online orders surged. The direct-to-consumer outdoor furniture brand <a href="https://dot.la/outer-furniture-raise-2646187491.html" data-linked-post="2646187491" target="_blank">uses backyards as showrooms</a> and <a href="https://dot.la/how-outer-aims-to-disrupt-the-outdoor-furniture-industry-2647872107.html" data-linked-post="2647872107" target="_blank">raised $4.3 million in a seed round</a> earlier this year led by Mucker Capital. Founded by Jake Liu and Terry Lin, a former designer at Pottery Barn, <a href="https://liveouter.com/" target="_blank">Outer</a> aims to appeal to Restoration Hardware and Pottery Barn shoppers. </p>WhatNot
<p>A livestreaming reseller of collectibles like FunkoPop vinyl figurines, Pokémon cards and sports cards, <a href="https://www.whatnot.com/" target="_blank">WhatNot</a> taps into a growing retail trend and promises that the collectibles are verified, much like sneaker reseller GOAT. </p><p>The startup secured $4 million in seed funding this month from Scribble Ventures, Wonder Ventures, Operator Partners, Y Combinator, Liquid 2 Ventures, Twenty Two Ventures and other investors. The company plans to use the funds to expand into video games, comics books, designer toys and vintage fashion.</p>Fourthwall
<p><a href="https://fourthwall.com/" target="_blank">Fourthwall</a> is the developer of an internet platform that helps content creators launch fully-branded websites focused on interacting with fans. Their website tag phrase is "Make a living doing what you love," which is complemented by their model, which provides creators 100% ownership of their website and brand.</p><p>Founded by Walker Williams and Will Baumann, the company has raised $4 million to date, from investors Defy Partners, Lightspeed Venture Partners and Initialized Capital Management.</p>Shop LatinX
<p><a href="https://shoplatinx.com/" target="_blank">Shop LatinX</a> calls itself the "leading beauty, fashion, and lifestyle ecommerce designed by and made for Latinas." The brainchild of two Los-Angeles-based Latinas, Brittany Chavez and Raquel Garcia <a href="https://dot.la/techstars-la-2646304264.html" data-linked-post="2646304264" target="_blank">launched their website</a> before Black Friday in 2016. It features more than 200 brands.</p>First Resonance
<p>Founded by former SpaceX software engineer Karan Talati and Neal Sarraf, <a href="https://www.firstresonance.io/" target="_blank">First Resonance</a> promises to ease the workflow for manufactures with software intended to provide greater visibility into production and test product development lifecycle. The company raised $1.75 million of seed funding last year from Wavemaker Partners, Stage Venture Partners and PLG Ventures, among clothes.</p>Vurbl
<p><a href="https://vurbl.com/" target="_blank">Vurbl</a> offers curated, one-stop-shop of what it calls the best audio on the internet, which can include podcasts but also goes well beyond that from religious sermons to court arguments. The new platform founded by CEO Audra Gold is being built with the <a href="https://dot.la/vurbl-raises-1-3-million-to-build-the-youtube-of-audio-2647713757.html" target="_self">$1.3 million pre-seed round Vurbl closed in September</a> led by AlphaEdison with participation from Halogen Ventures and Ten13.</p>PocketWatch
<p>Former Disney executive Chris Williams founded <a href="https://pocket.watch/" target="_blank">the studio</a> that produces family-focused content from YouTube stars. This year it launched clock.work, an advertising agency designed to help major brands reach kids. Investors include Viacom, Greycroft, Third Wave Digital and United Talent Agency, along with strategic angels including Robert Downey Jr. and Jon Landau.</p>PocketList
<p><a href="https://pocketlist.app/" target="_blank">The app</a> allows renters to see and share apartments that will soon be available before they're listed — reducing the time properties sit vacant and potentially heating up competition among apartment hunters. It launched <a href="https://dot.la/renter-app-2646416605.html" data-linked-post="2646416605" target="_blank">earlier this year</a>. The company has $2.8 million in seed funding led by David Sacks' Craft Ventures along with Abstract VC, Wonder Ventures and angel investor Spencer Rascoff, co-founder of Zillow and dot.LA.</p>Quilt
<p>The audio-based social platform promises to be the spot for "live, supportive, feel good conversations—just like hopping on the phone with a friend when you need it most." It lets people start a conversation around any topic or join by listening. <a href="https://www.beta.wearequilt.com/" target="_blank">Quilt</a> raised an undisclosed amount of venture funding from Freestyle Capital in 2019.</p>Tonebase
<p>Founded by Abhi Nayar, Chris Garwood and Igor Licthmann, <a href="https://www.tonebase.co/" target="_blank">Tonebase</a> provides high-level music education online. Yale School of Music alumnus Garwood and Lichtman<a href="https://news.yale.edu/2018/01/22/first-person-how-we-are-bringing-high-level-music-education-masses" target="_blank" rel="noopener noreferrer"> told their alma mater that it built with the idea </a>that it was "a way for people everywhere to learn from the very best musicians around the world — individuals who, due to their busy performing and teaching careers, are traditionally accessible to only a select few." The company has raised an undisclosed amount from Launch fund, e.ventures and other undisclosed last May. </p>Second Spectrum
<p>Launched in 2013 by Jeff Su, Yu-Han Chang and Rajiv Maheswaran, <a href="https://www.secondspectrum.com/index.html" target="_blank">Second Spectrum</a> already has deals with the NBA and English Premier League. This year it scored another one with Major League Soccer to use its optical tracking system to evaluate and analyze performance. </p><p>Second Spectrum puts their tracking cameras inside the stadium. Machine learning and AI-powered analytics provide detailed data that helps coaches and others better understand the game from player speed and deceleration to shot velocity in near real time. That technology can also be used on broadcast platforms to give fans more insight. The company raised about $20 million backed by CAA Ventures, Raine Ventures and The Chernin Group in 2018.</p>Toucan
<p>Founded by CEO Taylor Nieman, Shaun Merritt and Brandon Dietz, <a href="https://dot.la/slingshot-aerospace-ceo-2646797521.html" data-linked-post="2646797521" target="_blank">Toucan</a> is a Chrome browser extension that lets people learn a new language. It scans websites you visit and translates some words into the language you want to learn. The Santa Monica-based company most recently raised a $3 million round backed by GSV Ventures, Amplifyher Ventures, and Wonder Ventures, among others. </p>Serve Automation
<p>Created by former SpaceX engineers, <a href="https://serveautomation.com/" target="_blank">Serve Automation</a> aims to change the way foods get delivered. It has secured $7 million in a seed round and is operating in stealth mode. </p>- Meet 3 Early Stage Science Startups at First Look's Showcase - dot.LA ›
- What Early Stage Startups Should Be Thinking About COVID-19 ... ›
On this week's episode of Office Hours, you'll hear from Steven Galanis, founder and CEO of Cameo, which offers a marketplace of celebrities that will record a custom-crafted message for a fee.
- Watch: Our Virtual Fireside Chat with Cameo Founder and CEO ... ›
- Office Hours Podcast: Bill Gurley On Startups, Venture Capital and ... ›
- Cameo's CEO On How He Plans to Disrupt Hollywood - dot.LA ›