futureverse
Futureverse, an AI music company co-founded by music technology veteran Shara Senderoff, has announced the alpha launch of Jen, its text-to-music AI model. Available for anyone to use on its website, Jen-1 is an AI model that can be safely used by creators, given it was trained on 40 different fully-licensed catalogs, containing about 150 million works in total.
The company’s co-founders, Senderoff and Aaron McDonald, first teased Jen’s launch by releasing a research paper and conducting an interview with Billboard in August 2023. In the interview, Senderoff explained that “Jen is spelled J-E-N because she’s designed to be your friend who goes into the studio with you. She’s a tool.”
Trending on Billboard
Some of Jen’s capabilities, available at its alpha launch, include the ability to generate 10-45 second song snippets using text prompts. To lengthen the song to a full 3:30-long duration, one can use its “continuation” feature to re-prompt and add on additional segments to the song. With a focus on “its commitment to transparency, compensation and copyright identification,” as its press release states, Jen has made much of its inner workings available to the public via its research papers, including that the model uses “latent diffusion,” the same process used by Stable Diffusion, DALL-E 2, and Imagen to create high quality images. (It is unclear which music AI models use “latent diffusion” as well, given many do not share this information publicly).
Additionally, when works are created with Jen, users receive a JENUINE indicator, verifying that the song was made with Jen at a specific timestamp. To be more specific, this indicator is a cryptographic hash that is then recorded on The Root Network blockchain.
In an effort to work more closely with the music business, Futureverse brought on APG founder/CEO Mike Caren as a founding partner in fall 2023. While its mid-2024 release date makes it a late entrant in the music AI space, the company attributes this delay to making sure its 40 licenses were secured.
For now, Futureverse has declined to comment on which songs are included in their overall training catalog for Jen, but a representative for the company says that among these 40 catalogs includes a number of production libraries. Futureverse says it is also in talks with all major music companies and will have more licenses secured soon for Jen’s beta launch, expected for September 2024. Some licensing partners could be announced as soon as 4-6 weeks from the alpha launch.
In September, Futureverse has more capabilities planned, including longer initial song results, inpainting (the process of filling in missing sections or gaps in a musical piece) and a capability the company calls its “StyleFilter,” allowing users to upload an audio snippet of an instrument or track and then change the genre or timbre of it at the click of a button.
Also in September, Futureverse plans to launch a beat marketplace called R3CORD to go along with JEN. This will let JEN users upload whatever they produce with JEN to the marketplace and sell the works to others.
So far, the U.S. Copyright Office has advised that fully AI generated creations are not protected copyrights. Instead, they are considered “public domain” works and are not eligible to earn royalties like copyrights do, but any human additions made to an AI-assisted work are able to be copyright protected. (Already, this guidance has been applied in the music business in the case of Drake and Sexyy Red’s “U My Everything” which sampled the fully-AI generated sound recording “BBL Drizzy).”
“We have reached a defining moment for the future of the music industry. To ensure artistry maintains the value it deserves, we must commit to honor the creativity and copyrights of the past, while embracing the tools that will shape the next generation of music creation,” says Senderoff. “Jen empowers creators with tools that enhance their creative process. Jen is a collaborator; a friend in the studio that works with you to ideate and iterate. As we bring Jen to market, we are partnering with music rights holders and aligning with the industry at large to deliver what we believe is the most ethical approach to generative AI.”
“We’re incredibly proud of the work that’s gone into building Jen, from our research and technology to a strategy that we continue to develop with artists’ rights top of mind,” says Caren. “We welcome an open dialogue for those who’ve yet to meet Jen. There’s a seat at the table for every rightsholder to participate in building this next chapter of the music industry.”
Futureverse — a multi-hyphenate AI company — published a new research paper on Thursday (June 9) to introduce its forthcoming text-to-music generator. Called Jen-1, the unreleased model is designed to improve upon issues found in currently available music generators like Google’s MusicLM, providing higher fidelity audio and longer, more complex musical works than what is on the market today.
“Jen is spelled J-E-N because she’s designed to be your friend who goes into the studio with you. She’s a tool,” says Shara Senderoff, co-founder of Futureverse and co-founder of Raised in Space, about the model in an exclusive first-look with Billboard. Predicted to release in early 2024, Jen can form up-to three minute songs as well as help producers with half-written songs through offering ‘continuation’ and ‘in-painting’ as well.
‘Continuation’ allows a music maker to upload an incomplete song to Jen and direct the model to create a plausible idea of how to finish the song, and ‘in-painting’ refers to a process by which the model can fill in spaces of a song that are damaged or incomplete in the middle of the work. To Aaron McDonald, the company’s co-founder, Jen’s role is to “extend creativity” of human artists.
When asked why Jen is a necessary invention during a time in which producers, songwriters and artists are more bountiful than ever, McDonald replied, “I think musicians throughout the ages have always embraced new technology that expands the way they can create music,” pointing to electronic music as one example of how new tools shape musical evolution. “To imply that music doesn’t need [any new] technology to expand and become better now is kind of silly… and arbitrary.”
He also sees this as a way to “democratize” the “high end of music [quality],” which he says is now only accessible to musicians with the means to record at a well-equipped studio and with trained technicians. With Jen, Johnson and Senderoff hope to satisfy the interests of professional musicians and to encourage newcomers to dabble in songwriting, perhaps for the first time. The two co-founders imagine a world in which everyday people can create music, and have nicknamed the products of this type of user as ‘AIGC,’ a twist on the term User Generated Content (or ‘UGC’).
Futureverse was formed piecemeal over the last 18 months, merging eleven different pre-existing AI and metaverse start-ups together into one company to make a number of creative AI models, including those that produce animations, music, sound effects and more. To power their inventions, the company employs the AI protocol from Altered State Machine, a company that was founded by Johnson and included in the merger.
Senderoff says Jen will also be a superior product because Futureverse created it with the input of some of music’s top business executives and creators, unlike its competitors. Though Senderoff does not reveal who the industry partners are or how Jen will be a more ethical and cooperative model for musicians, but she assures an announcement will be released soon providing more information.
Despite its proposed upgrades, Futureverse’s Jen could face significant challenges from other text-to-music generators named in the new research paper, given some were made by the world’s most established tech giants and have already hit the market, but McDonald is unperturbed. “That forces us to think differently. We don’t have the resources that they do, but we started our process with that in mind. I think we can beat them with a different approach: the key insight is working with the music industry as a way to produce a better product.”
-
Pages