Sony has developed real-time live distribution technology with complete object-based spatial sound for the first time in history1. Sony has also broadened the range of devices that can support its “360 Reality Audio” music experience, which lets users submerge themselves in a three-dimensional soundscape.
While livestreaming is praised for its use and absence of location and mobility constraints, attaining a feeling of realism has proven difficult. Sony has improved its in-house 360 Spatial Sound technology, enabling real-time three-dimensional sound and video dissemination with “360 Reality Audio,” so users may enjoy a live performance or concert simultaneously without really being present.
The first live event that will be distributed in real time with “360 Reality Audio” is the online event “40 Dai-Wa-Iroiro♬” by the artist Hikaru Utada, scheduled to be held around the world on January 19, 2023. This event will be free for the first 10,000 attendees.
Development of an encoder for “360 Reality Audio” dissemination in real-time for artists and sound engineers
360 Reality Audio has created a real-time encoder that offers artists and sound engineers real-time performance and high-quality audio while also improving the working environment. Sound engineers first assign location information to each sound source, including voices, guitars, and drums, and then arrange them in a spherical sphere to produce a spatial musical experience. For real-time dissemination, Sony has created a brand-new “360 Reality Audio” production tool to enhance the working experience for sound engineers. With this tool, engineers may rapidly and arbitrarily position sound sources to produce sound that has the desired three-dimensional effect.
Although there is a method to compress audio data once, keeping the sound quality high requires a certain amount of processing time. To achieve real-time performance, which is crucial for live dissemination, Sony created its own sound quality processing algorithm. Additionally, as “360 Reality Audio” is an object-based spatial audio system, the quantity of information (bit rate) sent to each sound source (object) is automatically optimised without compromising aural quality. By temporarily compressing the audio data, it enables real-time dissemination that is timed with the video.
Application development for real-time distribution of “360 Reality Audio” for viewers
Together with US software company Streamsoft Inc., Sony created “360 Reality Audio Live,” an application4 that lets users enjoy “360 Reality Audio” distribution in real-time. Users that have this application and their own headphones may enjoy the new live entertainment.
Additionally, this programme has a real-time chat feature that enables real-time dialogue between artists and viewers as well as among viewers, creating a sense of community online as though everyone was present at the event.
“360 Reality Audio” real-time distribution of Hikaru Utada’s online event “40 Dai-Wa-Iroiro♬”
The event will be distributed around the world from 21:00 Japan time on Thursday, January 19, 2023, when Hikaru Utada turns 40. Attendees will need the “360 Reality Audio Live” app and headphones to participate.
For more info on “360 Reality Audio Live” visit https://www.sony.net/united/360RA_live/schedule/