TME Studio

tool describes

TME StudioIt is an AI music creation and multimedia assistance platform launched by Tencent Music Tianqin Laboratory. Its core services are QQ Music, National K Songs, Tencent Musicians and other TME products, and provide users with a full-process tool of "music creation-analysis-audio and video production". Relying on TME's massive music library and AI technology, it covers core functions such as music separation, assisted writing, and intelligent music scores. It also includes special tools such as Galaxy Sound Effect (Multi-Scene Sound Quality Optimization) and MusE (Audio and Video One-Click Creation), while exploring the metaverse. Virtual human technology. The tool takes into account the needs of professional music creation and UGC content, which can quickly improve the efficiency of music production and allow ordinary users to produce content of quality comparable to PGC.

core functions

• Music separation: Based on deep learning, uploading any song can separate human voice and drum, bass, guitar, piano and other musical instruments, making it convenient for secondary creation; ​
• MIR calculation: AI extracts music sampling rate, BPM, rhythm, tonality, chord, drum beat, chorus and other information, deeply analyzes music content, and assists in creation and mixing; ​
• Assisted writing words: Analyze the lyrics, prose and poetry corpus of TME's entire music library, intelligently recommend rhyming words, and solve the problem of exhaustion of inspiration for writing lyrics; ​
• Intelligent score: Use neural network algorithms to generate guitar scores for a large number of songs, and upload music to obtain playable scores; ​
• Galaxy Sound: Provides 47 basic sound effects (covering bass, surround, voice, etc.), adapts to headphones, playback, and car scenes, and supports AI+DSP personalized tuning (combining user biometrics and listening environment); ​
• MusE audio and video creation: Enter songs/lyrics to generate album covers, lyrics posters, and dynamic lyrics videos; specify film and television works to intelligently clip and click Short Video (including special effects, filters, character editing); ​
• Functions to be launched: spatial audio mixing (panoramic sound mixing), genre synthesis (one-click Remix), mixing console (music detail adjustment); ​
• Virtual human technology: The development of "Xiaotian Xiaoqin Brothers and Sisters" virtual humans will support functions such as avatar, virtual dance, singing expression generation, and music light show.

usage scenarios

• Short Video/self-media creation: Use MusE to generate lyrics posters and click on Short Video, and use the music separation function to extract song fragments as soundtrack to improve content texture; ​
• Music creation assistance: Music lovers use auxiliary lyrics to find rhymes, smart music scores to obtain guitar scores, MIR calculations and analysis of song structures, and quickly create original demos; ​
• Music analysis and optimization: Audio practitioners use MIR calculations to extract key music information, and use Galaxy sound effects to customize the sound quality of different scenes (such as in-car music optimization); ​
• Tencent product adaptation: QQ music users use the functions of listening to songs, recognizing songs and improving sound quality, and national K song users use the functions of intelligent sound modification and song synthesis to enhance the user experience.

applicable population

• Short Video creators/self-media people: Quickly generate lyrics videos and posters, extract song fragments to make soundtracks, and lower the threshold for audio and video production; ​
• Music lovers/independent musicians: With the help of assisted lyric writing, intelligent music score, and music separation functions, music creation and secondary adaptation are completed at low cost; ​
• Tencent product users: Adapt to platforms such as QQ music, national K songs, and lazy people to improve the experience of listening to songs, singing, and audio production; ​
• Audio/video developers: Access Galaxy sound and MIR computing functions through cross-platform SDK to customize personalized music tools or applications.

unique advantages

• TME music library and technology blessing: Relying on Tencent's massive authentic music library, MIR calculation, sound effect optimization and other functions are more suitable for mainstream music styles, and data support is more accurate; ​
• Deep cross-product linkage: The functions are directly adapted to TME products such as QQ Music and National K Songs, and the creative content can be seamlessly synchronized to the corresponding platform, forming a "creation-distribution" closed loop; ​
• UGC creation friendly: MusE tool realizes "input generation" and can produce high-quality audio and video without professional skills, and its efficiency far exceeds that of similar tools; ​
• Multi-scene sound coverage: Galaxy sound effects are customized for scenarios such as headphones, speakers, and cars. It combines AI+DSP technology to achieve personalized tuning, and provides a better sound quality experience.