ESTsoft (CEO Chung Sang-won), a company specializing in AI services, announced on the 17th that it has added multi-speaker voice cloning and script editing to PERSO.ai — its AI human video production and auto-dubbing service that supports the global expansion of K-content — and introduced a new team plan.
The update brings a raft of new features designed to accelerate the globalization of K-content. In particular, the technology behind the auto-dubbing service 'AI Video Translator' has been strengthened so that multiple speakers in a video can be dubbed at once, with related technology advanced to preserve the character of K-content.
The centerpiece is 'multi-speaker voice cloning'. The ability to recognize and clone speakers' voices in a video has been extended from one speaker to as many as ten. Difficult interview and discussion videos featuring several people can now be translated with natural, consistent results. An AI training model reflecting the characteristics of Korean conversation has also been applied, raising Korean speech recognition accuracy to world-class levels. More notable still is the substantially improved lip-sync technology: the company developed a proprietary AI model that analyzes lip movement patterns and the surrounding context to produce more precise results.
On the technical advances, Jung Eui-jung, Head of ESTsoft's AI Engine Platform Office, explained: "The key to this work was distinguishing speakers accurately even in conversations between two or more people, and preserving each person's tone and manner of speaking naturally," adding, "It gives us a technical strength that sets us apart from global competitors such as HeyGen and Synthesia."
A 'script editing' feature has also been added to raise the quality of auto-dubbed content. Users can now edit the translated script generated by AI Video Translator, allowing them to fill in what AI may miss, such as cultural context or technical terminology. The feature is supported on mobile too, so users can refine translations easily wherever they are.
Hong Seok-beom, a producer at MCN company Treasure Hunter, which uses AI Video Translator's auto dubbing, said: "Being able to adjust the translation of technical terms precisely with the script editing feature has improved our content quality considerably."
ESTsoft has also adjusted AI Video Translator pricing sensibly in line with the technical advances. Offering the service at a more competitive price than other global services, the company has brought on major MCN (multi-channel network) operators as customers, including Treasure Hunter, SOON ENT, WAP and Sellable.
The collaboration environment in PERSO.ai has been substantially improved in response to enterprise customers' needs. To support team-based collaboration more efficiently, ESTsoft launched a team plan and added a range of policies and features, including ▲a 'Team Plan' for team collaboration ▲a member invitation and permission management system ▲a credit-sharing mechanism and ▲collaboration workflows.
Kim Saeng-geun, Head of ESTsoft's PERSO SaaS Center, said: "Conveying the feeling and character of K-content accurately across many languages is our core mission," adding, "This update will further accelerate Korean creators' expansion overseas."
He continued: "We currently work with more than 50 partner channels with 30 million subscribers, and plan to expand that to 500 channels and 100 million subscribers in the first half of this year," setting out his ambition: "We will make sure PERSO.ai goes beyond Korea to lead the global auto-dubbing and AI human video production market."