Revolutionizing Language Synchronization in Dubbed Content: The Visionaries behind NeuralGarage

Imagine Spanish actors seamlessly speaking Tamil, conveying their lines with natural fluidity. This seemingly magical transformation is now possible, thanks to the ground-breaking efforts of four visionary minds at Bengaluru-based deep tech start-up NeuralGarage. With the aid of generative AI, NeuralGarage is reshaping the landscape of dubbed content, offering a cohesive and immersive viewing experience that eliminates the dissonance between audio and visual elements.

A Common Challenge Addressed

Dubbed content has long grappled with a significant challenge—audio-visual disparity. Despite being dubbed into different languages, the lip and jaw movements of actors often fail to sync with the translated dialogue, leading to a jarring and incongruous experience for viewers. NeuralGarage recognized this pervasive problem and set out to create a solution that would seamlessly blend audio and visual components, resulting in a more authentic and enjoyable viewing experience.

Catalyst for Innovation: A Personal Experience

The inception of NeuralGarage’s flagship product, VisualDub, traces back to a personal encounter. Anjan Banerjee, one of the founders of NeuralGarage, found himself enthralled by Korean shows and movies. However, while watching the dubbed version of the Korean film “Train to Busan,” he encountered a disconnect. The dubbed audio failed to synchronize with the actors’ facial expressions, hindering his ability to fully immerse himself in the storytelling and appreciate its visual nuances.

This frustration fuelled Banerjee’s curiosity, propelling him to explore the potential of artificial intelligence to address this dissonance. Alongside his fellow IIT Kanpur batch mates, Subhabrata Debnath and Subhashish Saha, Banerjee delved into the realm of AI to bridge the gap between audio and video synchronization. Their shared mission caught the attention of Mandar Natekar, a seasoned media and entertainment veteran, who would become a crucial mentor for their venture.

The Genesis of Neural Garage:

In 2015, the trio of Debnath, Banerjee, and Saha founded Visage Map, a pioneering facial recognition start-up. This endeavour was later acquired by FaceFirst, a prominent US-based facial tech company. Fuelled by a determination to make a more significant impact, the founders departed from FaceFirst in 2021 and embarked on their journey to revolutionize audio-visual synchronization. This endeavour led to the establishment of NeuralGarage, with the addition of Mandar Natekar, bringing his extensive 20-year experience from companies like Viacom18, Times Television Network, Turner International, Reliance Entertainment, and Sony.

Pioneering Seamless Communication through AI:

At the core of NeuralGarage’s vision is the seamless communication of ideas and stories across language barriers using the power of AI. The name “NeuralGarage” pays homage to its focus on neural networks, the foundation of AI. Drawing inspiration from tech giants like Apple, Microsoft, Google, and Meta, which started their journeys in garages, NeuralGarage aims to redefine language synchronization in the entertainment industry.

VisualDub: Bridging the Gap

NeuralGarage’s flagship product, VisualDub, addresses the audio-visual disparity prevalent in dubbed content. Operating on proprietary algorithms, VisualDub maps phonemes, the smallest units of human sound, to visemes, corresponding lip shapes. These mappings transcend linguistic boundaries, enabling the synchronization of jaw and lip movements with dubbed audio. The result is a harmonious and natural viewing experience that removes the visual discord that often plagues dubbed content.

Future Visions and Ambitions:

NeuralGarage’s pioneering solution has already garnered recognition in the industry. From ad campaigns for Amazon India to projects with Microsoft, the start-up is leaving its mark in advertising, influencer marketing, content creation, OTT platforms, films, and edtech. Backed by institutional VC fund Exfinity Venture Partners and notable angel investors, NeuralGarage has raised $1.45 million in its seed round, solidifying its presence in the rapidly growing generative AI landscape.

As the world continues to demand seamless content consumption in various languages and cultures, NeuralGarage remains committed to its mission. The startup’s focus on continuous innovation and expansion ensures that VisualDub will pave the way for a more inclusive and captivating viewing experience. With its sights set on revenue growth and widespread adoption, NeuralGarage’s journey is poised to transform how we interact with dubbed content and transcend language barriers in the world of entertainment.