AI4Bharat recently introduced Chitralekha is an open-source AI-powered video transcreation platform, developed by AI4Bharat and EkStep. It has an integrated workforce management system, which enables end-to-end transcreation of a video from one language to another through the stages of transcription, translation and voice-over for the translated language.
It presently caters to English and various Indian languages, supporting 12 languages for transcription, all 22 official languages for translation, and 14 languages for automated voice-over. Additionally, it allows transcription editing of mp3 audio files. The process of transcreating educational and informative videos from one language into multiple others contributes to wider accessibility and audience reach.
Chitralekha employs the open-source subtitle editor tool, Subplayer, accessible at https://subplayer.js.org/, to construct its subtitling system. Through the utilisation of open-source models such as IndicASR, IndicTrans, and IndicTTS developed by AI4Bharat, Chitralekha has the capability to automatically generate transcription, translation subtitles, and voice-over for the translated text in any given video.
It’s worth noting that, at present, machine-generated voice-over is specifically designed for single-speaker videos, with ongoing efforts to extend support for multi-speaker videos.
Chitralekha orchestrates a meticulous workflow encompassing transcription, translation, and voice-over stages. Rigorous verification and correction processes for transcripts and machine-generated subtitles set the stage for refined transcreation. Users are empowered to contribute manually, ensuring flexibility and accuracy throughout each stage.
Chitralekha empowers users to download subtitles in various formats, such as srt, vtt, txt, and docx. The platform goes a step further, offering word-level aligned transcript subtitles in ytt format, dynamically highlighting the spoken word. Project management is streamlined through effective grouping, customizable workflows, and robust workforce management.
Moreover, its user-friendly interface provides customisation options, including font size adjustment, video playback speed, theme selection, and subtitle positioning. This emphasis on user-centric features enhances the overall usability of the platform.