Skip to content
engrtarunPublic

About

An end-to-end automated video dubbing pipeline using Kaggle GPU, Mazinger, and Index-Homura-9B for high-quality, syllable-controlled dubbing.

Topics

Resources

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

71 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation


       


𝗧_𝗗𝘂𝗯𝗯𝗲𝗿 : 𝗔𝗱𝘃𝗮𝗻𝗰𝗲𝗱 𝗩𝗶𝗱𝗲𝗼 𝗗𝘂𝗯𝗯𝗶𝗻𝗴 𝗜𝗻𝗳𝗿𝗮𝘀𝘁𝗿𝘂𝗰𝘁𝘂𝗿𝗲

𝗭𝗲𝗿𝗼 𝗖𝗼𝘀𝘁. 𝗦𝗰𝗮𝗹𝗮𝗯𝗹𝗲 𝗖𝗹𝗼𝘂𝗱 𝗚𝗣𝗨. 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻 𝗚𝗿𝗮𝗱𝗲 𝗢𝘂𝘁𝗽𝘂𝘁.

Architected for developers, utilizing Kaggle Cloud Workers and Index-Homura-9B for syllable-controlled dubbing.


⬢ 𝗖𝗼𝗿𝗲 𝗖𝗮𝗽𝗮𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀

𝗦𝘆𝘀𝘁𝗲𝗺 𝗖𝗼𝗺𝗽𝗼𝗻𝗲𝗻𝘁 𝗘𝘅𝗲𝗰𝘂𝘁𝗶𝗼𝗻 𝗘𝗻𝘃𝗶𝗿𝗼𝗻𝗺𝗲𝗻𝘁 𝗧𝗲𝗰𝗵𝗻𝗶𝗰𝗮𝗹 𝗙𝘂𝗻𝗰𝘁𝗶𝗼𝗻

𝗖𝗼𝗻𝘁𝗿𝗼𝗹 𝗡𝗼𝗱𝗲
Local Client Gradio interface, telemetry polling, file validation

𝗜𝗻𝗴𝗲𝘀𝘁𝗶𝗼𝗻
Local ⭢ Cloud FFmpeg auto-compression, Kaggle dataset staging

𝗖𝗼𝗺𝗽𝘂𝘁𝗲 𝗡𝗼𝗱𝗲
Kaggle GPU Worker VAD, transcription, LLM translation, audio synthesis

⬢ 𝗔𝗿𝗰𝗵𝗶𝘁𝗲𝗰𝘁𝘂𝗿𝗲 𝗥𝗼𝗮𝗱𝗺𝗮𝗽

We are executing a structured rollout. Rather than viewing upcoming phases as incomplete, they represent the escalating scale of the architecture.

𝗣𝗵𝗮𝘀𝗲 𝟬 : 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 & 𝗜𝗻𝗴𝗲𝘀𝘁𝗶𝗼𝗻 (𝗗𝗲𝗽𝗹𝗼𝘆𝗲𝗱)

The core infrastructure is live. Local environments securely authenticate with Kaggle via kaggle.json. Project telemetry and foundational scripts (app.py, pipeline.py, kaggle_worker.ipynb) are established.

𝗣𝗵𝗮𝘀𝗲 𝟭 : 𝗠𝗩𝗣 𝗖𝗹𝗼𝘂𝗱 𝗘𝘅𝗲𝗰𝘂𝘁𝗶𝗼𝗻 (𝗗𝗲𝗽𝗹𝗼𝘆𝗲𝗱)

The primary dubbing pipeline is operational. The Gradio UI orchestrates the workflow. Local nodes automatically sync video payloads to Kaggle. The GPU worker (kaggle_worker.ipynb) executes the Mazinger stack. Real-time polling tracks worker states and fetches error logs. Final dubbed assets are successfully retrieved.

𝗣𝗵𝗮𝘀𝗲 𝟮 : 𝗜𝗻𝘁𝗲𝗹𝗹𝗶𝗴𝗲𝗻𝗰𝗲 & 𝗦𝘁𝗼𝗿𝗮𝗴𝗲 (𝗩𝗶𝘀𝗶𝗼𝗻)

Expanding the system's analytical capabilities. Implementation of multi-speaker detection algorithms to assign distinct synthesized voices. Integration of a comprehensive quality dashboard tracking WER (Word Error Rate), Sync Offsets, and Speaker Similarity scores. Implementation of telegram_backup.py to offload final artifacts to Telegram cloud storage, optimizing local hardware memory.

𝗣𝗵𝗮𝘀𝗲 𝟯 : 𝗦𝘆𝗻𝗰𝗵𝗿𝗼𝗻𝗶𝘇𝗮𝘁𝗶𝗼𝗻 & 𝗦𝗰𝗮𝗹𝗲 (𝗩𝗶𝘀𝗶𝗼𝗻)

Advanced visual synchronization using Wav2Lip arrays for pixel-perfect lip mapping. Introduction of resilient connection handling to resume interrupted Kaggle executions. Deployment of a dynamic GPU Worker Manager for seamless failover between Kaggle, Google Colab, and Lightning AI. Integration of DPAPI for encrypted credential management.



𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝗲𝗱 𝘄𝗶𝘁𝗵 𝗽𝗿𝗲𝗰𝗶𝘀𝗶𝗼𝗻. 𝗕𝘂𝗶𝗹𝘁 𝗳𝗼𝗿 𝘀𝗰𝗮𝗹𝗲.

About

An end-to-end automated video dubbing pipeline using Kaggle GPU, Mazinger, and Index-Homura-9B for high-quality, syllable-controlled dubbing.

Topics

Resources

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages