Senior Software Engineer (AI & ML)
CVC Network India Pvt. Ltd.Nov, 2022 - Oct, 20241 yr 11 months
Led a team that deployed and maintained multiple translation and text-to-speech models for 400+ languages via FastAPI, Docker, Kubernetes and Baseten in production environments. Spearheaded the development of an entire end-to-end MLOp's pipeline organisation-wide along with the deployment and configuration of an AI governance framework across 22+ offices globally. Served and deployed multiple large language models (LLMs eg: falcon, llama2) using PyTorch in secure environments, addressing privacy and security issues for GDPR compliances. Awarded as a Top 10 competitor at the 'Intel - Advent of GenAI Hackathon 2023' focusing on Generative AI which included prompt engineering, fine-tuning, context-tuning and generating multi-modal outputs. Developed a Generative AI product using Open AI's text generation models (GPT-4), Image generation models (Dall-E) and AI avatars, that automated and reduced an entire content generation lifecycle from multiple weeks to a few hours. Effectively utilized the Generative AI stack such as workflow orchestrators, Langsmith, Langchain, Vector databases and embedding models to expedite experiments and client demos. Coordinated with multiple stakeholders across Australia and the Americas to define the GenAI product roadmap and MVP. Also exceeded the stakeholders' expectations, by delivering ahead of schedule. Led R&D work that lies at the intersection of a Digital Twin and AI agents as chatbots.