SENIOR MACHINE LEARNING ENGINEER
AuquanJul, 2023 - Present2 yr 1 month
End-to-End Model Development and Deployment: Designed, built, and deployed ML models to process 6-8 million documents daily for ESG Risk Compliance (ERC) product. Developed and integrated models for entity extraction, topic extraction, sentiment analysis, theme detection, summarization, noise classification, severity detection, and deduplication at scale. Fine-tuned and deployed GPT-3.5, GPT-4o, and transformer-based models for specialized tasks. Created a custom Retrieval-Augmented Generation (RAG) pipeline to extract factual information from large datasets. Infrastructure and Scalability: Set up scalable infrastructure for vector databases (Qdrant) and engine pipeline, ensuring high performance and reliability. Deployed models using Docker and Kubernetes, implementing containerized solutions for production environments. Operational Excellence: Established robust test harnesses to validate models before production deployment, improving reliability and performance. Managed on-call engineering responsibilities, ensuring smooth operation and quick resolution of pipeline issues.