Machine Learning Engineer
DrivebuddyAIAug, 2022 - Present3 yr 7 months
Engineered and deployed ultra-fast face detection and 98-point facial landmark detection models tailored for real-time inference under constrained edge conditions. Developed a production-grade firmware simulation framework to monitor ML model drift and maintain inference integrity through periodic validation using reference datasets. Designed an early-onset drowsiness detection algorithm leveraging temporal EAR dynamics, blink rate decay, and PERCLOS to anticipate fatigue events before visual collapse. Implemented multi-signal driver behavior classifiers to disambiguate between downward gaze, visual occlusion, and sleep-induced microsleeps using eye aspect ratio and blink entropy. Built multi-modal distraction recognition pipelines for phone usage, seatbelt violation, and smoking detection by fusing facial geometry, motion vectors, and object context. Automated hyperparameter tuning using Optuna with multi-objective pruning (latency, F1-score), integrated into a modular PyTorch Lightning training pipeline. Performed model quantization, layer fusion, and ONNX graph surgery for real-time deployment on Intel OpenVINO, Kneron NPU (via NEF), and Ambarella CVFlow SDK platforms.