Integration Engineer
EricssonApr, 2019 - Jan, 20244 yr 9 months
Led a team of 4, providing guidance and motivation for query resolution. Oversaw 30% of operations, simultaneously fulfilling the role of a Proactive data engineer. Implemented ETL process to streamline the import of data from various sources into Big Query warehouse by using SQL. Architecting and designing micro services and event-driven process leveraging Cloud Functions, pub/sub in Python. Architected and built large-scale batch data processing pipelines using Dataproc and Airflow for orchestration. Led the migration of a 100TB data warehouse from on-premises to BigQuery using Cloud Dataflow. Transformed raw data into actionable insights through optimized DAGs in Cloud Composer, driving 15 % improvement in operational efficiency for the team. Optimized end-to-end technical solutions, proactively addressing challenges, leading to a 10% decrease in project delivery time and heightened customer satisfaction. Enhanced data processing efficiency using GCP services (Big Query, Dataflow, GCE, Cloud functions, etc.), achieving a 30% improvement in issue resolution and an 8% cost reduction.