Data Engineer with excellent problem-solving and ability to perform with team. Passionate about coding and enjoy learning new technical skills for professional growth.
Role
Senior Software & Databricks Engineer
Years of Experience
5.42 years
Skillsets
Github
version control
synapse
SQL Server
Team work
SparkSQL
Self management
Python
Problem Solving
GitLab
PySpark - 3.5 Years
Git
Flexibility
Confidence
Communication
Azure DataBricks
Azure Data Lake
Azure Data Factory
Airflow
Delta Lake
Professional Summary
5.42Years
Apr, 2025 - Present1 yr
Sr. Data engineer
NCR Atleos
Jun, 2024 - Apr, 2025 10 months
Senior software Engineer (sr. Data engineer)
Veersa Technologies
Aug, 2021 - Dec, 20243 yr 4 months
Cloud data engineer
Cognizant
Apr, 2021 - Jul, 2021 3 months
data Engineer Trainee
Cognizant
Applications & Tools Known
Azure Cloud
Azure Synapse
Azure Data Factory
Pyspark
Azure Data Lake
Azure databricks
PowerBI
Work History
5.42Years
Sr. Data engineer
NCR Atleos
Apr, 2025 - Present1 yr
Analyzed and developed stored procedures for incremental load with ADF pipeline testing and deployment in production.
Senior software Engineer (sr. Data engineer)
Veersa Technologies
Jun, 2024 - Apr, 2025 10 months
Developed ETL pipelines using Azure Data Factory and Databricks, implementing business logic-oriented transformations and loading enriched datasets into ADLS. Configured secure connectivity using Azure Key Vault. Conducted performance tuning of Spark jobs and supported end-to-end data solutions.
Cloud data engineer
Cognizant
Aug, 2021 - Dec, 20243 yr 4 months
data Engineer Trainee
Cognizant
Apr, 2021 - Jul, 2021 3 months
Designed and implemented ETL workflows extensively using Azure Data Factory (ADF) to orchestrate data pipelines for extracting data from on-premises SQL Server, APIs, and flat files, transforming it with complex mapping data flows, and loading it into Azure Data Lake Storage (ADLS). Configured and optimized ADLS for secure storage, utilized Databricks for transformations, and implemented secure credential management.
Achievements
Successfully migrated Informatica 10.4.0 SUSE 11 SP-5 servers to SUSE 12 SP-5 Linux servers
Automated Scripts using crontab scheduler
Migrated Spark Workload from on-prem to the cloud for better monitoring and scheduling
Used beam for replicating spark code as per business requirement
Major Projects
2Projects
Project 2
Jun, 2024 - Present1 yr 10 months
Developed ETL pipelines using Azure Data Factory and Azure Databricks, implemented Medallion Architecture in Databricks, and optimized data pipelines to ensure high-quality data solutions.
Project 1
Apr, 2021 - Jun, 20243 yr 2 months
Designed and implemented ETL workflows with Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake, ensuring data quality and migration from multiple sources.
Education
B.Tech in Information Technology
KIIT University (2021)
Certifications
Microsoft Azure Data Fundamentals (10/2022 - Present)
Microsoft Azure Data Fundamentals (10/2022 - Present)
Microsoft Azure Data Fundamentals (10/2022 - Present)
Microsoft Azure Data Fundamentals (10/2022 - Present)
Microsoft Azure Data Fundamentals (10/2022 - Present)
Microsoft Azure Data Fundamentals (10/2022 - Present)