Pankaj Kumar
A cloud data engineer with 3+ years of experience working with fortune 500 and life sciences clients in US, Europe and Asian markets. Hands-on experience in architecting end to end technical solutions that include data storage, processing & consumption infrastructure enabling reporting, analytics and systematic consumption by tools and services within the organization.
- Role
Data & Hive Engineer
- Years of Experience
3.9 years
Skillsets
- AWS
- visio
- Tableau
- Sql workbench
- S3
- Redshift
- MWAA
- Glue
- Git
- EMR
- EC2
- Databricks
- Python
- Athena
- Airflow
- Snowflake - 3 Years
- Hive
- Big Data
- ETL
- PySpark
- MS Excel
- Hadoop
- SQL - 3 Years
Professional Summary
3.9Years
- Aug, 2022 - Present3 yr 3 months
Data Engineer
ZS Associates - Feb, 2022 - Jul, 2022 5 months
Data Engineer, Intern (Certificate)
ZS Associates - Oct, 2021 - Jan, 2022 3 months
Analyst, Intern (Certificate)
GrowthCure
Applications & Tools Known
Airflow
Tableau
.png)
Databricks
SQL Workbench
EMR
Redshift
Athena
S3
Glue
Airflow
Tableau
Databricks
Visio
Git
Snowflake
Work History
3.9Years
Data Engineer
ZS AssociatesAug, 2022 - Present3 yr 3 months
Developed and optimized a high-performance streaming pipeline on Databricks for real-time contract data ingestion, enhancing contract lifecycle management. Migrated Informatica data to AWS, established pipelines on Apache Airflow, crafted PySpark scripts for the data warehouse layer, and documented data pipeline architectures. Produced SOPs and instructional materials, leveraged EMR managed scaling, designed and implemented ETL pipelines, and developed scripts in PySpark and SQL. Delivered status updates to project leads and stakeholders, participated in strategic planning, addressed ETL issues, and provided customer support during operations. Leveraged AWS and Databricks to develop Tableau dashboards, generated backend data solutions on Snowflake, optimized Spark configurations, collaborated with clients, evaluated reporting designs, and managed end-to-end client communication.
Data Engineer, Intern (Certificate)
ZS AssociatesFeb, 2022 - Jul, 2022 5 months
Leveraged data expertise and proprietary tools to streamline project processes. Implemented business rule changes in the data warehouse, developed, constructed, tested, and maintained critical data architectures, and identified opportunities to enhance data reliability and efficiency using programming languages and ETL tools.
Analyst, Intern (Certificate)
GrowthCureOct, 2021 - Jan, 2022 3 months
Analyzed daily data, created ad-hoc queries to meet business needs, and prepared reports to present the results.
Achievements
- Awarded with 'Ubharta Sitara' award for consistent performance.
- Awarded with 'Team awesome' for high impact created on multiple clients.
- Awarded with “Shining Star” award for consistent performance.
- Honored with the “Team awesome” for creating a significant impact across multiple clients.
- Mentored 4-5 junior team members during onboarding, providing feedback through code and design reviews to support their growth at ZS.
- Organized monthly networking and recreational activities to foster team collaboration.
- Served as President of the Alumni Meet Society at college, successfully organized the Alumni Meet 2020.
Education
Bachelor of Technology in Computer Science Engineering
Maharaja Agrasen Institute of Technology (GGSIPU) (2022)
Certifications
The ultimate mysql bootcamp: go from sql beginner to expert
Databricks certified associate developer - apache spark 2022
Tableau a-z: hands-on tableau training for data science
Ultimate aws certified cloud practitioner clf-c02