Data Engineer with 5 years of IT industry experience with technical skills in the full development life cycle of software applications including requirement gathering, architecture design, and project planning. Managing the execution of the project from development to production release and maintaining production releases.
Have been responsible for the design and development of multiple applications involving data integration from ~10 Operational Data stores to Enterprise Data Warehouse while applying business logic and requirements.
Good working knowledge of NoSQL database for MongoDB and HBase.
Good coding skills in Python,Pyspark,DBT and SQL. Good understanding of algorithms and implementation of the same efficiently. Have basic knowledge of AWS and AZURE cloud services. Worked on Sqoop, Flume, RedShift, S3, EMR, etc.
Experienced in ingesting data from multiple data sources and deriving meaningful insights.
Senior Data Engineer (Assistant Manager)
GenpactJupyter
pyCharm
Jira
Bitbucket
Spark
Hive
Hadoop
Apache
Databricks
Data Lake
Microsoft Azure
MySQL
PostgreSQL
MongoDB
Redshift
RDS
CosmosDB
MS Excel