Tushar Singhal
9+ years in Data engineering with expertise in building large-scale distributed systems, including data platforms and modernizing data systems. Recently focused on developing a high-scale dynamic Data Ingestion Platform at Intuit. Skilled in creating data products for the retail and finance industries, ensuring data compliance and governance. Experienced in technical optimizations and performance tuning for large-scale data pipelines, enhancing response times and ensuring timely data delivery.
- Role
Data Engineer II
- Years of Experience
9 years
- Professional Portfolio
View here
Skillsets
- Oracle
- Airflow
- CICD
- Data Pipelines
- Delta Lake
- dimensional data modeling
- Docker
- Kafka
- Kubernetes
- MySQL
- OOPs
- Git
- Postgres
- Problem Solving
- Project Planning
- RDBMS
- Scrum Master
- Spark Core
- Spark Streaming
- Splunk
- SQL
- Star/snowflake schema design
- AWS Cloud
- Hadoop - 9 Years
- Jenkins
- Git
- DynamoDB
- Ansible
- Lambda
- EC2
- Scala
- Maven
- Hive
- Python
- S3
- HDFS
- EMR
- Data warehouse
- Oozie
- YARN
- distributed data platforms
- Data lake
- IntelliJ
Professional Summary
9Years
- Jul, 2021 - Present4 yr 6 months
Data Engineer II
Intuit India Technology Service LLP Ltd - Apr, 2019 - Jul, 20212 yr 3 months
Specialist Software Engineer
Societe Generale Global Solution Centre - Dec, 2017 - Apr, 20191 yr 4 months
Data Engineer
Target Corporation India - Aug, 2015 - Dec, 20172 yr 4 months
Big Data Engineer
Tata Consultancy Services
Applications & Tools Known
Spark
Hadoop
Scala
Python
Java
Hive
Impala
Oozie
Yarn
HDFS
AWS Cloud
S3
EC2
Lambda
EMR
DynamoDB
Git
Maven
Intellij
.png)
Jenkins
Ansible
Spring Boot
Maven
Work History
9Years
Data Engineer II
Intuit India Technology Service LLP LtdJul, 2021 - Present4 yr 6 months
Centralized Ingestion Platform accommodating 200+ company-wide finance data pipelines processing ~5B events daily. Built robust data ingestion products leveraging AWS EMR, Spark, and Scala. Enhanced data compliance standards to meet CCPA regulations.
Specialist Software Engineer
Societe Generale Global Solution CentreApr, 2019 - Jul, 20212 yr 3 months
Orchestrated data collection from diverse sources for regulatory reporting using Spark and Scala. Automated reporting tools and enforced data compliance standards like GDPR. Improved team efficiency using automation solutions.
Data Engineer
Target Corporation IndiaDec, 2017 - Apr, 20191 yr 4 months
Analyzed web sales datasets to enhance customer experience using technologies like Hive and Spark. Built and modernized data ingestion systems for high-volume datasets. Conducted proof-of-concept projects using Elasticsearch.
Big Data Engineer
Tata Consultancy ServicesAug, 2015 - Dec, 20172 yr 4 months
Designed and built data processing products for large-scale datasets. Developed a SQL-to-Spark adaptor framework improving development time. Built data lakes with processed clean data for consumers.
Achievements
- Stronger Together x 11 2021 - 2024
- Customer Obsession x 5 2021 - 2024
- Excellence in Innovation April 2019
- Pyramid Award April 2018
- Quick TurnAround January 2017
- Stronger Together x 11 2021 - 2024 Intuit
- Customer Obsession x 5 2021 - 2024 Intuit
- Excellence in Innovation April 2019 Societe Generale
- Pyramid Award April 2018 Target Corporation
- Quick TurnAround January 2017 Tata Consultancy Services
Major Projects
2Projects
RESOURCE EFFICIENT PARTIAL BOOTSTRAP 2413120US
May, 2024 - Present1 yr 7 months
This patent addresses the issue of data inconsistency between source and destination in highly transactional datasets. It offers an efficient method to compare and resolve data discrepancies, ensuring synchronization between the source and destination datasets.
RESOURCE EFFICIENT PARTIAL BOOTSTRAP
May, 2024 - Present1 yr 7 months
This patent addresses the issue of data inconsistency in highly transactional datasets. It offers a method to compare and resolve discrepancies, ensuring synchronization between source and destination datasets.
Education
B. Tech Information Technology
(2015)
Certifications
Mapr certified hadoop developer march 2016
Oracle certified java professional november 2016