profile-pic

Piyush Mishra

Piyush Mishra

8.4 years of diverse experience in Data Engineering field, including Development, and Implementation of various applications in big data and EDW environments.
  • Role

    Senior Data Engineer

  • Years of Experience

    9 years

Skillsets

  • Data Analysis
  • Data Science
  • Data Warehousing
  • ETL
  • Agile/Scrum
  • Data Modeling
  • Data Engineering
  • Python - 5.0 Years
  • Hive - 6 Years
  • Snowflake - 2 Years
  • SQL - 8.0 Years
  • Hadoop - 6 Years
  • ETL processes - 8 Years
  • BigQuery - 3.0 Years
  • PostgreSQL - 2 Years
  • Apache Spark - 7.0 Years

Professional Summary

9Years
  • Oct, 2022 - Present2 yr 6 months

    Senior Data Engineer

    Harman Connected Services
  • May, 2021 - Oct, 20221 yr 5 months

    Senior Data Engineer

    IBM India Pvt. Ltd.
  • Oct, 2020 - Apr, 2021 6 months

    Senior Data Engineer

    TEKsystems India
  • Jan, 2016 - Jan, 20193 yr

    Associate Engineer

    Virtusa Software Services Pvt. Ltd.
  • Jan, 2019 - Oct, 20201 yr 9 months

    Senior Developer - Data Engineering

    Mu Sigma Business Solutions

Applications & Tools Known

  • icon-tool

    Hadoop

  • icon-tool

    Spark

  • icon-tool

    Sqoop

  • icon-tool

    Kafka

  • icon-tool

    Airflow

  • icon-tool

    Git

  • icon-tool

    Druid

  • icon-tool

    PostgreSQL

  • icon-tool

    Oracle

  • icon-tool

    SQL Server

  • icon-tool

    Hive

  • icon-tool

    Cassandra

  • icon-tool

    MongoDB

  • icon-tool

    HDFS

  • icon-tool

    OpenShift

  • icon-tool

    Oozie

  • icon-tool

    Control M

Work History

9Years

Senior Data Engineer

Harman Connected Services
Oct, 2022 - Present2 yr 6 months

Senior Data Engineer

IBM India Pvt. Ltd.
May, 2021 - Oct, 20221 yr 5 months

Senior Data Engineer

TEKsystems India
Oct, 2020 - Apr, 2021 6 months

Senior Developer - Data Engineering

Mu Sigma Business Solutions
Jan, 2019 - Oct, 20201 yr 9 months

Associate Engineer

Virtusa Software Services Pvt. Ltd.
Jan, 2016 - Jan, 20193 yr

Major Projects

6Projects

Lowes DACI Marketing Pro-Loyalty

    Lowe s spends between $700-$800 million every year on marketing, making it the second largest expense in the company. Given the large amount spent, its crucial for Lowe s to spend the money in the optimal way to drive sales, margin, and traffic. The DACI-Marketing team helps support this by Pro Loyalty Data Feeds Providing insights, and data feeds to support partner team scorecards and marketing initiatives that track overall performance for the Pro Loyalty program.

Treasury Data Services - Barclays

    TDS is the micro service-based application which serves as a data lake for the liquidity area of Barclays. The solution is an E2E data lake solution, having NiFi for ingestion, with data cataloguing and data transformation cloud native services built on internal OpenShift based cloud.

VISA Issuer Processing- Forward Data Processing

    Visa Issuer Processing focuses on building and deploying innovative solutions to enable and secure Visa transactions, connecting directly with the networks and issuing banks to provide the system of record, manage issuance of cards, authorize transactions, and communicate with settlement entities around the globe.

GM GCCX - OnStar

    OnStar provides a critical piece of the connected car equation with its ability to seamlessly link customers, vehicles and vehicle services.

BT-CMF SIM And RA+ EUGDPR

    CMF-SIM enriches the raw customer information into the BT hierarchical model and ensures the legacy and strategic BT systems are in sync.

Nyl Finance Transformation

    The goal of the financial transformation initiative is to create an integrated financial landscape to seamlessly integrate NYL s systems and processes.

Education

  • BTech in Information Technology

    Kamla Nehru Institute of Technology (KNIT)