profile-pic

Sonali Majumdar

Results-driven data engineer with a meticulous attention to detail, adept at comprehending data requirements and executing end-to-end data pipelines. Collaborative and adaptable, I thrive in agile environments, working seamlessly with cross-functional teams to deliver impactful solutions in the realm of big data. My passion lies in tackling complex problems head-on, employing critical thinking and problem-solving skills. I possess a strong aptitude for quickly grasping new processes and technologies, coupled with a keen eye for reviewing, optimizing, and ne-tuning performance. As a self-motivated professional, I exhibit exemplary organizational and time management abilities. My areas of interests include Big Data, Cloud Systems, Data Engineering, Data Cleaning, Analytics, Data Science, and Data Modeling.

  • Role

    Senior Data Engineer

  • Years of Experience

    7.7 years

Skillsets

  • S3
  • NO SQL
  • Mongo DB
  • ETL
  • Debugging
  • NO SQL
  • SQL
  • Python
  • NO SQL - 1 Years
  • Etl (extract transform load)
  • SQL - 5 Years
  • Spark
  • Shell Scripting
  • AWS - 2 Years
  • Python - 2 Years
  • Postgre SQL
  • Mongo DB
  • Kafka
  • Hive
  • Hadoop
  • ETL - 5 Years
  • Design
  • Debugging
  • Data warehouse
  • Data Modelling

Professional Summary

7.7Years
  • Nov, 2024 - Present1 yr 8 months

    Senior Member of Technical Staff

    Oracle
  • Jun, 2023 - Nov, 20241 yr 5 months

    Senior Data Engineer

    Digit Insurance
  • Jan, 2022 - Jun, 20231 yr 5 months

    Data Engineer

    Digit Insurance
  • Jul, 2018 - Nov, 20202 yr 4 months

    Associate Application Development Engineer

    Numerify (now Digital.ai)
  • Dec, 2020 - Mar, 2021 3 months

    Application Development Engineer

    Numerify (now Digital.ai)
  • Apr, 2021 - Jan, 2022 9 months

    Applications Development Engineer

    Digital.ai
  • Jul, 2017 - Aug, 2017 1 month

    Intern

    Bharat Electronics Limited

Applications & Tools Known

  • icon-tool

    PL/SQL

  • icon-tool

    AWS DMS

  • icon-tool

    AWS S3

  • icon-tool

    EMR

  • icon-tool

    Spark

  • icon-tool

    Hive

  • icon-tool

    Sqoop

  • icon-tool

    Bash

  • icon-tool

    SQL

  • icon-tool

    Python

  • icon-tool

    MongoDB

  • icon-tool

    AWS Lambda

  • icon-tool

    Kafka

  • icon-tool

    Swift UI

  • icon-tool

    PostgreSQL

  • icon-tool

    Hadoop

Work History

7.7Years

Senior Member of Technical Staff

Oracle
Nov, 2024 - Present1 yr 8 months

Senior Data Engineer

Digit Insurance
Jun, 2023 - Nov, 20241 yr 5 months

Data Engineer

Digit Insurance
Jan, 2022 - Jun, 20231 yr 5 months
    Implemented solutions for targeted strategies to maximize customer engagement and drive sales performance by marketing and sales teams using PL/SQL ETL pipelines. Optimized and fine-tuned existing pipelines for faster and more efficient data delivery, enhancing overall performance and productivity by 83.3% for marketing communications, using PL/SQL procedure, AWS DMS. Implemented scaled out solutions which increased the business efficiency by more than 50% in submission of regulatory reports using big data tools such as AWS S3 , EMR with spark cluster, hive, sqoop, bash and SQL. Enabled campaign reachability and efficiency by creating data pipeline to process the data in batches on daily basis empowering visualization of the customer engagement for management using Python and MongoDB. Performed debugging and root cause analysis on production issues. Designed and deployed real-time solution leveraging logs empowering business to view actionable insights in realtime using Python, AWS Lambda and Kafka. Involved in designing and architecturing solutions alongwith cross functional collaborations.

Applications Development Engineer

Digital.ai
Apr, 2021 - Jan, 2022 9 months

Application Development Engineer

Numerify (now Digital.ai)
Dec, 2020 - Mar, 2021 3 months

Associate Application Development Engineer

Numerify (now Digital.ai)
Jul, 2018 - Nov, 20202 yr 4 months
    Conducted Source system analysis on agile specific sources like CI/CD pipelines, SDLC and source code management, performed Data Modelling for warehouse. Designed and Implemented highly complex data pipelines from scratch after analyzing in depth source data behavior ensuring various data scenarios are handled by the pipeline using PL/SQL. Optimized and fine-tuning of data pipelines for reducing data flow time for huge volume of data by 30%. Involved in Dashboard design and creation which involved blending of various unrelated data cubes along with QA support in testing data quality.

Intern

Bharat Electronics Limited
Jul, 2017 - Aug, 2017 1 month
    Developed a central UI for a radar system using swift UI and socket communication in Java enabling communication with its components along with other interns in a team.

Achievements

  • Received 2nd position in the batch with a grade of 9.47 CGPA

Major Projects

1Projects

Central UI for radar system

Jul, 2017 - Aug, 2017 1 month
    Developed a central UI for a radar system using swift UI and socket communication in Java enabling communication with its components along with other interns in a team.

Education

  • B.E. in Computer Science

    Nitte Meenakshi Institute of Technology (2018)