profile-pic

Sonali Majumdar

Results-driven data engineer with a meticulous attention to detail, adept at comprehending data requirements and executing end-to-end data pipelines. Collaborative and adaptable, I thrive in agile environments, working seamlessly with cross-functional teams to deliver impactful solutions in the realm of big data. My passion lies in tackling complex problems head-on, employing critical thinking and problem-solving skills. I possess a strong aptitude for quickly grasping new processes and technologies, coupled with a keen eye for reviewing, optimizing, and ne-tuning performance. As a self-motivated professional, I exhibit exemplary organizational and time management abilities. My areas of interests include Big Data, Cloud Systems, Data Engineering, Data Cleaning, Analytics, Data Science, and Data Modeling.

  • Role

    Senior Data Engineer

  • Years of Experience

    7 years

Skillsets

  • S3
  • NO SQL
  • Mongo DB
  • ETL
  • Debugging
  • NO SQL
  • SQL
  • Python
  • NO SQL - 1 Years
  • Etl (extract transform load)
  • SQL - 5 Years
  • Spark
  • Shell Scripting
  • AWS - 2 Years
  • Python - 2 Years
  • Postgre SQL
  • Mongo DB
  • Kafka
  • Hive
  • Hadoop
  • ETL - 5 Years
  • Design
  • Debugging
  • Data warehouse
  • Data Modelling

Professional Summary

7Years
  • Jan, 2022 - Present3 yr 10 months

    Senior Data Engineer

    Go Digit General Insurance
  • Jul, 2018 - Jan, 20223 yr 6 months

    Application Development Engineer

    Numerify (Now Digital.ai)
  • Jul, 2017 - Aug, 2017 1 month

    Intern

    Bharat Electronics Limited

Applications & Tools Known

  • icon-tool

    PL/SQL

  • icon-tool

    AWS DMS

  • icon-tool

    AWS S3

  • icon-tool

    EMR

  • icon-tool

    Spark

  • icon-tool

    Hive

  • icon-tool

    Sqoop

  • icon-tool

    Bash

  • icon-tool

    SQL

  • icon-tool

    Python

  • icon-tool

    MongoDB

  • icon-tool

    AWS Lambda

  • icon-tool

    Kafka

  • icon-tool

    Swift UI

  • icon-tool

    PostgreSQL

  • icon-tool

    Hadoop

Work History

7Years

Senior Data Engineer

Go Digit General Insurance
Jan, 2022 - Present3 yr 10 months
    Implemented solutions for targeted strategies to maximize customer engagement and drive sales performance by marketing and sales teams using PL/SQL ETL pipelines. Optimized and fine-tuned existing pipelines for faster and more efficient data delivery, enhancing overall performance and productivity by 83.3% for marketing communications, using PL/SQL procedure, AWS DMS. Implemented scaled out solutions which increased the business efficiency by more than 50% in submission of regulatory reports using big data tools such as AWS S3 , EMR with spark cluster, hive, sqoop, bash and SQL. Enabled campaign reachability and efficiency by creating data pipeline to process the data in batches on daily basis empowering visualization of the customer engagement for management using Python and MongoDB. Performed debugging and root cause analysis on production issues. Designed and deployed real-time solution leveraging logs empowering business to view actionable insights in realtime using Python, AWS Lambda and Kafka. Involved in designing and architecturing solutions alongwith cross functional collaborations.

Application Development Engineer

Numerify (Now Digital.ai)
Jul, 2018 - Jan, 20223 yr 6 months
    Conducted Source system analysis on agile specific sources like CI/CD pipelines, SDLC and source code management, performed Data Modelling for warehouse. Designed and Implemented highly complex data pipelines from scratch after analyzing in depth source data behavior ensuring various data scenarios are handled by the pipeline using PL/SQL. Optimized and fine-tuning of data pipelines for reducing data flow time for huge volume of data by 30%. Involved in Dashboard design and creation which involved blending of various unrelated data cubes along with QA support in testing data quality.

Intern

Bharat Electronics Limited
Jul, 2017 - Aug, 2017 1 month
    Developed a central UI for a radar system using swift UI and socket communication in Java enabling communication with its components along with other interns in a team.

Achievements

  • Received 2nd position in the batch with a grade of 9.47 CGPA

Major Projects

1Projects

Central UI for radar system

Jul, 2017 - Aug, 2017 1 month
    Developed a central UI for a radar system using swift UI and socket communication in Java enabling communication with its components along with other interns in a team.

Education

  • B.E. in Computer Science

    Nitte Meenakshi Institute of Technology (2018)