profile-pic

Nitin Venkatesh

Experienced with 5+ years in SQL Server, PostgreSQL, Snowflake and AWS Services, Proficient in designing storage objects, developing pipelines, and executing analytical queries, Skilled in ETL with AWS Glue, PySpark, and SQL Server Integration Services. Extensive experience in implementing Data Lake and Data Warehousing solutions using AWS services, ensuring efficient large-scale data migration and processing with minimal impact on production systems.
  • Role

    Senior Consultant, SC-L1: Data and AI

  • Years of Experience

    9.9 years

Skillsets

  • Datadog
  • SQL Query Optimization
  • Spark SQL
  • PostgreSQL
  • CloudWatch
  • Big Data
  • Azure
  • AWS Lambda
  • Quick sight
  • SQS
  • SNS
  • Jira
  • Github
  • Event Bridge
  • AWS Glue
  • Databricks
  • Confluence
  • Athena
  • Airflow
  • SQL Server - 5 Years
  • Snowflake - 5.0 Years
  • S3
  • Python
  • PySpark
  • ETL - 6.0 Years
  • Data Warehousing
  • Data lake
  • AWS Services

Professional Summary

9.9Years
  • Jul, 2023 - Present2 yr 11 months

    Senior Data Engineer

    Emids

  • Senior Consultant SC L1: Data and AI

    Emids
  • Jul, 2021 - Jul, 20232 yr

    Software Engineer

    Excelsoft Technologies
  • Dec, 2018 - Nov, 2019 11 months

    Trainee Software Engineer

    Excelsoft Technologies
  • Dec, 2019 - Jun, 20211 yr 6 months

    Associate Software Engineer

    Excelsoft Technologies

Applications & Tools Known

  • icon-tool

    Confluence

  • icon-tool

    Jira

  • icon-tool

    GitHub

  • icon-tool

    SQL Server Profiler

  • icon-tool

    SSMS

  • icon-tool

    Jupyter

  • icon-tool

    PyCharm

  • icon-tool

    Visual Studio Code

Work History

9.9Years

Senior Data Engineer

Emids
Jul, 2023 - Present2 yr 11 months

Senior Consultant SC L1: Data and AI

Emids
    Interacting with clients to gather requirements, creating data frames, transforming logic using PySpark, scheduling notebooks, processing structured/unstructured files, monitoring Airflow jobs, debugging job logs, and validating batch file counts in Databricks.

Software Engineer

Excelsoft Technologies
Jul, 2021 - Jul, 20232 yr

Associate Software Engineer

Excelsoft Technologies
Dec, 2019 - Jun, 20211 yr 6 months

Trainee Software Engineer

Excelsoft Technologies
Dec, 2018 - Nov, 2019 11 months
    Analyzing functional requirements, writing complex T-SQL and PL-PGSQL code, querying XML/JSON data, index design and implementation, optimizing queries, ETL/ELT packages, data migration, and resolving database issues.

Achievements

  • Received Pat on Back 2020-2021 award, for providing quicker and reliable solutions for critical problems and being a great team contributor.

Major Projects

5Projects

APIXIO

Jul, 2023 - Present2 yr 11 months
    Working with structured/unstructured files in S3, transforming and processing them in Databricks Delta table with Airflow DAG jobs, monitoring Airflow jobs, debugging logs, validating batch files, and executing scheduled tasks.

Uprise Health

Jul, 2023 - Jun, 2024 11 months
    Managing AWS Aurora database infrastructures, reverse engineering complex views, building EDW systems, automating data load, ingesting data into EDW, resolving database issues, and documenting functionality.

SEIU 775 Benefits Group

Nov, 2022 - Jul, 2023 8 months
    Creating tables, stored procedures, views, monitoring Dell Boomi data pipelines, and performing ETL using Lambda functions for S3 and Snowflake Datawarehouse.

Marketron

Nov, 2019 - Oct, 20222 yr 11 months
    Interacting with clients, analyzing database objects, implementing T-SQL and PL-PGSQL code, creating ETL/ELT packages, S3 file manipulation, and migrating data across databases.

Pearson

Dec, 2018 - Nov, 2019 11 months
    Developing complex SQL queries, resolving database issues, implementing ETL packages, and optimizing query performance through index design and statistics analysis.

Education

  • B.E

    Visvesvaraya Technological University (2018)