Nitin Venkatesh
Experienced with 5+ years in SQL Server, PostgreSQL, Snowflake and AWS Services, Proficient in designing storage objects, developing pipelines, and executing analytical queries, Skilled in ETL with AWS Glue, PySpark, and SQL Server Integration Services. Extensive experience in implementing Data Lake and Data Warehousing solutions using AWS services, ensuring efficient large-scale data migration and processing with minimal impact on production systems.
- Role
Senior Software Engineer
- Years of Experience
6.6 years
Skillsets
- Datadog
- SQL Query Optimization
- Spark SQL
- PostgreSQL
- CloudWatch
- Big Data
- Azure
- AWS Lambda
- Quick sight
- SQS
- SNS
- Jira
- Github
- Event Bridge
- AWS Glue
- Databricks
- Confluence
- Athena
- Airflow
- SQL Server - 5 Years
- Snowflake - 5.0 Years
- S3
- Python
- PySpark
- ETL - 6.0 Years
- Data Warehousing
- Data lake
- AWS Services
Professional Summary
6.6Years
- Jul, 2023 - Present2 yr 2 months
Senior Software Engineer
EMIDS PVT LTD - Nov, 2022 - Jul, 2023 8 months
Software Engineer
Excel Soft TECHNOLOGY PVT LTD - Nov, 2019 - Oct, 20222 yr 11 months
Software Engineer
Marketron - Dec, 2018 - Nov, 2019 11 months
Associate Software Engineer
Pearson
Applications & Tools Known
Confluence
Jira
GitHub
SQL Server Profiler
SSMS
Jupyter
PyCharm
Visual Studio Code
Work History
6.6Years
Senior Software Engineer
EMIDS PVT LTDJul, 2023 - Present2 yr 2 months
Interacting with clients to gather requirements, creating data frames, transforming logic using PySpark, scheduling notebooks, processing structured/unstructured files, monitoring Airflow jobs, debugging job logs, and validating batch file counts in Databricks.
Software Engineer
Excel Soft TECHNOLOGY PVT LTDNov, 2022 - Jul, 2023 8 months
Creating tables, procedures, views, monitoring and correcting data, reprocessing data in Dell Boomi, creating Lambda functions, and working with Snowflake Datawarehouse.
Software Engineer
MarketronNov, 2019 - Oct, 20222 yr 11 months
Client interaction for business requirements, analysis of database objects, implementing scalable database solutions, writing advanced SQL/PL-PGSQL code, ETL/ELT packages, S3 file manipulation, and migrating from various databases.
Associate Software Engineer
PearsonDec, 2018 - Nov, 2019 11 months
Analyzing functional requirements, writing complex T-SQL and PL-PGSQL code, querying XML/JSON data, index design and implementation, optimizing queries, ETL/ELT packages, data migration, and resolving database issues.
Achievements
- Received Pat on Back 2020-2021 award, for providing quicker and reliable solutions for critical problems and being a great team contributor.
Major Projects
5Projects
APIXIO
Jul, 2023 - Present2 yr 2 months
Working with structured/unstructured files in S3, transforming and processing them in Databricks Delta table with Airflow DAG jobs, monitoring Airflow jobs, debugging logs, validating batch files, and executing scheduled tasks.
Uprise Health
Jul, 2023 - Jun, 2024 11 months
Managing AWS Aurora database infrastructures, reverse engineering complex views, building EDW systems, automating data load, ingesting data into EDW, resolving database issues, and documenting functionality.
SEIU 775 Benefits Group
Nov, 2022 - Jul, 2023 8 months
Creating tables, stored procedures, views, monitoring Dell Boomi data pipelines, and performing ETL using Lambda functions for S3 and Snowflake Datawarehouse.
Marketron
Nov, 2019 - Oct, 20222 yr 11 months
Interacting with clients, analyzing database objects, implementing T-SQL and PL-PGSQL code, creating ETL/ELT packages, S3 file manipulation, and migrating data across databases.
Pearson
Dec, 2018 - Nov, 2019 11 months
Developing complex SQL queries, resolving database issues, implementing ETL packages, and optimizing query performance through index design and statistics analysis.
Education
B.E
Visvesvaraya Technological University (2018)