Taroon Kumar Ray

Achieved 70% faster data delivery by revamping data architecture for near real-time processing using AWS DMS. Optimized job efficiency in Bronze and Silver layers utilizing EMR Serverless and Spark Streaming. Unified data platform by implementing Iceberg tables and leveraging Athena for business transformation. Automated orchestration of Glue jobs through Airflow and developed a Dapr Consumer Client to trigger jobs via Kafka topics. Enhanced customer experience by integrating Looker insights into products and implemented fine-grained access control via Lakeformation. Collaborated with cross-functional teams to gather requirements and deliver customized data solutions.

Optimized ETL tasks using Snowflake's dynamic tools, including Snowstream and Materialized Views. Developed HouseKeeping solutions in Python to roll data into S3, utilizing AWS SNS and SQS for messaging. Automated error notifications by implementing Slack alerts via Dagster. Extracted data from diverse sources like Jira and Amplitude using Fivetran. Ensured data integrity by executing Dagster validation jobs and creating transformation models with dbt. Applied Zero Copy Cloning in Snowflake for effective internal database testing. Enhanced performance by optimizing server queries to reduce system load.

Reduced manual effort by 90% by creating custom Airflow plugins and introducing new automation features. Led strategy for scalability and accuracy of data pipelines while managing the design of new data models. Advanced 100% cloud architecture by onboarding legacy supplier data into Cloud Space using AWS Glue and PySpark. Facilitated business continuity by migrating legacy systems to modern cloud platforms with Data Vault 2.0 modeling. Maintained quality standards through rigorous code reviews and used AWS Lambda for effective metadata registration. Resolved customer issues with knowledgeable service to promote high satisfaction levels.

Managed data migration from Oracle to AWS Aurora and mitigated performance bottlenecks during the transition to PostgreSQL. Optimized ETL processes and developed data models to support complex reporting and analytical needs. Resolved business functionality bugs and implemented new requirements and enhancements.

Achieved 99% data accuracy by constructing models and marts using dbt with rigorous testing protocols. Met 100% of SLA requirements for business reports by building end-to-end pipelines with Glue and PySpark. Enhanced BI functionality by designing engineering pipelines for Retail databases. Built custom extractors for Retail databases (orchestrated via Airflow) and REST APIs with ORDS to integrate vendors like Cybersource and UPS. Streamlined order processing by executing OMS and OB systems for the Intermix Brand.

Engineered user monitoring and automated solutions to streamline manual tasks beyond Guardium's native capabilities. Analyzed Guardium data in Oracle DB to provide actionable insights for both operational and business teams. Optimized efficiency using Python multi-threading and SQL across Oracle and SQL Server databases. Created alert systems for STAP restarts to notify Operations Teams of potential issues. Collaborated with Project Management to maintain whitelist tables for user exceptions.

Managed ETL performance by monitoring weekly/monthly jobs and resolving issues using PROC SQL and PROC SORT. Developed Linux/UNIX scripts to meet evolving client needs and data processing tasks using Oracle and SAS.