profile-pic

Ayushi Gupta

I'm a passionate Data Engineer with over 3 years of hands-on experience specializing in building efficient data pipelines. My journey has equipped me with a solid command of Python for scripting, a deep understanding of AWS infrastructure, and expertise in using Git for version control. I'm proud to be a certified AWS Cloud Practitioner, further underpinning my cloud technology skills.

I'm all about merging data prowess with DevOps strategies to deploy impeccable data pipelines, and I'm particularly skilled in orchestrating workflows using Apache Airflow. My background includes successfully deploying pipelines within AWS EKS clusters, ensuring top-notch performance and integration.

A significant part of my expertise lies in loading data into Snowflake data warehouse. This experience has refined my grasp of data warehousing concepts, enabling me to optimize data loading processes for speed and precision.

I'm passionate about keeping up with the rapidly evolving data landscape and actively seek opportunities to enhance my skills. Collaboration is where I thrive – I enjoy being part of teams where I can contribute my technical skills to solve complex data challenges and drive organizational growth.

  • Role

    Software Engineer II & Bash Developer

  • Years of Experience

    4 years

Skillsets

  • ETL
  • SQL
  • Spark
  • Snowflake
  • Python
  • Machine Learning
  • Linux
  • Kubernetes
  • Hadoop
  • Github
  • GCP
  • Airflow
  • Docker
  • Datawarehousing
  • Cloud Services
  • C
  • Bitbucket
  • Big Data
  • Bash
  • AWS
  • Alteryx

Professional Summary

4Years
  • Jun, 2022 - Present3 yr 5 months

    Software Engineer II

    Cisco
  • Aug, 2021 - Jun, 2022 10 months

    Software Engineer

    Happiest Minds Technologies

Work History

4Years

Software Engineer II

Cisco
Jun, 2022 - Present3 yr 5 months
    Implemented CI/CD automation framework to streamline product delivery, ensuring efficient and reliable code deliverables. Led the design and integration of automation processes, utilizing Python, PySpark, SQL, Database, AWS, and Git to optimize the delivery pipeline, reducing manual intervention by 40% and optimizing delivery pipelines. Developed and enhanced the show tech support feature to facilitate comprehensive log collection across diverse software processes within the routers application software, improving diagnostic efficiency by 25%. Enhanced the shelfmgr feature, implementing code changes to establish a common codebase across different platform variants. Focused on bug fixing and resolution, conducting root cause analysis to address critical issues, reducing unnecessary alarms. Deepened expertise in automation, Python, SQL, Datawarehouse, AWS, PySpark, and database management. Gained experience in networking features and C programming.

Software Engineer

Happiest Minds Technologies
Aug, 2021 - Jun, 2022 10 months
    Implemented Python-based ETL pipelines for data extraction from OLTP platforms including SQL servers and AWS services (Cognito, DynamoDB). Managed multi-stage data flow within the ETL process: loading extracted data into Amazon S3, routing it through SQS to OLAP systems like Snowflake. Leveraged Snowflake's landing, staging, and final tables to deliver insights and data to clients. Orchestrated ETL workflows within a Kubernetes cluster using Airflow Kubernetes pod operator to enhance reliability and scalability. Proficient in designing ETL pipelines, working with data warehouses like Snowflake, and cloud services including DynamoDB, Cognito, S3, SQS, KMS, IAM, and Glue. Experienced in advanced data workflow orchestration with Airflow.

Major Projects

1Projects

Recommender System

Jan, 2021 - Jan, 2021
    Developed a tool using machine learning models and word/sentence embedding techniques to analyze user behavior and preferences for accurate recommendations. Designed a recommender system using the Rasa Python framework, ensuring seamless integration using Docker for deployment and scalability.

Education

  • Master of Computer Application

    Jawaharlal Nehru University (2021)