Design ingestion architecture for various data sources into Google Cloud Platform. Develop stored procedures, tables(Partition , cluster , external tables) and optimize queries in BigQuery. Encrypted Personally Identifiable Information (PII) columns according to business rules. Design data pipeline orchestration using Google Cloud Composer. Migration of Airflow Directed Acyclic Graphs (DAGs) to GCP Workflows. Led data migration from Hong Kong to the Europe region in BigQuery. Migration of Customize CICD pipeline to Terraform CI/CD pipeline and GCP source repository to GitHub repo along with cloud build triggers.

Migration of Netezza DWH to BigQuery. Migration of Datastage ETL to Cloud composer (Airflow DAG). Analyzed the existing Datastage ETL flow and Netezza DWH. Created stored procedures ,tables and optimized queries on Big Query. Created optimized DAGs on Cloud Composer (Airflow) as per the requirements and design of Datastage ETL pipeline. Performed testing of DAGs to achieve desired results. Mentored people in my team to be better at Big Query concepts and Airflow.

Requirement analysis from business analysts or end users. Create design and represent it to business analysts. Create PL/SQL code (Procedure , Functions ,Triggers, Tables, View ..). Unit and User acceptance testing on created modules. Production deployment of code. (Clear case migration ). Create SQL queries and deploy in the OBIEE reporting tool.