Maintained and managed the Priviledged Activity Monitoring framework using Airflow, Docker and the ELK Stack. Integrated Airflow with various data sources and platforms, including databases, cloud services, and external APIs, to enable seamless data integration and transformation. Developed monitoring and logging solutions to track task execution, performance metrics and workflow status. Configured Logstash pipelines and Filebeat agents for data ingestion from various sources, including log files, databases, ensuring proper parsing and transformation of data. Created Kibana visualizations and dashboards to provide real-time insights into log data, system performance, and critical metrics. Led the data migration efforts from Opendistro Elasticsearch to AWS Opensearch using Amazon S3. Led the design and implementation for a Disaster Recovery strategy for Priviledged Activity Monitoring Systems. Designed and implemented the User Interface for Change Data Capture of Table Level Data. Integrated the User Interface with Python and Elasticsearch.

Implemented a proof-of-concept DLP solution demonstrating the ability to identify and classify sensitive logs for a system. Build a command line utility using Python to scan and parse through the system logs, classify and dump them into SQLite database.