Harman Singh Waraich

Set up Azure Elastic Cloud for a 12-node cluster for 8TB search data. Designed and optimized cluster architecture for performance and scalability. Developed data pipelines for multiple countries using Logstash for analytics and search. Created .Net APIs for advanced search, filters, auto-complete, and suggestion capabilities. Implemented monitoring solutions using Elastic Agents and Fleet Server. Integrated Elastic APM and Elastic RUM for distributed tracing and real-time performance metrics. Automated data transformation and ingestion pipelines using Python scripts and cron jobs.

Led end-to-end development of a Docker-based 4-node Elasticsearch cluster for search. Designed and optimized cluster architecture. Built fast, scalable search features across backend Node.js APIs. Created APIs for advanced search capabilities including similar employees, similar companies, and suggestion-based queries. Implemented Semantic Search using vector embedding and synonym analysers. Integrated Elastic APM with Node.js backend services. Exported APM data to Grafana and Elasticsearch. Implemented monitoring and alerting solutions using Kibana, Grafana Alerting, Metricbeat, and Auditbeat. Automated data transformation and ingestion pipelines using Python scripts and cron jobs.

Collaborated on the development of an Elasticsearch-based search engine for Digi-Key Electronics. Utilized Python Elasticsearch Client API to interact with Elasticsearch. Implemented enhancements to APIs for search, products, category, and suggestion. Enhanced index templates to improve analyzers and tokenizers. Ensured code quality using SonarQube. Implemented monitoring and alerting solutions using Datadog and Grafana. Leveraged ActiveBatch for task automation. Managed Elasticsearch clusters using Rancher.

Setup Elasticsearch clusters and Kibana/Logstash servers for large data volumes. Developed parsers in Logstash and created dashboards for transactional data. Automated client ad-hoc requests and created dashboards. Integrated Elastic Stack with Confluent, AWS S3, and Fluentd. SAML integration and Active Directory setup. Troubleshooting and cluster upgrades using Ansible. Linux scripting and crontab for job scheduling. Data snapshot using shared file system and Azure Blob Storage.

Setup Elasticsearch cluster with Kibana and Logstash server. Converted client data using Python code. Data ingestion to Elasticsearch and dashboard creation on Kibana. Database updates using MySQL CRUD queries and dashboard creation.