Big Data Developer
• Total experience: 8+ years of experience in software design and development with Hadoop, Spark, Scala, Microsoft Azure (Eventhub, Azure HDInsight, Azure AppInsight, Key-vault, BlobStorage, Cosmos DB), Jenkins, Hive
• Experience in building low latency data pipeline using spark streaming
• Worked on various phases of Product Development Life Cycle in variety of technical areas like design, development, production Support.
• Worked in programming languages - Java, Scala and shell scripting.
• Worked on ETL side to extract, transform, load data.
• Worked on GIT Repository to maintain the code.
• Explored the Azure services like Appinsight, key-vault, Blob Storage, Cosmos DB, Eventhubs
• To ingest the data from source eventhub using Spark-Scala
• Transform the ingested data and Store the output data to Target cosmosDB and update the checkpoint location to Azure Blob-storage
• Validated the data from target eventhub and debugging the code.
• Run the Streaming job on Azure HDinsight cluster.
• Have done unit testing by writing test cases.
• Have done code coverage on sonarquebe.
• Have done code review on GIT while sending merge request.
Senior Associate Technology
SynechronLead Software Engineer
Persistent Systems Ltd.Scala
Apache Spark
Intellij
Kafka
Kubernetes
Docker
Logstash
ElasticSearch
Azure Cosmos DB
Jenkins
Chef
Eclipse