Backend, Distributed Systems Engineer
ZohoDec, 2018 - Present6 yr 10 months
Architected and led the development of Zohos Field Service Management Applications core server infrastructure, supporting thousands of users across six data centers. Optimized the data import layer, enhancing processing efficiency from 10,000 records in 7 minutes to 1 million records in under 6 minutes, utilizing a MySQL database. Developed and implemented a rate-limiting and API credit system using Redis, which processes approximately one million requests daily with minimal overhead. Optimized Internationalization (i18n) by restructuring a single resource file into on-demand smaller chunks, significantly reducing initial application load time from 14 seconds to under 3 seconds. Identified, designed, and implemented fail-over mechanisms for batch processes, enabling graceful degradation and efficient resumption of workflows post-crisis, significantly improving data processing reliability. Led multiple database migration initiatives, including Cassandra to HBase, cross-data center migrations over MySQL, and MySQL 5.7 to 8.0 upgrades, ensuring seamless transitions and minimal impact on application performance. Designed and directed the development of a data synchronization system across services using Kafka, ensuring consistency and fail-over handling while processing around a million messages daily. Integrated Apache Lucene to enhance search functionality within the application, enabling efficient and accurate retrieval of data across large datasets. Conducted thorough secure code reviews to identify and mitigate potential vulnerabilities, ensuring the development of robust and safe applications. Collaborated to ensure application compliance with industry standards, including but not limited to GDPR, HIPAA, and Australian Privacy Act. Implemented strategies to achieve optimal server performance, minimizing downtime and maximizing application responsiveness.