Full Stack Software Engineer OSLabs
Apache Kafka Repartition and Monitoring Utility
• Deployed a utility that connects to client clusters, cutting repartitioning time by 50% with a custom offset sorting algorithm.
• Leveraged Prometheus and JMX data, implemented intuitive UI visualizations for comprehensive cluster and topic monitoring.
• Utilized React Router to establish a client-side routing system, enhancing application navigation and user experience.
• Employed Redux Toolkit to clearly manage the application’s substantial data flow, organizing the state into well-defined, predictable segments. This not only facilitated more straightforward testing but also reduced test times by 20%.
• Achieved significant improvements in the system’s maintainability, scalability, and reliability by centralizing management functions and employing immutable reducers and actions, ensuring a consistent and efficient operational framework.
• Built a backend using Node.js and Express, providing a robust REST API capable of handling data-intensive, real-time queries including concurrent asynchronous requests to Kafka, Prometheus, and JMX.
• Created logic to analyze partition offsets, ensuring minimum viable partition count and preventing data loss in repartitioning.