Lead ML/DevOps Engineer Magnit Tech (LLC “ITM”)
IT division of Magnit, responsible for maintaining complex infrastructure supporting 30,000+ stores across Russia and abroad.
Tech Stack: PyTorch, TensorFlow, Docker, Terraform, GitLab CI/CD, Kubernetes, Helm, Python, Bash, Linux, Nginx, Prometheus, Grafana, Loki, Yandex Cloud
Responsibilities:
• Deployed monitoring systems for high-performance LLM inference servers using vLLM and Triton Inference Server.
• Optimized Kubernetes clusters using Helm and observability tools (Prometheus, Grafana, Loki) for real-time metrics, logs, and alerting.
• Built automated infrastructure workflows using Infrastructure as Code (IaC), Makefiles, and CI/CD pipelines.
• Managed AI/ML application deployments in Kubernetes on Yandex Cloud.
• Implemented secure authentication via LDAP and encrypted sensitive configurations using SOPS.
• Set up and maintained a ClearML lab for AI/ML experiment tracking, model versioning, and workflow automation.
Key Achievements:
• Deployed comprehensive monitoring alongside cluster setup.
• Fully rewrote the RAG Helm chart to meet internal standards.
• Developed ClearML sessions for virtual machines used in ML workflows.