Augustus Hong
Augustus Hong

Staff Machine Learning Engineer

Actively looking · Member since 19 Aug 2026
Message
Location
Mountain View, United States
Desired salary
Unspecified
Work preference
On-site
Experience level
Lead

About

Professional summary

I am a highly experienced AI/ML engineer with more than 10 years of experience building production systems powered by deep neural networks. My work spans ranking and recommendation systems, conversational AI, real-time decisioning, data mining, and large-scale analytics.

I specialize in translating machine learning research into dependable, scalable products. I have hands-on experience across the full lifecycle, from data quality and distributed model training to inference optimization, service integration, monitoring, and safe production rollouts.

I build AI platforms and applications using Python, PyTorch, FastAPI, Node.js, gRPC, and cloud-native infrastructure. My recent work has focused on LLM-powered assistants, RAG systems, tool orchestration, voice interfaces, and secure APIs with auditable action execution.

I am experienced in distributed training and serving, including DDP, DeepSpeed, FSDP, mixed precision, FP8 quantization, KV caching, and low-latency inference optimization. I also work extensively with ranking models, embeddings, experimentation, offline evaluation, and online A/B testing.

I value operational excellence and responsible AI delivery. I build systems with observability, security controls, evaluation gates, and compliance requirements in mind, using technologies such as Kubernetes, Terraform, OpenTelemetry, CloudWatch, Prometheus, and Grafana.

I enjoy mentoring engineers and collaborating with product, platform, SRE, and research teams. I help teams ship measurable improvements safely by establishing clear API contracts, robust engineering practices, and disciplined launch processes.

Skills

35 capabilities

Tech stack & tools

Working toolkit

Analytics

Application Hosting

Experience

Career history

Staff Machine Learning Engineer, Perception, Autonomy Rivian

Led backend and machine learning delivery for an in-vehicle conversational assistant. Built Python and FastAPI services that convert voice intent into safe, traceable actions across vehicle controls and diagnostics, with agent and tool orchestration through gRPC, REST, and GraphQL APIs.

Integrated Gemini through Google Vertex AI for reasoning while maintaining audited service-side execution controls. Built RAG capabilities with LangChain and Pinecone, created Kafka-to-S3 and PostgreSQL telemetry pipelines, trained PyTorch models with DeepSpeed and FSDP, optimized inference for real-time latency, and deployed observable, secure services on EKS using Docker, Terraform, GitHub Actions, OpenTelemetry, CloudWatch, Prometheus, and Grafana. Mentored engineers and partnered with product, SRE, and platform teams.

Senior Machine Learning Engineer Meta

Built DLRM-style advertising ranking models in PyTorch using sparse embedding tables and dense features to predict CTR and CVR and improve ad ordering. Used distributed PyTorch training, mixed precision, checkpointing, reproducible configurations, and clean data sharding.

Improved ranking quality through feature and embedding optimization, offline evaluation, and online A/B testing. Developed data-quality guardrails, optimized serving latency through batching and caching, connected regression gates to releases, monitored model quality in production, and mentored engineers on ranking, embeddings, model debugging, and launch discipline.

Software Engineer – Machine Learning Cresta

Built the Expertise Engine real-time agent-assist product using Python, FastAPI, and Node.js to deliver live coaching and next-best-action suggestions for voice and chat interactions. Trained and shipped PyTorch NLP models using transformer architectures including BERT, GPT-2, and T5 for intent, objection, and moment detection.

Developed real-time gRPC inference and routing flows, custom ASR and entity-recognition modules, and secure REST and GraphQL orchestration APIs. Built React, React Native, and Flutter product surfaces; operated Kafka and S3 data pipelines; and deployed Dockerized Kubernetes services using Terraform and GitHub Actions with comprehensive production monitoring.

Machine Learning Engineer Woebot Health

Designed and implemented high-accuracy NLP classifiers using state-of-the-art deep learning techniques. Led strategies for obtaining high-quality training datasets to support machine learning development.

Defined and analyzed product metrics and built dashboards for company health and enterprise campaign performance. Mentored team members on machine learning projects and engineering practices.

Data Scientist Branch

Worked in a fast-paced agile team to iterate on proof-of-concept products for potential partners. Built complex search and recommendation systems spanning API services, backend data storage, search-query logic, and frontend web applications.

Conducted controlled experiments and A/B tests to measure engagement lift relative to competing products. Contributed across the stack to turn data-driven capabilities into partner-facing product experiences.

Software Engineer Branch

Built user feature-modeling and engagement-prediction capabilities using machine learning. Led the analytics backend for partner-facing dashboard products.

Developed analytics systems for high-throughput, real-time data streams and mined large datasets for business insights and data-driven decisions. Applied machine learning to product re-engagement and customer upsell initiatives.

Summer Fellow Lightspeed Venture Partners

Worked as a full-stack developer on a web application designed to significantly improve the trip-planning experience.

Also developed an iOS version of the application, extending the product experience to mobile users.

Design Engineer AMD

Developed software infrastructure to optimize simulation performance for CPU core verification.

Contributed engineering solutions supporting processor verification workflows and simulation efficiency.

Education

Learning history

Stanford University

MS, Artificial Intelligence

Master of Science in Artificial Intelligence.

Purdue University

BS, Computer Science

Bachelor of Science in Computer Science.

This professional hasn’t added portfolio projects yet.

This professional hasn’t listed any services yet.

People also viewed

All talent ›
Jobs Talent Salaries
Menu