Forward Deployed Engineer
Novita Ai
| Company | Novita Ai |
| Category | Engineering |
| Location | San Mateo |
| Remote | On-site (inferred) |
| Employment | Not stated |
| Level | Not stated |
| Salary | Not stated by the employer |
| Posted | 25 Jun 2026 |
| Last verified | 12 Aug 2026 |
| Source | The employer's own careers page (company_site) |
Description
Novita AI is an AI & Agent Cloud platform providing unified infrastructure for Model APIs, GPU Cloud, and Agent Sandbox. As a Forward Deployed Engineer, you will work at the intersection of engineering, customer success, and product, partnering closely with customers to understand their AI workloads, deploy solutions, troubleshoot production issues, and influence platform evolution.
What You'll Do
• Work directly with customers to understand AI products, technical requirements, and business goals
• Deploy and integrate Novita AI products including Model APIs, inference endpoints, dedicated model hosting, GPU cloud infrastructure, and agent sandbox environments
• Debug production issues across APIs, networking, containers, GPUs, and distributed systems
• Build customer-specific solutions, integrations, demos, and prototypes; travel to customer sites when necessary
• Translate customer feedback into product requirements and create reusable tooling, automation, and reference implementations
What You Need
• Strong software engineering fundamentals
• Proficiency in Python and at least one additional programming language
• Experience building or deploying cloud-native applications
• Familiarity with Docker, Kubernetes, Linux, and networking concepts
• Strong debugging and problem-solving skills in production environments
• Excellent communication skills and ability to work directly with customers
Nice to Have
• Experience with AI/ML infrastructure, LLMs, or inference systems
• Familiarity with vLLM, SGLang, Ray, or distributed serving frameworks
• Experience working with GPUs, CUDA, or large-scale compute systems
• Background in solutions engineering, developer relations, or customer-facing engineering roles
• Experience building AI agents, coding agents, or sandboxed execution environments
• Prior startup experience or experience as an early engineer
• Professional working proficiency in Mandarin Chinese
Competitive pay package, 100% employer-covered premium medical, dental, and vision insurance, 401(k) plan, free meals in the office