AI Systems & Platform Internals - Technical Architect
Accellor
| Company | Accellor |
| Category | Data & Analytics |
| Location | Mountain View |
| Remote | On-site (inferred) |
| Employment | Not stated |
| Level | Lead |
| Salary | Not stated by the employer |
| Posted | 22 Jun 2026 |
| Last verified | 2 Aug 2026 |
| Source | Employer ATS (workable) |
Description
Accellor is an AI-native services firm purpose-built for the post-ChatGPT era. Free from legacy constraints, we focus on delivering measurable business outcomes through advanced AI, data, and engineering capabilities. Our mission is to operationalize AI at scale and unlock sustained enterprise value. Our offerings span AI solutions, data services, enterprise applications, and product engineering, tailored to industry-specific needs across healthcare, life sciences, telecom, retail, financial services, and technology. By leveraging design thinking and technology-agnostic architectures, we ensure faster time-to-value and seamless interoperability. With a proven track record of enabling Fortune 100 enterprises and global innovators, Accellor stands as a trusted partner for organizations seeking to harness the full potential of AI. Our vision is clear: to build intelligent, connected ecosystems that deliver measurable outcomes and redefine the future of enterprise transformation. Technical Architect — AI Systems & Platform Internals Experience: 10–12 Years Role Type: Technical Architect / Staff-Level Systems Architect Role Summary Accellor is looking for a Technical Architect — AI Systems, Inference & Platform Internals to help design, scale, and optimize the systems that power ChatGPT, OpenAI API, Codex, agentic systems, multimodal experiences, and internal research workloads. This role is focused on the internal AI systems stack, including inference runtime, model serving, GPU infrastructure, distributed systems, context engineering, cost optimization, evaluation gates, observability, release safety, and production reliability. The ideal candidate is a senior hands-on architect who can reason across the full AI platform — from GPU-level performance and distributed inference to product-scale reliability, model deployment, safety, and cost-efficient operations. Key Responsibilities : 1. AI Systems Architecture Design and evolve large-scale AI systems that support ChatGPT, OpenAI API, Codex, agentic workflows, multimodal models, and research workloads. Define architecture across inference runtime, model serving, request routing, batching, KV-cache handling, GPU scheduling, distributed execution, observability, release gates, and production rollout. Own technical trade-offs across latency, throughput, reliability, correctness, safety, scalability, cost, and infrastructure efficiency. 2. Inference Runtime & Model Serving Architect high-throughput, low-latency inference systems across large-scale GPU clusters. Work across inference engines, serving layers, scheduling systems, caching, streaming, deployment pipelines, and runtime optimization. Partner with engineering teams to improve model-serving efficiency, tail latency, GPU utilization, memory efficiency, correctness under load, and cost per request. Guide architecture decisions involving PyTorch, JAX, Triton, vLLM-style serving, CUDA/Triton kernels, distributed inference, tensor parallelism, pipeline parallelism, model sharding, and long-context serving. 3. GPU, Kernel & Distributed Performance Analyze and improve performance across GPU kernels, memory movement, collective communication, orchestration, and runtime scheduling. Guide engineering decisions involving CUDA, Triton, NCCL/RCCL, GPU profiling, memory pressure, compute utilization, tensor layouts, interconnect behavior, and distributed execution. Identify system-level bottlenecks across compute, memory, networking, scheduling, model execution, and data movement. 4. Context Engineering Design and guide context engineering frameworks that determine what information should be passed to the model, how it should be structured, how much context should be used, and how context quality should be measured. Own architecture patterns for prompt structure, dynamic context assembly, re
2,051,957 openings. Erioun finds yours.Scored against your own profile, every hour.Try the radar →