Forward Deployment Engineer (Hybrid)
Are you a senior engineer who looks beyond basic model API calls and understands how LLM-based systems actually behave-and fail-in production?
We are a fast-growing enterprise AI company seeking a Forward Deployment Engineer to build scalable, secure, and production-ready AI systems for our clients. In this role, you will tackle complex engineering challenges across the entire AI stack, focusing on agentic orchestration, distributed knowledge infrastructure, model inference, and robust access-control layers.
We are looking for a highly autonomous builder with 4+ years of production experience, deep backend and data engineering fundamentals (especially SQL/PostgreSQL), and a strong track record of designing resilient AI/ML architectures. If you thrive on taking high-level architectures with open decisions and independently closing the gaps to deliver secure, enterprise-grade solutions, we want to hear from you.
location: Sunnyvale, California
job type: Permanent
salary: $150,000 - 170,000 per year
work hours: 9am to 5pm
education: Bachelors
responsibilities:
Senior Engineer with deep technical range across the AI systems stack. We need someone who can reason critically about the production behavior of LLM-based systems, distributed infrastructure, and complex data pipelines-moving far beyond simply calling a model API.
What you'll do
- Agentic and orchestration systems: Architect multi-agent workflows, implement tool-use and agent-facing protocols (e.g., MCP), and manage state, memory, tracing, replay, and sandboxing.
- Large-scale data and knowledge infrastructure: Build entity/relationship graphs, execute structured extraction from unstructured data using bounded LLM strategies, and develop incremental pipelines that prevent full reprocessing upon every change.
- Model serving and inference: Manage deployment, optimize latency and cost, and perform reliability engineering for systems interfacing with LLMs or client-hosted models at scale.
- Evaluation and cost infrastructure: Develop gold sets, implement regression detection, and build per-operation cost meters.
- Access control and trust: Integrate permission and sensitivity enforcement directly into the data layer, ensuring all pipelines pass through secure, centralized mutation and write gates.
- Core backend and data engineering: Drive schema design, query planning, and apply distributed systems fundamentals.
- 4+ years building production systems, demonstrating genuine depth in AI/ML architectures. You should understand how LLM-based applications, distributed data infrastructure, and agentic pipelines fail in production (e.g., drift, cost escalation, latency cliffs, brittle orchestration) and know how to design resilient solutions around those failure modes.
- Strong distributed systems and data engineering fundamentals: Deep expertise in SQL/PostgreSQL, including the ability to reason about query plans and schema design under strict production constraints. You must be comfortable managing these systems in live environments, encompassing monitoring, incident response, and cost optimization.
- Domain expertise: Direct production experience in at least two or three of the following areas: agentic/orchestration systems, large-scale knowledge/data infrastructure, model serving/inference, evaluation systems, or access-control and authorization design.
- Security-conscious by default: A foundational mindset that prioritizes data protection and secure system architecture.
- High autonomy: The ability to take high-level architectural concepts with open decisions and independently close the gaps to deliver complete, robust solutions.
qualifications:
Experience : 4-5 years overall
Position : Forward Deployed Engineer
Location: San Francisco, CA. , Hybrid role- not remote
Type: Full-time
skills:
AI,data infrastructure,distributed data,distributed systems,LLM-based systems,data engineering,ML systems,model serving,Postgres,SQL,access-control,architecture,incident response,infrastructure,cost control,production systems,Security-conscious
Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.
At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.
We use AI tools to support our recruiters and interviewers with tasks like note-taking, summarization, and documentation of interviews to ensure they can be fully focused on your conversation. All hiring decisions are made by people.
Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).
This posting is open for thirty (30) days.
Qualified applicants in San Francisco with criminal histories will be considered for employment in accordance with the San Francisco Fair Chance Ordinance.
Qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.
We will consider for employment all qualified Applicants, including those with criminal histories, in a manner consistent with the requirements of applicable state and local laws, including the City of Los Angeles' Fair Chance Initiative for Hiring Ordinance.