HeadsUpAI

Andrew Ng Identifies Resurgence of Forward Deployed Engineers for Custom Agentic Workflows

Andrew Ng analyzes the rise of the AI Forward Deployed Engineer (FDE), a role where engineers embed within client organizations to customize solutions. This resurgence follows the OpenAI Deployment Company launch and similar efforts by Anthropic to help enterprises build and tune agentic workflows—AI systems that autonomously plan and execute multi-step tasks.
Role
Forward Deployed Engineer (FDE)
Historical Precedent
Palantir
Core Focus
Custom agentic workflows
Key Skills
Technical, communication, business strategy
Active Companies
OpenAI, Anthropic

The FDE role, pioneered by Palantir, is returning because off-the-shelf models require significant customization for specific business needs. While these roles address integration gaps, Ng notes that enterprises face a trade-off between deep vendor integration and maintaining "optionality"—the ability to switch providers as the model landscape evolves.

Ng predicts the AI Engineer role will eventually fragment into specialized disciplines like Evals Engineers. This specialization supports his earlier argument that AI is creating an engineering jobapalooza rather than a market collapse, as companies prioritize internal teams to avoid being tightly bound to a single vendor's ecosystem.

Andrew Ng
Andrew Ng
@AndrewYNg
X

One of the new, buzzy jobs in Silicon Valley is the AI Forward Deployed Engineer (FDE), an engineer who is embedded within a client organization to help customize solutions, such as building and tuning agentic workflows that suit the client’s particular needs. I’ve heard from people who are wondering anew about the FDE career path since OpenAI and Anthropic started building new teams to place FDEs within client organizations. The rise of FDEs for AI workloads is one way AI is creating new jobs (and why the jobpolcalypse narrative of upcoming job market collapse is false -- there will be many AI and non-AI jobs). However, I believe there will be far more AI Engineer jobs than FDEs, as I explain below. The FDE role was pioneered about two decades ago by Palantir, which sent engineers to government locations to work on secure, air-gapped networks. In addition to having good technical skills, FDEs need communication skills and sometimes business skills. For example, they may need to speak with clients to understand their needs, formulate a strategy to prioritize projects, explain complex technology, and respectfully push back if a client asks for something unrealistic. They’re enjoying a resurgence because of the amount of work involved in taking an off-the-shelf LLM and building it into a custom agentic workflow that fits particular business needs. However, I believe the number of AI Engineer jobs will be far larger. A company might accept a few FDEs to be embedded within its organization. But most companies will want far more of their own employees working on their projects. While my organizations do hire FDEs, we hire far more AI Engineers! Also, a common client concern is that it is hard to find vendor-neutral FDEs — they are, after all, there to deeply integrate a particular vendor’s product into a company. In this moment when it’s hard to predict which AI service will be the best one in a year’s time, optionality (the ability to pick whatever vendor turns out to fit best in the future) is very valuable. In contrast, letting FDEs tightly bind a company’s processes significantly reduces optionality. Right now, I see surging demand for AI Engineers who can build software applications using AI software components (like LLM prompting, agentic frameworks, evals, etc.) and effectively use AI coding agents (like Claude Code, Codex, Antigravity CLI, and OpenCode). As the AI Engineer role matures, I expect it to fragment into more specialized roles, like the generic Software Engineer role from decades ago fragmented into frontend, backend, mobile, data engineering, devops, and so on. What will be the future, specialized AI engineering roles? I don’t know. Perhaps there will be AI FDEs, LLMOps Engineers, Evals Engineers, AI Data Engineers, Harness Engineers, and other roles we don’t have names for yet. But for now, I see a lot of AI engineers who are generalists create a lot of value. Skilled AI Engineers are in very high demand! As our field continues to mature over the coming decade, I look forward to new specializations within AI Engineering that create even more job opportunities. [Original text: The Batch newsletter]

704retweets4.3klikes
View on X

Every HeadsUpAI update is written based on its original source and reviewed before it's published. Read our editorial standards →

Share this update