Product Manager, AI Factories Orchestration, Agent Harness

Tel Aviv-Yafo, Tel Aviv District, Israel Mid Level AI Product Manager

Interested in this AI Product Manager role at DriveNets?

Apply Now →

Skills & Technologies

AwsAzureClaudeGcpKubernetesOpenaiPythonRag

About This Role

AI job market dashboard showing open roles by category

Description About DriveNets DriveNets is a leader in high-scale networking software for AI infrastructure and service providers. The company pioneered a disaggregated networking architecture that transforms the economics of large-scale networks while maximizing performance, utilization, and operational efficiency. DriveNets-powered networks are deployed by global leaders, including AT&T and Comcast, supporting more than 30% of total U.S. internet traffic. DriveNets AI Fabric delivers full-stack networking for AI infrastructures, providing the highest-performance, Ethernet-based alternative to InfiniBand. The solution is deployed by hyperscalers, NeoClouds, and enterprises worldwide. With over $1B raised, DriveNets continues to push the boundaries of modern networking infrastructure. The Role DriveNets is seeking a Product Manager to build the Agent Harness for AI Factories orchestration – the layer that lets AI agents safely operate AI infrastructure. Operators of large GPU clusters are drowning in telemetry, alarms, and change requests. Your mission is to give them agents that can investigate incidents, explain root cause, propose and execute changes, and plan capacity, with the guardrails that production infrastructure demands. As the Product Manager for the Agent Harness, you will own the tools, context, guardrails, evaluation, and runtime that connect LLM-based agents to the DriveNets orchestration platform, for both DriveNets-built agents and the agents our customers bring. You will join the AI Factories Orchestration product team, a dedicated software product group within DriveNets Product Management. This is a software product role: you will own a platform that customers run every day, with APIs, workflows, user experience and integrations at its core. You will partner with hyperscalers, NeoClouds, and enterprises building AI/HPC GPU clusters, and your work will directly determine how fast they can bring GPUs into service and how much useful work they get out of them. Responsibilities

  • Define the Agent Harness: the tool layer (including MCP servers) that exposes orchestration, telemetry, topology, and configuration capabilities to agents in a safe, well-scoped way.
  • Own the first-party operations agents – e.g., incident investigation and root cause analysis, change planning and pre-checks, configuration audit, and capacity planning – and define where they run autonomously versus with a human in the loop.
  • Define the guardrails: permissions and RBAC for agents, policy enforcement, approval workflows, blast-radius limits, dry-run and rollback, and full audit trails of agent actions.
  • Own context engineering: how topology, live telemetry, logs, runbooks, and documentation are retrieved and presented to models to produce accurate, grounded answers.
  • Build the evaluation framework – offline eval suites, regression benchmarks on real incident scenarios, and online quality metrics – and make eval results a release gate.
  • Make the platform agent-friendly: work with platform teams so APIs, errors, and data models are easy for agents to use, and support open interoperability (MCP, A2A) for customer-owned agents and AIOps tools.
  • Stay current with the fast-moving agent ecosystem (agent SDKs, models, open standards) and drive build/partner decisions, including model selection, cost, latency, and on-premise / air-gapped deployment.
  • Own the product strategy, roadmap, and backlog for your area, and translate customer problems into clear PRDs, user stories, API specifications, and acceptance criteria for engineering teams working in agile delivery.
  • Run continuous discovery with hyperscalers, NeoClouds, and enterprise customers: interview operators and platform teams, map their day-0/1/2 workflows, and turn the patterns into prioritized product requirements.
  • Design northbound APIs (REST/gRPC, OpenAPI) and SDKs so the platform can be consumed programmatically by customer portals, cloud control planes, and automation pipelines – not only through a UI.
  • Drive integrations with the AI infrastructure ecosystem, such as Kubernetes, Slurm, NVIDIA Base Command Manager / Mission Control, Run:ai, NetBox, ServiceNow, and observability stacks.
  • Define and track product success metrics such as time-to-first-job, GPU utilization, mean time to resolve, adoption, and customer satisfaction.
  • Lead demos and proof-of-concepts with customers, and support sales, solution architects, and customer success in strategic engagements.
  • Create external content – white papers, technical briefs, blogs, conference talks – that balances technical accuracy with clear messaging.

Requirements What we need to see

  • Mandatory: daily, hands-on use of AI agentic tools (e.g., Claude / Claude Code, Cursor, ChatGPT / Codex, GitHub Copilot) as a core part of how you work – for research, writing PRDs and specs, data analysis, prototyping, and automating your own workflows. Be ready to show us how you use them.
  • 6+ years in the technology industry, with at least 3 years as a product manager for technical or developer-facing software, including hands-on experience shipping LLM or agent-based features.
  • Strong, hands-on understanding of how LLM-based agents work: tool calling, retrieval (RAG), MCP, and their common failure modes.
  • A clear point of view on trust and safety for agents that act on production systems: permissions, approvals, and auditability.
  • Proven experience writing clear product requirements for software platforms, with APIs as a first-class part of the product.
  • Strong, hands-on understanding of cloud-native software architecture – Kubernetes, containers, microservices, and distributed systems – with a proven ability to drive design trade-offs with engineering.
  • Solid understanding of AI infrastructure: GPU cluster architecture, how training and inference workloads use compute, network, and storage, and what drives GPU utilization and job reliability.
  • Strong data-driven decision making, with a proven ability to define success metrics and act on product analytics.
  • Clear written and verbal communication, with the ability to work with executives, engineers, and customers alike.
  • Ability to manage shifting priorities in a fast-paced environment and to work with teams across geographies.
  • Travel as needed.

Ways to stand out from the crowd

  • Practical experience with LLM evaluation: building eval sets, measuring accuracy and hallucination, and using results as release gates.
  • Hands-on experience with agent frameworks and SDKs such as LangGraph, the Claude Agent SDK, OpenAI Agents SDK, or similar, and with agent tracing/observability tools.
  • Experience with multi-agent systems, memory, and context engineering over large volumes of live telemetry and logs.
  • Background in SRE, NetOps, or AIOps – you have been paged and know what a good root cause analysis looks like.
  • Experience deploying LLM solutions in on-premise, sovereign, or air-gapped environments, including open-weight models.
  • Ability to prototype: proficient in Python and building a working demo agent yourself.
  • Familiarity with data center networking: leaf/spine and Clos topologies, BGP/EVPN-VXLAN, RoCEv2, and AI scale-out / scale-up fabrics (Ethernet, UEC, InfiniBand, NVLink).
  • Hands-on experience with infrastructure-as-code and DevOps tooling: Terraform, Ansible, Helm, GitOps, CI/CD.
  • Familiarity with observability and telemetry: Prometheus, Grafana, OpenTelemetry, streaming telemetry (gNMI/gRPC).
  • Experience at a Tier-1 cloud (AWS, Azure, GCP, OCI), a NeoCloud, or a company building infrastructure management software.
  • Experience building AI-assisted features (copilots, natural-language queries, AIOps) into an operations product.

Education BS/MS in Computer Science, Computer/Electrical Engineering, or another engineering field, or equivalent experience. If your experience is close but doesn’t fulfill all requirements, please apply. DriveNets is on a mission to build a special company comprised of individuals with different backgrounds, perspectives, and experiences. More About DriveNets

  • Based in Israel with locations in Romania, US, India and Japan as well as extended teams, DriveNets operations cover more than twelve countries. With recognition by industry analysts and through partnerships with market leaders such as AMD, Broadcom, Dell and others, DriveNets is pushing market momentum, delivering the scale and efficiency that modern AI workloads demand. Visit our website: https://drivenets.com/company/

Role Details

Company DriveNets
Title Product Manager, AI Factories Orchestration, Agent Harness
Location Tel Aviv-Yafo, Tel Aviv District, Israel
Experience Mid Level
Salary Not disclosed
Remote No

About This Role

AI Product Managers define what AI features get built and why. They translate business problems into ML-solvable tasks, work with engineering to scope model requirements, and own the metrics that determine if an AI feature is working. The role requires a rare combination of technical fluency and product instinct.

Unlike traditional product management, AI PM work involves managing uncertainty at a fundamental level. Your model might work 90% of the time. What happens the other 10%? What's the user experience when the AI is wrong? How do you measure 'good enough' for a probabilistic system? These questions don't have easy answers, and the AI PM is the person responsible for finding them.

Across the 10,419 AI roles we're tracking, AI Product Manager positions make up 5% of the market. At DriveNets, this role fits into their broader AI and engineering organization.

AI Product Manager roles are growing as companies realize that shipping AI features requires different product thinking than traditional software. The best candidates combine product management experience with enough technical depth to have productive conversations with ML engineers about model capabilities and limitations.

What the Work Looks Like

A typical week includes: reviewing model evaluation results with the ML team, defining success metrics for a new AI feature, conducting user research on how customers respond to AI-generated outputs, writing product requirements that include accuracy thresholds and fallback behaviors, and presenting the AI roadmap to leadership. You're the translator between technical capability and business value.

AI Product Manager roles are growing as companies realize that shipping AI features requires different product thinking than traditional software. The best candidates combine product management experience with enough technical depth to have productive conversations with ML engineers about model capabilities and limitations.

Skills Required

Aws (11% of roles) Azure (10% of roles) Claude (6% of roles) Gcp (7% of roles) Kubernetes (6% of roles) Openai (5% of roles) Python (23% of roles) Rag (9% of roles)

Technical fluency with ML concepts is essential, though you won't be writing models. Expect to understand training data, evaluation metrics, model limitations, and responsible AI practices. SQL and basic Python are increasingly expected. Experience with A/B testing, data analysis, and product analytics is baseline. Understanding LLM capabilities and limitations is now a core requirement.

The differentiator is AI-specific product thinking: knowing when to use ML vs. heuristics, understanding the cost of training data collection, designing graceful degradation for model failures, and building products that improve with usage data. Experience with AI safety, bias mitigation, and responsible AI deployment is increasingly important.

Strong postings describe specific AI products the PM will own, mention the ML team structure, and talk about measurement methodology. Look for companies that have already shipped AI features. Roles at companies that are 'exploring AI' often mean you'll spend a year defining the strategy before any building happens.

Compensation Benchmarks

AI Product Manager roles pay a median of $221,400 based on 1,193 positions with disclosed compensation. Mid-level AI roles across all categories have a median of $193,200.

Across all AI roles, the market median is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. For comparison, the highest-paying categories include AI Safety ($274,500) and Research Engineer ($252,000). By seniority level: Entry: $114,400; Mid: $193,200; Senior: $230,000; Director: $272,100; VP: $235,000.

DriveNets AI Hiring

DriveNets has 3 open AI roles right now. They're hiring across AI/ML Engineer, AI Product Manager. Positions span North Township, IN, Tel Aviv-Yafo, Tel Aviv District, Israel.

Location Context

Across all AI roles, 6% (580 positions) offer remote work, while 9,776 require on-site attendance. Top AI hiring metros: New York (3,785 roles, $222,480 median); San Francisco (3,262 roles, $261,300 median); Los Angeles (1,896 roles, $210,000 median).

Career Path

Common paths into AI Product Manager roles include Product Manager, Data Analyst, Technical Program Manager.

From here, career progression typically leads toward Director of AI Product, VP Product, Head of AI.

The most effective path is PM experience plus self-directed AI education. Take Andrew Ng's courses, build a small ML project, and learn enough Python to read model evaluation code. The goal isn't to become an ML engineer. It's to have credibility in technical conversations and to understand what's possible, what's hard, and what's a bad idea.

What to Expect in Interviews

AI interviews typically combine coding challenges (Python-focused), system design questions tailored to the role, and discussions about your experience with relevant tools and frameworks. Strong candidates demonstrate both technical depth and the ability to make pragmatic engineering tradeoffs. Prepare portfolio projects that demonstrate end-to-end capability rather than isolated skills.

When evaluating opportunities: Strong postings describe specific AI products the PM will own, mention the ML team structure, and talk about measurement methodology. Look for companies that have already shipped AI features. Roles at companies that are 'exploring AI' often mean you'll spend a year defining the strategy before any building happens.

AI Hiring Overview

The AI job market has 10,419 open positions tracked in our dataset. By seniority: 117 entry-level, 4,975 mid-level, 3,840 senior, and 1,487 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (580 positions). The remaining 9,776 roles require on-site or hybrid attendance.

The market median for AI roles is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. Highest-paying categories: AI Safety ($274,500 median, 90 roles); Research Engineer ($252,000 median, 580 roles); AI Engineering Manager ($250,811 median, 72 roles).

AI Product Manager roles are growing as companies realize that shipping AI features requires different product thinking than traditional software. The best candidates combine product management experience with enough technical depth to have productive conversations with ML engineers about model capabilities and limitations.

The AI Job Market Today

The AI job market spans 10,419 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,849), AI Product Manager (516), AI Software Engineer (513). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (117) are outnumbered by mid-level (4,975) and senior (3,840) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,487 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (580 positions), with 9,776 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $214,834. Top-quartile roles start at $266,000, and the 90th percentile reaches $321,730. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $274,500 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,350 postings), Aws (1,173 postings), Azure (1,030 postings), Rag (986 postings), Gcp (714 postings), Pytorch (649 postings), Kubernetes (583 postings), Claude (581 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 1,193 roles with disclosed compensation, the median salary for AI Product Manager positions is $221,400. Actual compensation varies by seniority, location, and company stage.
Technical fluency with ML concepts is essential, though you won't be writing models. Expect to understand training data, evaluation metrics, model limitations, and responsible AI practices. SQL and basic Python are increasingly expected. Experience with A/B testing, data analysis, and product analytics is baseline. Understanding LLM capabilities and limitations is now a core requirement.
About 6% of the 10,419 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
DriveNets is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from AI Product Manager positions include Director of AI Product, VP Product, Head of AI. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.