Research Engineer, Infrastructure

$230K - $450K Remote Mid Level Research Engineer

Interested in this Research Engineer role at HARVEY?

Apply Now →

Skills & Technologies

JaxPythonPytorch

About This Role

AI job market dashboard showing open roles by category

Location

Remote

Employment Type

Full time

Location Type

Remote

Department

Engineering

Compensation

  • $230K – $340K • Offers Equity • Offers Bonus

Additionally, this role is eligible to participate in our equity plan and benefits program. Benefits include, but not limited to: Comprehensive health, dental and vision coverage, retirement benefits (401k match up to 4%), and flexible PTO.

Why Harvey

At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.

This is a rare chance to help build a generational company at a true inflection point. We have strong product-market fit and world-class investor support. We’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.

Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you.

At Harvey, the future of professional services is being written today — and we’re just getting started.

Role Overview

As a Member of Technical Staff, Infrastructure in Harvey Research, you’ll build the systems that power how we adapt and improve leading open-weight models for legal work.

We recently post-trained our first model built for legal work, and we’re now building the team to scale up our post-training efforts. You’ll own the infrastructure behind that effort: distributed training, RL rollout systems, the environments where models learn to use tools and complete complex legal workflows, and the internal systems the team uses to manage data, run evals, and launch and track training jobs. You’ll help decide what we build, what we adopt, and how the pieces fit together. You’ll join a small, high-bar team of hands-on engineers and researchers, where each person owns a large part of the stack.

We’re looking for research engineers who have built demanding ML or distributed systems, can debug across the stack, and want to work closely with researchers to make training faster, more reliable, and easier to iterate on.

Learn more about our work at harvey.ai/research.

What You'll Do

  • Scale our post-training stack, supporting SFT and RL on leading open-weight models.
  • Build distributed rollout infrastructure that coordinates model inference, tool execution, and collection of training experience for long-horizon tasks.
  • Build the infrastructure for reproducible agent environments where models can interact with documents, tools, and external systems during training and evaluation.
  • Own the performance and reliability of training runs, including GPU utilization, checkpointing, failure recovery, and observability.
  • Identify and remove bottlenecks across training and inference to shorten the path from research idea to useful result.
  • Build the internal tools and services the team runs on: training data management and versioning, running evals and browsing results, and launching and tracking training jobs and experiments.
  • Integrate models into production, including serving, latency, cost, and online evaluation, so research reaches customers quickly and safely.
  • Partner closely with researchers to turn experimental workflows into dependable systems while keeping room for rapid experimentation.

What You Have

  • Experience building ML infrastructure, distributed systems, or research tooling, with ownership of performance, reliability, and operation.
  • Strong Python and generalist software engineering skills across backend services, data systems, and internal tools, with familiarity with PyTorch, JAX, or similar ML frameworks.
  • Experience with distributed training or inference, including diagnosing performance bottlenecks and failures across the stack.
  • Understanding of post-training workflows; experience with RL rollouts, agent environments, or sandboxed tool execution is a plus.
  • Practical judgment about what to build versus adopt, and the ability to partner with researchers and ship quickly as needs evolve.

We are hiring for this role across multiple levels.

Compensation

$230,000 - $450,000 USD

Depending on your location, an Applicant Privacy Notice may apply to you. You can find all of our Applicant Privacy Notices here.

#LI-DZ1

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing accommodations@harvey.ai

Salary Context

This $230K-$450K range is above the 75th percentile for Research Engineer roles in our dataset (median: $213K across 73 roles with salary data).

View full Research Engineer salary data →

Role Details

Company HARVEY
Title Research Engineer, Infrastructure
Location Remote, US
Experience Mid Level
Salary $230K - $450K
Remote Yes

About This Role

Research Engineers bridge the gap between research and production. They implement papers, build experiment infrastructure, optimize training pipelines, and make research prototypes production-ready. They're the engineers who make research work at scale.

The role sits at a unique intersection. You need to understand the math well enough to implement novel architectures correctly, and you need the engineering chops to make them run efficiently on distributed systems. When a research scientist has a breakthrough idea, you're the person who turns it from a notebook prototype into a training pipeline that runs on 256 GPUs.

Across the 10,419 AI roles we're tracking, Research Engineer positions make up 2% of the market. At HARVEY, this role fits into their broader AI and engineering organization.

Research Engineer roles are growing as AI labs recognize that research velocity depends on engineering quality. The role is less competitive than Research Scientist (no PhD required), but the bar for engineering skill is very high. These roles are concentrated at major labs and well-funded startups.

What the Work Looks Like

A typical week involves: implementing a new attention mechanism from a recent paper, profiling and optimizing a training pipeline that's bottlenecked on data loading, building evaluation infrastructure for a new benchmark, debugging distributed training issues across a GPU cluster, and pair-programming with a research scientist on their latest experiment. The work is deeply technical.

Research Engineer roles are growing as AI labs recognize that research velocity depends on engineering quality. The role is less competitive than Research Scientist (no PhD required), but the bar for engineering skill is very high. These roles are concentrated at major labs and well-funded startups.

Skills Required

Jax (1% of roles) Python (23% of roles) Pytorch (6% of roles)

Strong software engineering fundamentals plus ML knowledge. Python, C++, and CUDA experience are common requirements. You'll need to read papers and turn ideas into working code. Distributed systems experience (especially distributed training) is highly valued. Performance optimization skills separate great candidates from good ones.

Experience with large-scale training infrastructure (FSDP, DeepSpeed, Megatron), GPU programming (CUDA, Triton), and the internals of ML frameworks (PyTorch internals, custom autograd functions) is what makes candidates stand out. The best research engineers can debug issues that span the full stack from GPU memory management to numerical precision to algorithmic correctness.

Strong postings mention the team's recent research, the infrastructure scale, and the specific technical challenges. They often list the research areas you'd support. Look for roles that emphasize both implementation quality and research understanding.

Compensation Benchmarks

Research Engineer roles pay a median of $252,000 based on 580 positions with disclosed compensation. Mid-level AI roles across all categories have a median of $193,200. This role's midpoint ($340K) sits 35% above the category median. Disclosed range: $230K to $450K.

Across all AI roles, the market median is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. For comparison, the highest-paying categories include AI Safety ($274,500) and AI Engineering Manager ($250,811). By seniority level: Entry: $114,400; Mid: $193,200; Senior: $230,000; Director: $272,100; VP: $235,000.

HARVEY AI Hiring

HARVEY has 3 open AI roles right now. They're hiring across Research Engineer. Positions span New York, NY, US, Remote, US. Compensation range: $450K - $450K.

Remote Work Context

Remote AI roles pay a median of $188,000 across 2,811 positions. About 6% of all AI roles offer remote work.

Career Path

Common paths into Research Engineer roles include Software Engineer, ML Engineer, Research Intern.

From here, career progression typically leads toward Senior Research Engineer, Research Scientist, ML Architect.

This is one of the best entry points into AI research without a PhD. Build a strong engineering portfolio with ML projects, contribute to open-source ML frameworks, and demonstrate that you can implement complex ideas correctly and efficiently. The transition to Research Scientist is possible with published first-author work, which some research engineer roles support.

What to Expect in Interviews

Technical screens test both engineering skill and research understanding. Expect coding rounds with performance-critical implementations (GPU optimization, efficient data loading). Be prepared to discuss papers relevant to the team's research area and explain how you'd implement key ideas. System design questions focus on training infrastructure: distributed training, experiment tracking, and compute resource management.

When evaluating opportunities: Strong postings mention the team's recent research, the infrastructure scale, and the specific technical challenges. They often list the research areas you'd support. Look for roles that emphasize both implementation quality and research understanding.

AI Hiring Overview

The AI job market has 10,419 open positions tracked in our dataset. By seniority: 117 entry-level, 4,975 mid-level, 3,840 senior, and 1,487 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (580 positions). The remaining 9,776 roles require on-site or hybrid attendance.

The market median for AI roles is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. Highest-paying categories: AI Safety ($274,500 median, 90 roles); Research Engineer ($252,000 median, 580 roles); AI Engineering Manager ($250,811 median, 72 roles).

Research Engineer roles are growing as AI labs recognize that research velocity depends on engineering quality. The role is less competitive than Research Scientist (no PhD required), but the bar for engineering skill is very high. These roles are concentrated at major labs and well-funded startups.

The AI Job Market Today

The AI job market spans 10,419 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,849), AI Product Manager (516), AI Software Engineer (513). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (117) are outnumbered by mid-level (4,975) and senior (3,840) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,487 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (580 positions), with 9,776 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $214,834. Top-quartile roles start at $266,000, and the 90th percentile reaches $321,730. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $274,500 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,350 postings), Aws (1,173 postings), Azure (1,030 postings), Rag (986 postings), Gcp (714 postings), Pytorch (649 postings), Kubernetes (583 postings), Claude (581 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 580 roles with disclosed compensation, the median salary for Research Engineer positions is $252,000. Actual compensation varies by seniority, location, and company stage.
Strong software engineering fundamentals plus ML knowledge. Python, C++, and CUDA experience are common requirements. You'll need to read papers and turn ideas into working code. Distributed systems experience (especially distributed training) is highly valued. Performance optimization skills separate great candidates from good ones.
About 6% of the 10,419 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
HARVEY is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from Research Engineer positions include Senior Research Engineer, Research Scientist, ML Architect. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.