Interested in this Research Scientist role at G2?
Apply Now →Skills & Technologies
About This Role
Location
Remote (US)
Employment Type
Full time
Department
Product R&D
Compensation
- $190K – $235K • Offers Equity
At G2, we’re committed to building an equitable and inclusive workplace for all. That's why our compensation program is rooted in market data, transparency, fairness, and individual performance.
Compensation in an offer is determined by factors such as the candidate’s experience, relevant skills, and job-related knowledge.
We’ve built a company-wide framework to provide employees clarity on how compensation and success is measured at each level. This career framework supports our employees' professional growth and guides them to their PEAK.
We also support our employees by offering generous benefits, such as flexible work, ample parental leave, and unlimited PTO. Click here to learn more about our benefits.
About G2 - The Company
G2 is the world's largest and most trusted software marketplace. When you join G2, you’re joining the industry’s leading team that helps businesses reach their peak potential by powering decisions and strategies with trusted insights from real software users.
Now, we have joined forces with Capterra, SoftwareAdvice, and GetApp to create the largest source of online data and software insights to fuel intelligent buying in the age of AI. With 200M+ combined annual visitors and 6M verified reviews, we are now the centralized place to enable software buyers to make better and faster decisions with confidence.
And we are just getting started! We are setting out to transform the global B2B software industry and become the most trusted data foundation for buyers and sellers of software for the age of AI.
Does that sound exciting to you? Come join us as we try to reach our next PEAK!
About G2 - Our People
At G2, everything we are and what we do is grounded in our PEAK values— (*P*erformance + *E*ntrepreneurship + *A*uthenticity + *K*indness. Working at G2 means you are part of a value-driven, growing global community that climbs PEAKs together. We cheer for each other’s successes, learn from our mistakes, and support and lean on one another during challenging times. With ambition and entrepreneurial spirit we push each other to take on challenging work, which will help us all to grow and learn.
You will be part of a global, diverse team of smart, dedicated, and kind individuals - each with unique talents, aspirations, and life experiences. At the heart of our community and culture are our people-led ERGs, which celebrate and highlight the diverse identities of our global team. As an organization, we are intentional about our DEI and philanthropic work (like our G2 Gives program) because it encourages us all to be better people.
About The Role
Buyers of business software increasingly need to know how well AI agents actually perform, not just what vendors claim. G2 is building independent, rigorous evaluations of AI agents on realistic business work, to help buyers choose with confidence and to set a trusted standard for the market.
This is the most senior applied research role on that work, and it is hands-on. You will own the research agenda for how agents get tested, make sure the results mean what we say they mean, and turn them into product features and insights G2 publishes. You will work side by side with engineers and product managers, and your work will go into what G2 ships today, not only into longer-term research.
You will also raise the bar around you. You will mentor engineers, data scientists and researchers working on evaluation, review their methodology, and make the standards you set repeatable by people who did not write them.
The field is unsettled. Methods from academia, frontier labs and industry are still being worked out. Part of the job is staying on top of that work and bringing the ideas that matter into the product. The approaches that last are the simple, general ones that still hold up as models change.
In This Role, You Will:
- Own the evaluation methodology. Set the standard for how G2 evaluates AI agents, defend it to skeptical audiences inside and outside the company, and keep it current as models change.
- Contribute to today's product. Work closely with engineers and product managers to build and improve the evaluations behind G2's current offerings. Help scope features, turn methods into production-ready components, and iterate on what customers and the business need.
- Design realistic evaluations. Build environments and task sets that reflect the work businesses actually give AI agents, and that stay useful as models improve.
- Develop sound measurement. Create scoring approaches, including automated checks, LLM-based judges and human review, that are accurate, reproducible and hard to game. Measure consistency and reliability, not just average performance.
- Validate the evaluations themselves. Audit tasks and graders, quantify noise, and establish when differences between agents are real.
- Represent the results. Present and defend evaluation findings to buyers, customers and partners, and to the research community. Be the credible voice behind the numbers when the audience has a stake in the outcome.
- Mentor and multiply. Manage and guide researchers and engineers on evaluation design and measurement, review their work, and write the documentation and standards that let the team run evaluations without you in the room.
- Set and pursue a research agenda. Choose which evaluation problems matter most and carry long-running projects through to something that works, favoring simple ideas that generalize over ones tuned to this year's models. Directions include simulated-user and environment-based evaluation in the tradition of benchmarks like τ-bench; realistic user and persona simulation; LLM-as-judge reliability; evaluation of voice and multimodal agents; assessing agents in open-ended, long-horizon workflows; and protecting test sets from contamination.
- Stay current. Follow new benchmarks, papers and evaluation practices across the research community. Translate them into product and roadmap decisions, and communicate them clearly to the team.
- Share and collaborate. Write methodology documentation and, where appropriate, papers and public posts. Partner with data and go-to-market teams on how results are presented and used.
Minimum Qualifications:
We realize applying for jobs can feel daunting at times. Even if you don’t check all the boxes in the job description, we encourage you to apply anyway.
- Experience working with evaluation design or dataset curation in multi-agentic systems
- 5+ years building or evaluating ML systems, including hands-on work with LLMs or LLM-based agents.
- 2+ years experience managing small to medium teams preferred.
- A graduate degree (MS or PhD) in machine learning, NLP, computer science, statistics or a related field, or equivalent applied research experience.
- A track record of original ideas in machine learning, or clear improvements on existing ones, shown through first-author publications or projects you led end-to-end.
- The ability to own a research agenda: pick the problems worth solving, and carry long-running projects without being directed.
- A track record of shipping ML work in a product setting, working closely with engineers and product managers.
- Experience setting technical direction for others: mentoring researchers or engineers, reviewing methodology, and raising the quality of work you did not do yourself.
- Familiarity with how AI systems are benchmarked, and a clear view of how benchmark scores can mislead.
- Sound statistical judgment: experimental design, variance, significance and agreement between human and automated raters.
- Good judgment about trade-offs, including when a practical solution now serves customers better than a more complete one later.
- Clear writing, and the ability to explain methodology to non-specialists and to defend it to skeptical audiences.
What Can Help Your Application Stand Out:
- Research experience in agent evaluation, user simulation, or human and AI-based judging.
- Experience with conversational, voice, retrieval-based or tool-using AI systems.
- Contributions to open-source evaluation tools or public leaderboards.
- Familiarity with business software workflows.
- A considered view on the effects of AI technology on the people and markets it reaches.
- Publications at ACL, EMNLP, NeurIPS, ICML, ICLR, COLM or similar venues.
Our Commitment to Inclusivity and Diversity
At G2, we are committed to creating an inclusive and diverse environment where people of every background can thrive and feel welcome. We consider applicants without regard to race, color, creed, religion, national origin, genetic information, gender identity or expression, sexual orientation, pregnancy, age, or marital, veteran, or physical or mental disability status.
-
How We Use AI Technology in Our Hiring Process
G2 incorporates AI-powered technology to enhance our candidate evaluation process. These tools may assist with initial application screening, skills assessment analysis, and identifying candidates whose qualifications align with specific role requirements. While AI technology supports our recruitment workflow, all final hiring decisions remain under human oversight and judgment.
Your Choice Matters: If you would prefer that your application be reviewed without AI assistance, you can opt out by entering your email address in the email entry field at the bottom of the Automated Processing Legal Notice. Choosing to opt out will not disadvantage your application in any way—we will ensure your materials receive a thorough manual review by our hiring team.
For additional details about how we handle your information throughout the application process, please review G2's Applicant Privacy Notice.
Compensation Range: $190K - $235K
Salary Context
This $190K-$235K range is above the median for Research Scientist roles in our dataset (median: $196K across 91 roles with salary data).
Role Details
About This Role
Research Scientists push the boundaries of what AI can do. They design experiments, develop novel architectures, publish papers, and translate research breakthroughs into production capabilities. This is where the fundamental advances happen, from attention mechanisms to diffusion models to reasoning chains.
The work is intellectually demanding and often ambiguous. You might spend months on an approach that doesn't pan out. The best research scientists combine deep mathematical intuition with engineering pragmatism. They know when to go deep on theory and when to run experiments. They read papers voraciously and can spot incremental contributions from genuine breakthroughs.
Across the 10,419 AI roles we're tracking, Research Scientist positions make up 2% of the market. At G2, this role fits into their broader AI and engineering organization.
Research Scientist roles are concentrated at major AI labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR) and well-funded AI startups. The competition is intense. PhD is effectively required for most positions, and publication track record matters. Compensation is among the highest in AI, reflecting both the scarcity of talent and the strategic importance of research breakthroughs.
What the Work Looks Like
A typical week includes: reading and discussing recent papers with your team, designing and running experiments on multi-GPU clusters, analyzing results and iterating on hypotheses, writing up findings for internal review or publication, and collaborating with engineering teams to productionize promising results. The ratio of thinking to coding is higher than in engineering roles.
Research Scientist roles are concentrated at major AI labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR) and well-funded AI startups. The competition is intense. PhD is effectively required for most positions, and publication track record matters. Compensation is among the highest in AI, reflecting both the scarcity of talent and the strategic importance of research breakthroughs.
Skills Required
PhD strongly preferred for most roles. Deep expertise in a specific area (NLP, computer vision, reinforcement learning, multimodal) is expected. PyTorch is the standard. Publication track record matters. Strong mathematical foundations in linear algebra, probability, optimization, and information theory are assumed.
Beyond the fundamentals, companies value experience with large-scale distributed training, novel architecture design, and the ability to bridge theory and practice. Understanding of current frontier topics (reasoning, multimodal, long-context, alignment) is essential. Code quality matters more than many researchers expect. Labs want researchers who can implement their ideas cleanly.
Strong research postings specify the research area, mention the team you'd join, and describe the problems they're working on. They often list recent publications from the team. Vague 'AI research' postings without specifics usually mean the company wants to sound impressive but doesn't have a real research agenda.
Compensation Benchmarks
Research Scientist roles pay a median of $223,400 based on 917 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $230,000. This role's midpoint ($212K) sits 5% below the category median. Disclosed range: $190K to $235K.
Across all AI roles, the market median is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. For comparison, the highest-paying categories include AI Safety ($274,500) and Research Engineer ($252,000). By seniority level: Entry: $114,400; Mid: $193,200; Senior: $230,000; Director: $272,100; VP: $235,000.
G2 AI Hiring
G2 has 1 open AI role right now. They're hiring across Research Scientist. Based in Remote, US. Compensation range: $235K - $235K.
Remote Work Context
Remote AI roles pay a median of $188,000 across 2,811 positions. About 6% of all AI roles offer remote work.
Career Path
Common paths into Research Scientist roles include PhD Student, Research Engineer, Postdoc.
From here, career progression typically leads toward Research Lead, Distinguished Scientist, VP of Research.
The PhD is the entry point for most paths. Choose your advisor and research area carefully since they'll define your first industry position. Publish consistently, contribute to open-source projects in your area, and build relationships at conferences. Industry research offers better compensation and compute resources than academia, but the pressure to show product impact is real.
What to Expect in Interviews
Research interviews are multi-stage: a research talk (present your best paper), technical deep-dives on your methodology, and often a 'research proposal' exercise where you design an experiment to test a hypothesis. Coding rounds test implementation ability alongside theoretical knowledge. Be prepared to implement a paper from scratch and discuss the design choices the authors made. Strong candidates can critique papers constructively and identify gaps in experimental methodology.
When evaluating opportunities: Strong research postings specify the research area, mention the team you'd join, and describe the problems they're working on. They often list recent publications from the team. Vague 'AI research' postings without specifics usually mean the company wants to sound impressive but doesn't have a real research agenda.
AI Hiring Overview
The AI job market has 10,419 open positions tracked in our dataset. By seniority: 117 entry-level, 4,975 mid-level, 3,840 senior, and 1,487 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (580 positions). The remaining 9,776 roles require on-site or hybrid attendance.
The market median for AI roles is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. Highest-paying categories: AI Safety ($274,500 median, 90 roles); Research Engineer ($252,000 median, 580 roles); AI Engineering Manager ($250,811 median, 72 roles).
Research Scientist roles are concentrated at major AI labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR) and well-funded AI startups. The competition is intense. PhD is effectively required for most positions, and publication track record matters. Compensation is among the highest in AI, reflecting both the scarcity of talent and the strategic importance of research breakthroughs.
The AI Job Market Today
The AI job market spans 10,419 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,849), AI Product Manager (516), AI Software Engineer (513). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.
The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (117) are outnumbered by mid-level (4,975) and senior (3,840) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,487 positions, representing the bottleneck between technical execution and organizational strategy.
Remote work availability sits at 6% of all AI roles (580 positions), with 9,776 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.
AI compensation is structured in clear tiers. The market median sits at $214,834. Top-quartile roles start at $266,000, and the 90th percentile reaches $321,730. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.
Category matters for compensation. AI Safety roles lead at $274,500 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.
The most in-demand skills across all AI postings: Python (2,350 postings), Aws (1,173 postings), Azure (1,030 postings), Rag (986 postings), Gcp (714 postings), Pytorch (649 postings), Kubernetes (583 postings), Claude (581 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.
Frequently Asked Questions
Get Weekly AI Career Intelligence
Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.