Location: San Francisco, CA | New York City, NY | Washington, DC
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
As a Safeguards Enforcement Analyst on the account abuse team, you'll build and execute enforcement workflows that keep our products safe, with a focus on detecting and mitigating potential harm. Your initial focus will be account compromise: Anthropic's enforcement systems have to distinguish customers whose accounts have been compromised from actors abusing the platform — and today those two populations can look identical in the data. Stolen credentials and leaked keys are a growing abuse vector, and the collateral damage from enforcement against them lands on legitimate users. You'll own this problem end to end: detection, revocation, user notification, remediation, and the criteria for restoring access — turning what is today ad hoc incident response into a scalable, repeatable program.
This position may expand into broader areas of enforcement over time. Safety is core to our mission, and you'll help shape policy enforcement so that our users can safely interact with and build on top of our products in a harmless, helpful, and honest way.
Key responsibilities
Investigate credential-compromise incidents across first-party and third-party platforms, tracing actor behavior across accounts and surfaces
Design and operate remediation workflows for compromised accounts: revocation, customer notification, and standards for restoring access
Partner with Engineering and Data Science teams to improve how we separate compromised-customer traffic from willful abuse
Enforce usage policies with a focus on detecting and mitigating potentially harmful use of AI systems
Work with threat intelligence on emerging credential-abuse patterns and the actors behind them
Support the Safeguards policy design team by providing detailed feedback on policy gaps based on real enforcement scenarios
Keep up to date with emerging AI policy enforcement best practices, and use these to inform our decision-making and workflows
Write the policy framework for compromise scenarios, including cases where Anthropic can't independently verify a customer's security posture
Act as the enforcement SME when account compromise intersects with active abuse investigations
Minimum qualifications
Experience in trust and safety, fraud investigation, security operations, or a related field
Subject matter expertise in one or more of: account takeover, credential abuse, session security, or incident response
Experience designing or operating enforcement, remediation, or customer-recovery flows — not just detection
Comfort using data (SQL or similar tools) to trace actor behavior across accounts and to measure what's working
A thoughtful perspective on the tension between protecting the platform and restoring access for legitimate compromised customers
Strong written communication skills, with experience producing clear briefs about messy incidents for technical and non-technical stakeholders
Excellent judgment and the ability to collaborate with team members while navigating rapidly evolving priorities and workstreams
Preferred qualifications
Familiarity with credential-theft ecosystems or threat intelligence tooling
Experience working with fraud/risk vendors (e.g., device or network intelligence platforms)
Experience with API platform abuse specifically, not just consumer-account ATO
A deep interest in AI safety and responsible technology development
Experience writing effective prompts for generative AI systems in a content review or enforcement context
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$245,000
—
$285,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA | New York City, NY | Washington, DC
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
As a Safeguards Enforcement Analyst on the account abuse team, you'll build and execute enforcement workflows that keep our products safe, with a focus on detecting and mitigating potential harm. Your focus will be driving a number of enforcement areas including access controls and identity verification. You'll own the policy layer of these systems: what we ask users for, when, on what grounds, and what passes. The work sits at the intersection of policy, operations, and regulatory exposure.
This position may expand into broader areas of enforcement over time. Safety is core to our mission, and you'll help shape policy enforcement so that our users can safely interact with and build on top of our products in a harmless, helpful, and honest way.
Key responsibilities
Set collection policy for identity signals: what we request, in which enforcement states, and what evidence reinstates access
Improve verification program health — accuracy, appeal coverage, and consistency of outcomes
Own access policy for hard cases, including geographic restrictions and reseller arrangements
Run the operational queue for access-control cases alongside contractor support, authoring playbooks and QA'ing scaled review output
Work with Legal, Public Policy, and Privacy stakeholders to keep our approach proportionate, privacy-preserving, and responsive to an evolving regulatory landscape
Coordinate enforcement consistency with third-party platform partners
Keep up to date with emerging AI policy enforcement best practices, and use these to inform our decision-making and workflows
Stand up graduated enforcement in practice — verification requests, conditional reinstatement, and appeal pathways that satisfy regulatory requirements for automated decisions
Minimum qualifications
Experience in trust & safety, integrity, or risk policy work
Hands-on operational experience — you've owned or quality-checked live enforcement queues, not only authored policy
Subject matter expertise in one or more of: KYC, identity verification, age or identity assurance, or verification program operations
Experience navigating evolving regulatory landscapes (including frameworks like the DSA and GDPR) as design constraints rather than blockers
Experience driving cross-functional initiatives with Product, Engineering, Legal, and Policy partners — especially where safety, privacy, and usability tradeoffs need to be navigated together
Comfort using data (SQL or similar tools) to measure what's working and inform decisions
Strong written communication skills, with experience producing clear briefs and recommendations for technical and non-technical stakeholders
Excellent judgment and the ability to make consistent, defensible calls on ambiguous cases
Preferred qualifications
Experience with graduated/tiered enforcement systems rather than binary ban models
Experience with geographic access restrictions, sanctions screening, or reseller/channel policy
Experience building or scaling a contractor review bench
A deep interest in AI safety and responsible technology development
Experience writing effective prompts for generative AI systems in a content review or enforcement context
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$285,000
—
$330,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: New York City, NY; San Francisco, CA
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
The Safeguards team is responsible for ensuring our models and products are developed and deployed safely. We're looking for engineers for our Review Tooling team, which builds the systems that humans — and increasingly Claude — use to investigate potential harms and take enforcement actions across Anthropic's first-party products and third-party cloud platforms.
You'll own the tools our safety investigators rely on to understand what's happening on our platforms and act on it, as well as the platform underneath those tools. That platform includes data analysis capabilities, privacy-preserving primitives that keep review workflows compatible with our data retention commitments, and a sandbox environment where new review interfaces and workflows can be built and iterated quickly.
These are internal tools, but they are anything but low-stakes: the speed, clarity, and reliability of this tooling directly determines how quickly Anthropic can identify harmful behavior, make sound enforcement decisions, and feed signals back into model training and safety classifiers. You'll partner closely with policy, operations, data science, legal, and privacy teams to ensure our enforcement systems are effective, accurate, and trustworthy.
Key responsibilities
Build investigation, review, and enforcement tooling for both first-party and third-party platform surfaces — including case queues, investigation views, decision and audit logging, and account-actioning workflows
Develop the platform layer of reusable APIs, data storage, and backend services that lets new review workflows be stood up quickly and safely
Stand up and run deployments of this tooling across multiple clouds, including inside cloud-provider partner environments where data must stay in place. Keep the deployments consistent through shared deployment pipelines, smoke tests, observability, and alerting
Scale review through automation, including enabling reviewers to use Claude effectively and building toward Claude-assisted and Claude-driven review workflows
Partner with policy, operations, legal, privacy, and data science stakeholders to translate enforcement and investigation needs into reliable, well-designed systems that measurably reduce handling time and decision error
Instrument the tools you ship — surfacing metrics on queue health, reviewer throughput, and decision quality — and ensure tooling evolves alongside new privacy primitives and data retention commitments
Minimum qualifications
A technical background in full-stack or platform engineering, with the ability to engage deeply in architecture and design discussions
Experience shipping internal tools or platforms with demanding operational users, and a track record of improving their workflows measurably
Experience working cross-functionally with non-engineering partners such as operations, policy, or legal teams
Excellent communication skills, including the ability to explain technical tradeoffs to non-technical stakeholders
Care about the societal impacts of AI and want your work to make powerful systems safer
Preferred qualifications
8+ years of industry software engineering experience
Experience building data labeling, trust and safety, integrity, fraud, or abuse-prevention tooling, or other systems supporting human review at scale
Have built systems that handle sensitive or regulated data, with requirements around access control, auditability, retention, and data residency
Have worked across multiple cloud providers, or built infrastructure designed to be provider-agnostic
A product-minded approach to internal users: you work directly with the people using your tools, watch where they struggle, and fix it
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$320,000
—
$485,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA | New York City, NY | Washington, DC
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
As an Enforcement Analyst focused on Bio Harms, you will play a critical role in protecting against the misuse of AI systems for biological and related CBRNE harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating bio risks, investigating potential violations, and help continuously strengthen our safeguards. The work sits at the intersection of biosecurity threat analysis and platform enforcement: you will read real model interactions and make fast, well-reasoned calls about whether activity is benign research or a credible attempt at harm.
This role is a fit for someone who understands the dual-use nature of biology and enabling technologies well enough to separate the benign from the malicious. You will own and continuously improve the enforcement monitoring workflows for the bio-harms area, and you will work closely with Policy, Threat Intelligence, Data Science, and Engineering cross-functional partners to accomplish tasks at scale. Safety is core to our mission, and your work will directly protect individuals, communities, and critical systems.
Important context for the role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including material of a sexual, violent, or psychologically disturbing nature. The role also carries a shared on-call responsibility across the Policy and Enforcement teams.
Key responsibilities
Enforce Usage Policies with a specific focus on detecting and mitigating potential bio risks and harmful use of AI systems.
Take ownership of enforcement monitoring workflows for the bio-harms area, improving end-to-end detection, investigation, triage, and escalation processes.
Monitor and analyze platform activity to identify emerging patterns related to biological (and adjacent chemical, radiological, nuclear, and explosive) threats that may require policy updates or enforcement action.
Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
Proactively surface trends and propose improvements to detection methods and review workflows.
Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for bio-related policy violations.
Partner with Policy and Threat Intelligence groups to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to potential bio-related Usage Policy violations.
Minimum qualifications
Hold a degree in a bio-related field (e.g., microbiology, molecular biology, biochemistry, public health) and/or relevant professional experience in a related field.
Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts.
Can analyze complex, ambiguous situations and make well-reasoned, defensible decisions under time pressure.
Are proactive and self-directed: you spot trends, dig in, and ship improvements on your own initiative.
Communicate clearly in writing and can translate technical bio concepts for diverse audiences, including both technical and non-technical stakeholders.
Preferred qualifications
Subject matter expertise in biodefense, biosecurity, WMD/CBRNE non-proliferation, or threat-intelligence.
An understanding of where real-world biological risk actually lies — adversary intent, acquisition and weaponization pathways, and dual-use concerns, including familiarity with cross-platform threat analysis and open-source intelligence (OSINT) techniques relevant to weapons of mass destruction.
Proficiency in SQL and/or other data analysis tools to draw insights from large datasets and monitor enforcement workflow health.
Familiarity with dual-use research of concern (DURC), select agents, and relevant policy frameworks.
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$245,000
—
$285,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA | New York City, NY | Washington, DC
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
As an Enforcement Analyst focused on Chem & Explosives Harms, you will play a critical role in protecting against the misuse of AI systems for chemical and explosives harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating these risks, investigating potential violations, and help continuously strengthen our safeguards. The work sits at the intersection of chemical and explosives threat analysis and platform enforcement: you will read real model interactions and make fast, well-reasoned calls about whether activity is benign research or a credible attempt at harm.
This role is a fit for someone who understands the dual-use nature of chemistry and explosives technologies well enough to separate the benign from the malicious — and who acts decisively under ambiguity. You will own and continuously improve the enforcement monitoring workflows for this harm area, and you will work closely with Policy, Threat Intelligence, Data Science, and Engineering matrix partners to accomplish tasks at scale. Safety is core to our mission, and your work will directly protect individuals, communities, and critical systems from AI-facilitated weapons harm.
Important context for the role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including material of a sexual, violent, or psychologically disturbing nature. The role also carries a shared on-call responsibility across the Policy and Enforcement teams.
Key responsibilities
Enforce Usage Policies with a specific focus on detecting and mitigating potential chemical and explosives risks and harmful use of AI systems.
Take ownership of enforcement monitoring workflows for the chemical and explosives harm area, improving end-to-end detection, investigation, triage, and escalation processes.
Monitor and analyze platform activity to identify emerging patterns related to chemical and explosives threats (within the broader CBRNE landscape) that may require policy updates or enforcement action.
Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
Proactively surface trends and propose improvements to detection methods and review workflows without waiting to be directed.
Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for policy violations.
Partner with Policy and Threat Intelligence teams to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to chemical and explosives policy violations.
Minimum qualifications
Hold a degree in a chemistry-related field (e.g., chemistry, chemical engineering, materials science) and/or relevant professional experience in a related field.
Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts.
Can analyze complex, ambiguous situations and make well-reasoned, defensible decisions under time pressure.
Are proactive and self-directed: you spot trends, dig in, and ship improvements on your own initiative.
Communicate clearly in writing and can translate technical chemistry concepts for diverse audiences, including both technical and non-technical stakeholders.
Preferred qualifications
Subject matter expertise in chemical and explosives defense, security, WMD/CBRNE non-proliferation, or threat-intelligence.
An understanding of where real-world chemical and explosives risk actually lies — adversary intent, acquisition and weaponization pathways, and dual-use concerns, including familiarity with cross-platform threat analysis and open-source intelligence (OSINT) techniques relevant to weapons of mass destruction.
Proficiency in SQL and/or other data analysis tools to draw insights from large datasets and monitor enforcement workflow health.
Familiarity with the Chemical Weapons Convention (CWC), scheduled chemicals, precursor controls, and energetic-materials safety frameworks.
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$245,000
—
$285,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA | New York City, NY | Washington, DC
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
As a Safeguards Enforcement Analyst on the Child Safety team, you will be responsible for our child safety enforcement workflows, responsible for scaling, maintaining, and continuously improving the systems and processes we use to detect and respond to child sexual abuse material (CSAM) and child sexual exploitation material (CSEM) generated or facilitated through Anthropic's products.
This is a deeply operational role. You will serve as the central point of contact for those who conduct content review, managing day-to-day workflows, quality assurance, and escalation processes to ensure reviews are accurate, consistent, and conducted with appropriate support structures in place. You will also work closely with internal Engineering, Policy, and Legal teams to scale detection systems and close enforcement gaps as the threat landscape evolves.
This work is essential to Anthropic's mission. Child safety is one of our highest-priority harm areas, and the person in this role will have a direct and meaningful impact on protecting children from AI-facilitated exploitation and abuse.
Important context for this role: In this position you will regularly be exposed to and engage with explicit content of a sexual nature involving minors, as well as content that may be violent or psychologically disturbing. Anthropic takes the wellbeing of team members working in this area seriously and provides access to wellness resources and support. Candidates should carefully consider this aspect of the role before applying.
Key responsibilities
Own the day-to-day operational management of child safety content review workflows, including task routing, queue management, escalation handling, and SLA monitoring
Serve as the primary point of contact for review partners conducting child safety content review, including onboarding, training, quality assurance, and ongoing relationship management
Design and improve enforcement workflows to scale effectively as volume grows, while maintaining high accuracy and consistency across review decisions
Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for CSAM, CSEM, and related child safety policy violations
Review novel or ambiguous flagged content to drive enforcement decisions and surface policy gaps to the Safeguards policy design team
Develop and maintain internal documentation, decision trees, and review guidelines that enable accurate and consistent enforcement at scale
Keep up to date with emerging AI policy enforcement best practices, evolving legal frameworks, and developments in child safety technology, and use these to inform our workflows
Identify and report trends in misuse patterns to internal stakeholders, including Policy, Legal, and Trust & Safety leadership
Coordinate reporting obligations to relevant external bodies (e.g., NCMEC) in accordance with applicable law and Anthropic policy
Minimum qualifications
Experience in trust & safety, content moderation operations, or policy enforcement with direct exposure to child safety, CSAM/CSEM, or related child protection harm areas
Experience managing or coordinating content review operations, including quality assurance and workflow management
Experience standing up and scaling policy enforcement or content review workflows
Proficiency in SQL and/or other data analysis tools to monitor workflow health, review queue metrics, and surface enforcement trends
Experience identifying emerging risks and communicating findings to cross-functional stakeholders, such as Product, Policy, Engineering, and Legal teams
Understanding of the challenges involved in implementing product policies at scale in the content moderation space
Preferred qualifications
Deep subject matter expertise in child safety, child sexual exploitation and abuse (CSEA), or online child protection, including familiarity with CSAM/CSEM classification standards (e.g., COPINE, SAM scale)
Experience working with or reporting to NCMEC, IWF, or equivalent child safety reporting bodies
Familiarity with relevant legal and regulatory frameworks, including CSAM reporting obligations, KOSA, COPPA, or equivalent international frameworks
Experience working with generative AI products, including an understanding of how AI systems can be misused to generate or facilitate CSEA
Experience designing or evaluating trauma-informed support structures and wellness protocols for content reviewers working with harmful material
Proficiency in Python for workflow automation or data analysis
Experience working with hash-matching technologies (e.g., PhotoDNA, CSAI Match) or perceptual hashing tools used in CSAM detection
Familiarity with age assurance technologies and their role in child safety enforcement
Experience in a trust & safety role at a technology company, with an understanding of how platform policy intersects with child protection obligations
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$245,000
—
$285,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA | New York City, NY | Washington, DC
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
As a Safeguards Enforcement Analyst on the user well-being team, you'll build and execute enforcement workflows that keep our products safe, with a focus on detecting and mitigating potential harm. Your initial focus will be on how Anthropic handles age. A core part of this work is making sure our consumer products reach the right audiences, including the detection signals, verification paths, and appeals workflows that keep underage users off surfaces not designed for them. Claude also reaches younger users through third-party developers building on our API, and you'll be the enforcement partner that sales and platform teams rely on when those customers need guidance on deploying age-appropriately.
This position may expand into broader areas of user well-being enforcement over time. Safety is core to our mission, and you'll help shape policy enforcement so that our users can safely interact with and build on top of our products in a harmless, helpful, and honest way.
Important context for this role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a sexual, violent, or psychologically disturbing nature. There is also an on-call responsibility across the Policy and Enforcement teams.
Key responsibilities
Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy
Partner with Engineering and Data Science teams to optimize detection models for policy violations and automated enforcement systems
Review flagged content to drive enforcement and policy improvements
Enforce usage policies with a focus on detecting and mitigating potential harmful use of AI systems
Work with Legal, Public Policy, and Privacy stakeholders to keep our age assurance approach proportionate, privacy-preserving, and responsive to an evolving regulatory landscape
Support the Safeguards policy design team by providing detailed feedback on policy gaps based on real enforcement scenarios
Keep up to date with emerging AI policy enforcement best practices, and use these to inform our decision-making and workflows
Responsible for Anthropic's layered age assurance approach - self-declaration, behavioral signals, verification, and ban appeals - to keep our first-party consumer products safe
Adjacent user well-being enforcement where age is a key factor in how policy is applied such as sexual content and illicit substances
Minimum qualifications
Experience in trust and safety, online child safety, age assurance, privacy, product policy, or a related field
Subject matter expertise in one or more of: age assurance or age verification systems, age-appropriate design, child online safety, privacy-preserving verification methods, or content classification for young people
Experience driving cross-functional initiatives with Product, Engineering, Legal, and Policy partners — especially where safety, privacy, and usability tradeoffs need to be navigated together
Experience navigating evolving regulatory landscapes and enforcement best practices with regards to age assurance (including frameworks like the UK AADC, COPPA, and the DSA), CSAM/CSEM, NCII, and digital well-being
A thoughtful perspective on the privacy/safety tradeoffs inherent in age verification — including when less invasive approaches are the right call
Strong written communication skills, with experience producing clear briefs and recommendations for technical and non-technical stakeholders
Comfort using data (SQL or similar tools) to measure what's working and inform decisions
Excellent judgment and the ability to collaborate with team members while navigating rapidly evolving priorities and workstreams
Preferred qualifications
Experience building or operating age-gating flows, age estimation signals, underage account detection, or appeals workflows
Experience advising or partnering with third-party platforms on deploying safely to younger users
Experience working with or evaluating third-party age verification providers
A deep interest in AI safety and responsible technology development
Experience writing effective prompts for generative AI systems in a content review or enforcement context
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$245,000
—
$285,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA | New York City, NY | Washington, DC
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
As an Enforcement Analyst, you will be responsible for reviewing content and executing enforcement actions across our products and services, with a focus on detecting and mitigating attempts to misuse Anthropic's AI systems for malicious cyber operations. Your initial focus will center on reviewing flagged activity related to cyberattacks, malware development, and offensive exploitation; however, this position may later expand to include broader areas of enforcement.
Safety is core to our mission, and you'll help uphold policy enforcement so that our users can safely interact with and build on top of our products in a harmless, helpful, and honest way.
Important context for this role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a violent, technical, or psychologically disturbing nature. This role may require responding to escalations during weekends and holidays.
Key responsibilities
Review flagged content and accounts to make accurate, well-documented enforcement decisions in line with our usage policies
Detect and mitigate potential misuse of AI systems to facilitate cyberattacks, malware creation, exploitation tooling, and related harmful cyber operations
Triage and escalate novel, ambiguous, or high-severity cases to appropriate stakeholders
Provide detailed feedback to the Safeguards policy design team on policy gaps surfaced through real enforcement scenarios
Partner with Engineering and Data Science teams by surfacing detection model errors and quality signals from review to improve precision and recall
Maintain high accuracy and consistency standards across review queues
Keep up to date with emerging AI policy enforcement best practices, threat actor tactics, and the evolving cyber threat landscape, using these to inform enforcement decisions
Minimum Qualifications
Experience in cybersecurity, including knowledge of offensive techniques, exploit development, malware analysis, or vulnerability research
Experience performing content review, abuse investigations, or policy enforcement at volume
Proficiency in SQL and/or Python for data analysis and threat detection
Experience identifying emerging risks and communicating findings to a diverse set of stakeholders, such as Product, Policy, Engineering, and Legal teams
Experience working with generative AI products, including writing effective prompts for content review and enforcement
Preferred qualifications
Experience in trust & safety, abuse investigations, cybersecurity investigations, or threat intelligence in a technology or AI company
Experience with large language models and an understanding of how AI technology could be misused for cyber operations
Experience operating within abuse monitoring programs or enforcement review systems
Understanding of the challenges involved in implementing product policies at scale, including in the content moderation space
Experience working with government agencies, regulated environments, or information sharing communities
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$285,000
—
$330,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA | New York City, NY | Washington, DC
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
As a Safeguards Analyst focusing on Integrity & Authenticity, you will be responsible for building and executing enforcement workflows for our products and services, with a focus on detecting and mitigating attempts to misuse Anthropic's AI systems for coordinated inauthentic behavior, election manipulation, and targeting, tracking, and surveillance of individuals.
Your work will span a broad and interconnected set of harm areas: AI-enabled influence operations and disinformation campaigns, the abuse of AI to interfere with electoral processes, and the use of AI systems to facilitate stalking, surveillance, profiling, and the targeting of individuals or groups. Safety is core to our mission, and you'll help shape policy enforcement so that our users can safely interact with and build on top of our products in a harmless, helpful, and honest way.
Important context for this role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including those of a political, violent, or psychologically disturbing nature. This role may require responding to escalations during weekends and holidays, particularly around major electoral events.
Key responsibilities
Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy
Partner with Engineering and Data Science teams to optimize detection models for policy violations and automated enforcement systems
Review flagged content to drive enforcement and policy improvements
Enforce usage policies with a focus on detecting and mitigating AI-enabled influence operations, coordinated inauthentic behavior, election interference, and targeting, tracking, or surveillance of individuals and groups
Support the Safeguards policy design team by providing detailed feedback on policy gaps based on real enforcement scenarios
Keep up to date with emerging AI policy enforcement best practices, evolving threat actor tactics, and the regulatory landscape around elections, privacy, and surveillance, using these to inform our decision-making and workflows
Minimum qualifications
Experience in trust & safety, policy enforcement, threat intelligence, or a closely related field with a focus on one or more of: influence operations, disinformation, coordinated inauthentic behavior, election integrity, or privacy and surveillance harms
Experience standing up and scaling policy enforcement or content review workflows
Proficiency in SQL and/or other data analysis tools to draw insights from large datasets
Experience identifying emerging risks and threat actors, and communicating findings to a diverse set of stakeholders, such as Product, Policy, Engineering, and Legal teams
Experience working with generative AI products, including writing effective prompts for content review and enforcement
Understanding of the challenges involved in implementing product policies at scale, including in the content moderation space
Preferred qualifications
Experience conducting cross-platform investigations into influence operations, coordinated inauthentic behavior, or disinformation campaigns
Familiarity with open-source intelligence (OSINT) techniques and tools used for threat actor tracking and network analysis
Working knowledge of privacy law, surveillance technology, or data broker ecosystems as they relate to targeting and tracking harms
Experience with large language models and an understanding of how AI technology could be misused to generate synthetic personas, fabricate quotes, or automate persuasion at scale
Familiarity with election security frameworks, campaign finance law, or electoral integrity standards in one or more jurisdictions
Experience navigating evolving regulatory landscapes relevant to this space (e.g., DSA, EU AI Act, FEC regulations, GDPR)
Experience working with election bodies, civil society organizations, or government agencies on integrity or disinformation-related issues
Proficiency in Python for data analysis and automation
Experience with dark web monitoring or tracking threat actors across surface, deep, and dark web environments
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$285,000
—
$330,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
Anthropic's Safeguards team is seeking a Red Team Engineer to help ensure the safety of our deployed AI systems and products. In this role, you'll take an adversarial approach to uncover vulnerabilities across our product ecosystem before they can be exploited by malicious actors. Your work will span from technical infrastructure vulnerabilities on our products to emergent risks from advanced AI capabilities.
While you'll bring best practices from traditional security approaches, the focus is on broader safety implications and novel abuse unique to advanced AI systems and associated products. You'll investigate the full spectrum of potential abuse — from coordinated account manipulation and payment fraud to novel exploitation of product features — and simulate sophisticated threat actors who chain multiple attack vectors to achieve their objectives.
Key responsibilities
Conduct comprehensive adversarial testing across Anthropic's product surfaces, developing creative attack scenarios that combine multiple exploitation techniques
Research and implement novel testing approaches for emerging capabilities, including agent systems, tool use, and new interaction paradigms
Design and execute "full kill chain" attacks that emulate real-world threat actors attempting to achieve specific malicious objectives
Build and maintain systematic testing methodologies that evaluate every aspect of our systems
Develop automated testing frameworks to enable continuous assessment at scale
Collaborate with Product, Engineering, and Policy teams to translate findings into concrete improvements
Help establish metrics for measuring detection effectiveness of novel abuse
Minimum qualifications
Experience in penetration testing, red teaming, or application security
Experience in model jailbreaking and testing large-scale agentic workflows for non-obvious prompt injection vectors
Strong technical skills in web application security, including hands-on expertise with security testing tools (e.g., Burp Suite, Metasploit, custom scripting frameworks)
Experience building custom automation, including LLM-specific testing frameworks
A track record of discovering novel attack vectors and chaining vulnerabilities in creative ways
A public body of work such as CVEs, blog posts, or disclosed bug bounty reports
Strong written and verbal communication skills, with the ability to explain technical concepts to varied audiences
Preferred qualifications
Experience with AI/ML security or adversarial machine learning
Understanding of AI safety considerations beyond traditional security, including modern guardrails against jailbreaks
Experience testing API security and rate-limiting systems
Background in testing business logic vulnerabilities and authorization bypass techniques
Background in anti-fraud, trust & safety, or abuse prevention systems
Familiarity with distributed systems and infrastructure security
Familiarity with abuse detection mechanisms and the ability to engineer novel bypasses
Adaptability to understand and build engagements around emerging threats outside your direct area of expertise
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$320,000
—
$405,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
Anthropic is dedicated to developing AI assistants that are helpful, harmless, and honest. As usage of our AI services grows, we need to ensure they are not misused. The Safeguards team is at the forefront of protecting our users from the risks of powerful AIs as well as ethical, technical, and social risks from the use of generative AI. The Safeguards team at Anthropic builds protections for new AI features enabled by the research teams and protects new products and surfaces developed by our product teams. As a Product Manager for the Safeguards team at Anthropic, you will own the ideation, design, development and deployment of Safeguards systems and relevant product UX to ensure we are advancing frontier models safely to users across various cloud platforms. You will work closely with our research and product teams to develop detections, evals, interventions, and tools to measure and mitigate deployment and user risks.
We are looking for a product manager who is deeply committed to making AI safe and beneficial for humanity. You are aware of the risks and are committed to working with experts and coming up with ideas for Anthropic to implement. You have deep technical expertise in development, deployment and measurement of Safeguards systems. You thrive in rapidly moving and ambiguous environments.
Responsibilities:
Determine how to build in safety by design upstream and leverage downstream defenses for Anthropic’s frontier models, AI products, customers on different surfaces - Claude.ai, 1P API, external Cloud providers.
Ability to write safety evals and communicate externally about safety.
Drive impact via ruthless prioritization by clearly defining problems, solution options forward, clarity on both business & technical tradeoffs and accordingly clear requirements toward MVP vs. ideal state.
Align & collaborate with policy, enforcement, research, engineering and cross functional stakeholders.
Understand the AI landscape and ecosystem to plan for mitigation of deployment risks of increasingly powerful models and determined adversaries.
Lead the development of metrics to understand the area, performance, blindspots to help inform future project planning.
Minimum Qualifications
You may be a good fit if you have:
Ability to make technical tradeoff decisions; ideally with experience working across policy experts, AI/ML research engineers and software engineering teams to design and build state of the art safety systems.
Strong user understanding of how our products are used, their Safeguards concerns and how we provide the best solutions.
Demonstrated ability to build product and engineering strategy across multiple cross-functional teams for a rapidly changing space.
Demonstrated experience in designing and building metrics to evaluate risks, system performance, user impact and making crisp tradeoffs
Very strong ability to navigate, and prioritize amidst rapidly changing product specs, and to flex into different domains to bring clarity and execute.
Evidence of exercising judgment and decision making in ambiguous situations.
Planning, building, launching and measuring new products / systems in a zero to one environment.
Ability to clearly articulate complex technical concepts to non-technical audiences in written and verbal communication.
Think creatively about the risks and benefits of new technologies, and think beyond past checklists and playbooks.
Preferred Qualifications
5+ years in product management with a focus on fast problem understanding, building roadmaps with tractable progress, ability to get into the details on data, detection & interventions, infrastructure & tools, and/or evals.
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$305,000
—
$385,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
The Safeguards team is responsible for ensuring our models and products are developed and deployed safely. We're looking for an Engineering Manager to lead our Review Tooling team, which builds the systems that humans — and increasingly Claude — use to investigate potential harms and take enforcement actions across Anthropic's first-party products and third-party cloud platforms.
This is a foundational role: you'll own the tools our safety investigators rely on to understand what's happening on our platforms and act on it, as well as the platform underneath those tools. That platform includes analytics capabilities, privacy-preserving primitives that keep review workflows compatible with our data retention commitments, and a sandbox environment where new review interfaces and workflows can be built and iterated quickly. As model capabilities and usage grow, you'll also drive how we scale review through automation — building systems where Claude meaningfully extends what human reviewers can do, while keeping people in the loop where their judgment matters most.
You'll partner closely with policy, operations, data science, and legal teams to ensure our enforcement systems are effective, accurate, and trustworthy.
Key responsibilities
Lead, grow, and develop a team of engineers building investigation, review, and enforcement tooling for both first-party and third-party platform surfaces
Define the vision and roadmap for our review tooling platform, including analytics, privacy-compatible data access primitives, and a sandbox for rapidly developing new review interfaces
Drive the team's strategy for scaling review through automation, including enabling reviewers to use Claude effectively and building toward Claude-assisted and Claude-driven review workflows
Partner with policy, operations, legal, privacy, and data science stakeholders to translate enforcement and investigation needs into reliable, well-designed systems
Ensure review tooling evolves alongside new privacy primitives and data retention commitments, so reviewers can do their work without compromising user trust
Create clarity for the team and stakeholders in an ambiguous and evolving environment
Take an inclusive, equitable approach to hiring and coaching top technical talent, and maintain a high-performing team
Contribute to engineering-wide initiatives as a member of Anthropic's engineering management community
Minimum qualifications
Experience managing software engineering teams, including hiring, coaching, and developing engineers
A technical background in full-stack or platform engineering, with the ability to engage deeply in architecture and design discussions
Experience shipping internal tools or platforms with demanding operational users, and a track record of improving their workflows measurably
Experience working cross-functionally with non-engineering partners such as operations, policy, or legal teams
Excellent communication skills, including the ability to explain technical tradeoffs to non-technical stakeholders
Care about the societal impacts of AI and want your work to make powerful systems safer
Preferred qualifications
4+ years of management experience, 10+ years of industry software engineering experience
Experience building trust and safety, integrity, fraud, or abuse-prevention tooling, or other systems supporting human review at scale
Experience designing systems under strict privacy, compliance, or data governance constraints, such as zero data retention environments
Experience integrating LLMs or agentic systems into operational workflows, or building human-in-the-loop automation
Experience building developer platforms or extensible tooling frameworks that other teams build on top of
Experience supporting enforcement or moderation systems across multiple product surfaces, including enterprise or cloud platform contexts
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$405,000
—
$485,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: New York City, NY; San Francisco, CA; Seattle, WA
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
As an early member of our Safeguards Data Science and Analytics team, you will play an instrumental role in our company’s mission of building safe and beneficial artificial intelligence by building and scaling a data driven culture from the ground up. In this unique company, technology, and moment in history, your work will be critical to informing our product and commercial strategy as we deploy safe, frontier AI at scale to the world.
You will work closely with product, engineering, policy & enforcement to define and measure key company success metrics, analyze user behavior to identify new enforcement opportunities and build a culture of developing and testing hypotheses through experimentation. You’ve worked in cultures of excellence in the past, and are eager to apply that experience to building robust and scalable systems and processes as our company goes through a phase of rapid growth.
Key responsibilities
Deep dive into user behavior data to provide insights on safety concerns
Define core metrics that measure the team's success. Set goals, build forecasts, monitor performance, and develop actionable reporting
Identify and size opportunities to improve the product, influencing product roadmap through your insights and recommendations
Develop hypotheses on product changes, design controlled experiments, analyze the results, and make recommendations based on impact to key metrics
Build a data driven culture from the ground up by establishing foundational data best practices and making data more accessible across the company
Minimum qualifications
Expertise in Python, SQL, and data visualization tools.
A bias for action and urgency, not letting perfect be the enemy of the effective.
A strong disposition to thrive in ambiguity, taking initiative to create clarity and forward progress.
A deep curiosity and energy for pulling the thread on hard questions.
Experience in turning open questions and data into concise and insightful analysis.
Highly effective written communication and presentation skills.
A passion for the company's mission of building helpful, honest, and harmless AI.
Preferred qualifications
8+ years of experience in data science or analytics roles, preferably in an infrastructure or operations context.
3+ years of experience deeply embedding in Product teams.
Experience working on safety, anti-abuse, integrity shaped problems.
Deadline to apply:
None. Applications will be reviewed on a rolling basis.
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$285,000
—
$380,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA | New York City, NY | Washington, DC
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the Role
Anthropic's Safeguards team is responsible for enforcing our policies, protecting users, and ensuring our platform is not misused. As a Safeguards Enforcement Analyst focused on Safety Evaluations, you'll play a central role in ensuring our models meet safety and policy standards before and after launch. You'll run and monitor evaluations, drive mitigations when issues surface, coordinate the creation of new evals, and help build the processes and documentation that allow the team to scale this work over time.
This role requires someone who is detail-oriented, comfortable navigating ambiguity, and capable of coordinating across teams to break new ground and drive work to completion. This work is deeply cross-functional — you'll partner closely with policy experts, Safeguards engineering teams, and many other stakeholders throughout the organization to ensure our evaluations are comprehensive and current, and that findings translate into meaningful improvements to model behavior.
Responsibilities
Support model launch readiness by running evaluations, monitoring and interpreting results, and surfacing regressions or unexpected behavior changes to relevant stakeholders
Partner closely with policy and domain experts throughout the evaluation lifecycle — from identifying risks and scoping the right evaluation approach, to coordinating creation of new evals and ensuring existing ones remain current with evolving policies, threat vectors, and model capabilities
Work with cross-functional stakeholders to help manage evaluation outcomes, including interpreting results and driving mitigations where needed
Think strategically about eval quality to build processes and eval paradigms that keep evaluations unsaturated, high-signal, and insightful as models improve
Build out processes and frameworks for creating product-specific evaluations as Anthropic's product surface area expands
Help design and scope tooling improvements that accommodate evolving eval needs and expand self-serve eval creation and iteration for non-technical users
Write and maintain rigorous documentation for evaluation creation, execution, and interpretation as the team builds out eval tooling and processes
You may be a good fit if you:
Have experience in trust and safety, content operations, policy enforcement, or a related operational role at a technology company
Thrive in ambiguous, fast-moving environments — you're energized rather than frustrated when the path forward isn't clearly defined and you need to figure it out as you go
Have experience building processes, workflows, or programs from scratch (zero-to-one work), not just maintaining existing ones
Have strong program management instincts, naturally creating structure around complex, multi-stakeholder efforts by tracking timelines, dependencies, and deliverables to keep work on track
Are eager to expand your technical toolkit, including adopting internal tools and AI-assisted workflows (e.g., Claude Code) to accelerate your work
Can manage multiple concurrent workstreams across different domain areas without losing track of details — strong prioritization and context-switching are essential when deadlines and priorities shift quickly
Are a strong generalist comfortable moving fluidly across different types of work and switching contexts throughout the day
Are comfortable making judgment calls with incomplete information and escalating appropriately when needed
Communicate clearly and concisely, both in writing and cross-functionally
Strong candidates may also have:
Experience operating under tight, high-stakes timelines — such as product launch cycles, incident response, or regulatory deadlines — where information and priorities can shift with little notice
Experience coordinating across engineering, policy, and product teams to translate findings into concrete action
Experience building and maintaining SOPs, runbooks, and operational documentation in fast-changing environments
Proficiency with data tools (SQL, dashboards, spreadsheets) sufficient to maintain and improve workflows
Comfort working with sensitive content areas as part of eval creation or enforcement review responsibilities
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$230,000
—
$270,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA | New York City, NY | Seattle, WA
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the Role
Safeguards Engineering builds and operates the infrastructure that keeps Anthropic's AI systems safe in production — the classifiers, detection pipelines, evaluation platforms, and monitoring systems that sit between our models and the real world. That infrastructure needs to be not just correct, but
reliable
: when a safety-critical pipeline goes down or degrades, the consequences can be serious, and they can be invisible until someone looks closely.
As a Technical Program Manager for Safeguards Infrastructure and Evals, you'll own the operational health and forward momentum of this stack. Your primary responsibility is driving reliability — owning the incident-response and post-mortem process, ensuring SLOs are defined and met in partnership with various teams, and making sure that when things go wrong, the right people know, the right actions get taken, and those actions actually get closed out. Alongside that ongoing operational rhythm, you'll coordinate the larger platform investments: migrations, eval-platform improvements, and the cross-team dependencies that connect them.
This role sits at the intersection of operations and program management. It requires genuine technical depth — you need to understand how these systems work well enough to triage effectively, judge what's actually safety-critical versus what can wait, and have informed conversations with the engineers building and maintaining them. But the core of the job is keeping the machine running well and the work moving.
What You'll Do:
Own the Safeguards Engineering ops review -
Drive the recurring cadence that keeps the team informed and coordinated: surfacing recent incidents and failures, bringing visibility to reliability trends, and making sure the right people are in the room when decisions need to be made. This is the heartbeat of how Safeguards Eng stays ahead of operational risk.
Drive incident tracking and post-mortem execution -
When incidents happen — and in this space, they happen regularly — you'll make sure they get followed through properly. That means tracking incidents across the organization (including those owned by partner teams like Inference), ensuring post-mortems get written, and most critically, making sure the action items that come out of them actually get done. Closing the loop on post-mortem actions is one of the highest-leverage things this role does.
Establish and maintain SLOs with partner teams -
Work with Safeguards Engineering teams and key partners — particularly Inference and Cloud Inference — to define service-level objectives for safety-critical pipelines. Then build the tracking and reporting that makes it possible to tell whether those SLOs are being met, and surface it when they're not.
Maintain runbook quality and incident-ownership clarity -
Safety-critical systems need clear playbooks for when things go wrong. Partner with engineering leads to keep runbooks accurate, actionable, and up to date — and ensure that ownership of incidents is unambiguous so that nothing falls through the cracks during an active incident.
Drive platform migrations and infrastructure projects -
Own the program management for the larger infrastructure work on the roadmap: migrating the infra from one platform to the next, moving from one incident platform to the next and from one cloud system monitoring to another, and other migrations as they come. These are cross-team efforts with real dependencies — your job is to keep them sequenced, on track, and connected to the teams that need them.
Coordinate evals platform improvements -
Partner with the evals engineering team to drive improvements to the evaluation platform — including self-serve capabilities and the broader eval factory infrastructure. Help scope the work, track dependencies on other Safeguards systems, and make sure the evals platform is keeping pace with the team's needs.
You might be a good fit if you:
Have solid technical program management experience, particularly in operational or infrastructure-heavy environments — you're comfortable owning a mix of ongoing operational cadences and discrete project work simultaneously.
Understand how production ML systems work well enough to triage incidents intelligently and have substantive conversations with engineers about what's going wrong and why — you don't need to write the code, but you need to follow the technical thread.
Are energized by closing loops. Post-mortem action items that never get done, SLOs that no one checks, runbooks that go stale — these things bother you, and you know how to build the processes and follow-ups that fix them.
Can work effectively across team boundaries — comfortable coordinating with partner teams (like Inference) where you don't have direct authority, and skilled at keeping shared work moving through influence and clear communication.
Thrive in environments where the work shifts between "keep the lights on" and "build something new" — and can context-switch between incident follow-ups and longer-horizon platform projects without dropping either.
Have experience with or strong interest in AI safety — you understand why the reliability of a safety-critical pipeline is a different kind of problem than the reliability of a product feature, and that distinction motivates you.
Strong candidates may also:
Have experience with SRE practices, incident management frameworks, or on-call operations at scale.
Have worked on or with evaluation infrastructure for ML systems — understanding how evals get designed, run, and interpreted.
Have experience driving infrastructure migrations in complex, multi-team environments — particularly where the migration touches operational systems that can't go offline.
Be familiar with monitoring and alerting tooling (PagerDuty, Datadog, or equivalents) and the operational culture around them.
Deadline to apply:
None, applications will be received on a rolling basis.
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$290,000
—
$365,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
Anthropic is dedicated to developing AI assistants that are helpful, harmless, and honest. As usage of our AI services grows, we need to ensure they are not misused. The Safeguards team is at the forefront of protecting our users from the risks of powerful AIs as well as ethical, technical, and social risks from the use of generative AI. The Safeguards team at Anthropic builds protections for new AI features enabled by the research teams and protects new products and surfaces developed by our product teams. As a Product Manager for the Safeguards team at Anthropic, you will own the ideation, design, development and deployment of Safeguards systems and relevant product UX to ensure we are advancing frontier models safely to users across various cloud platforms. You will work closely with our research and product teams to develop detections, evals, interventions, and tools to measure and mitigate deployment and user risks.
We are looking for a product manager who is deeply committed to making AI safe and beneficial for humanity. You are aware of the risks and are committed to working with experts and coming up with ideas for Anthropic to implement. You have deep technical expertise in development, deployment and measurement of Safeguards systems. You thrive in rapidly moving and ambiguous environments.
Responsibilities:
Determine how to build in safety by design upstream and leverage downstream defenses for Anthropic’s frontier models, AI products, customers on different surfaces - Claude.ai, 1P API, external Cloud providers.
Ability to write safety evals and communicate externally about safety.
Drive impact via ruthless prioritization by clearly defining problems, solution options forward, clarity on both business & technical tradeoffs and accordingly clear requirements toward MVP vs. ideal state.
Align & collaborate with policy, enforcement, research, engineering and cross functional stakeholders.
Understand the AI landscape and ecosystem to plan for mitigation of deployment risks of increasingly powerful models and determined adversaries.
Lead the development of metrics to understand the area, performance, blindspots to help inform future project planning.
Minimum Qualifications
You may be a good fit if you have:
Ability to make technical tradeoff decisions; ideally with experience working across policy experts, AI/ML research engineers and software engineering teams to design and build state of the art safety systems.
Strong user understanding of how our products are used, their Safeguards concerns and how we provide the best solutions.
Demonstrated ability to build product and engineering strategy across multiple cross-functional teams for a rapidly changing space.
Demonstrated experience in designing and building metrics to evaluate risks, system performance, user impact and making crisp tradeoffs
Very strong ability to navigate, and prioritize amidst rapidly changing product specs, and to flex into different domains to bring clarity and execute.
Evidence of exercising judgment and decision making in ambiguous situations.
Planning, building, launching and measuring new products / systems in a zero to one environment.
Ability to clearly articulate complex technical concepts to non-technical audiences in written and verbal communication.
Think creatively about the risks and benefits of new technologies, and think beyond past checklists and playbooks.
Preferred Qualifications
5+ years in product management with a focus on fast problem understanding, building roadmaps with tractable progress, ability to get into the details on data, detection & interventions, infrastructure & tools, and/or evals.
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$305,000
—
$385,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: London, UK
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
We are looking for software engineers to help build the foundational pieces for safety, oversight and intervention mechanisms of our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight.
Responsibilities:
Develop the foundational systems which power Safeguards, including infrastructure for data storage and management, metric and evaluation systems, and tooling for human and agentic review.
Ensure the day-to-day running of Safeguards systems and hold a high operational bar which serves both safety and customers while reducing the amount of human intervention and oversight required.
Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale
You may be a good fit if you have:
Bachelor’s degree in Computer Science, Software Engineering or comparable professional experience
Proficiency in Python
Ability to work across the stack
Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
Strong candidates may also:
7+ years of experience in a software engineering position
Have experience building trust and safety, anti-spam, fraud or abuse detection and mitigation mechanisms and interventions for AI/ML systems
Have experience building metrics and measurement systems or data and privacy management systems
Have worked closely with operational teams to build custom internal tooling
Be proficient in TypeScript or Rust
Have experience with Claude Code or similar agentic coding tools
Deadline to apply:
None. Applications will be reviewed on a rolling basis.
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
£325,000
—
£395,000 GBP
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
Location: San Francisco, CA | New York City, NY
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
About the role
We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies.
We have multiple teams that are currently hiring within Safeguards. Team placement occurs after the interview process, taking into account your interests and experience alongside organizational needs. This flexible approach allows us to match talented engineers where they'll have the greatest impact and growth potential.
Responsibilities:
Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review
Build abuse detection mechanisms and infrastructure
Surface abuse patterns to our research teams to harden models at the training stage
Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale
You may be a good fit if you:
Bachelor’s degree in Computer Science, Software Engineering or comparable professional experience
Proficiency in at least one programming language such as Python, Java, etc.
Ability to work across the stack
Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
Strong candidates may also:
8+ years of experience in a software engineering position
Have experience with integrity, spam, fraud, or abuse detection and mitigation
Have experience building trust and safety detection mechanisms and intervention for AI/ML systems
Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs
Have worked closely with operational teams to build custom internal tooling
Deadline to apply:
None. Applications will be reviewed on a rolling basis.
The annual compensation range for this role is listed below.
For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.
Annual Salary:
$320,000
—
$485,000 USD
Logistics
Minimum education:
Bachelor’s degree or an equivalent combination of education, training, and/or experience
Required field of study:
A field relevant to the role as demonstrated through coursework, training, or professional experience
Minimum years of experience:
Years of experience required will correlate with the internal job level requirements for the position
Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
Visa sponsorship:
We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.
We encourage you to apply even if you do not believe you meet every single qualification.
Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.
Your safety matters to us.
To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit
anthropic.com/careers
directly for confirmed position openings.
How we're different
We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.
The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.
Come work with us!
Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.
Guidance on Candidates' AI Usage:
Learn about
our policy
for using AI in our application process.
География найма не уточнена
New York City, NY; San Francisco, CA
Не хотите искать каждый день?
Настройте подбор один раз, и подходящие вакансии будут сами приходить в Telegram.
Настройте подбор, и подходящие вакансии будут приходить в Telegram.