Threat Investigator (Trust & Safety)

Threat Investigator (Trust & Safety)

Our team needs additional support to respond to critical safety incidents and conduct investigations across a range of abuse areas including but not limited to Violence, Hate, Mental Health, CBRN, Child Safety, and more

As a threat investigator, you will be supporting our Investigations Team and responsible for detecting and/or responding to malicious uses and abuse, investigating the activity, drafting reports based on your findings, and making recommendations. This will require experience investigating threat actors, harmful behaviors, and/or other activities; as well as a strong ability to use SQL and Python to query, transform, and understand data. You will also respond to escalations and reactive leads, including those that are not caught by our existing safety systems.

Responsibilities:

Proactively detect and reacquire bad actors on our platform
Investigate potentially policy-violating activity by querying internal data sources (using SQL and Python) and cross-referencing open-source information
Document and share investigative findings with internal stakeholders

Required Skills:

3+ years of experience working on related topics
U.S.-based, with the ability to work West Coast hours (9am - 5pm PT)
Ability to be on-call that will involve resolving urgent escalations outside of normal work hours, including occasional evenings and weekends
Familiarity with technical investigations, and detection pipelines, especially using SQL and Python
Familiarity with one of the following topics/areas: AI safety, child safety, digital mental health, fraud abuse, radicalization/persuasion/grooming; hateful activities and groups
Ability to rapidly switch across domains, modalities, and abuse areas, to include violent activities and child safety
Excited to work in a fast paced, ambiguous, and purposeful space with high impact across users and beyond
Bonus Points if you are proficient in Arabic, Chinese, Farsi, Portuguese, Russian, or Spanish

This role includes serving in an on-call capacity that will involve resolving urgent escalations outside of normal work hours, occasionally including evenings and weekends. The typical on-call rotation is 7 consecutive days every 6-8 weeks

Pay Rate:

$50-$60/hour