Staff/Lead Data Scientist (Model Evaluation) - TikTok Integrity and Safety (San Jose)

Staff/Lead Data Scientist (Model Evaluation) - TikTok Integrity and Safety (San Jose) Location: San Jose Employment Type: Regular Job Code: A128353B Responsibilities Design, build, and maintain core metrics systems related to platform content safety and risk, including but not limited to content violation, user report, and account risk identification. Develop comprehensive monitoring and anomaly detection systems to quickly identify and analyze security incidents, providing data support for risk alerts and policy adjustments. Apply rigorous statistical methods, including A/B testing, causal inference, regression analysis, and more, to evaluate the effectiveness of security policies. Analyze experiment results, provide quantitative evidence for business decisions, and continuously optimize experiment design to improve evaluation efficiency. Develop quantitative analysis systems for specific business challenges and leverage data mining techniques to identify potential optimization opportunities. Work closely with product, operations, R&D, and algorithm teams to translate analytical insights into actionable improvements and drive implementation, ultimately improving platform safety. Continuously explore and summarize data analysis methodologies, create reusable analysis frameworks and tools to improve overall analytical capabilities of the team. Participate in the design and iteration of data products, productizing data analysis capabilities to provide business teams with more efficient and convenient data services. Design and build comprehensive LLM evaluation frameworks and metric systems, leveraging strong ML Ops and statistical capabilities to conduct deep analyses that drive business strategy. Mentor team members, developing and fostering a collaborative and high-performing environment. Proactively identify and address skill gaps within the team through training and development opportunities. Collaborate with cross-functional stakeholders to define data science roadmaps and ensure alignment with business priorities. Communicate complex technical findings to both technical and non-technical audiences. Qualifications 5+ years of data science experience and Bachelor’s degree or above in statistics, data science, economics, mathematics, or a related field. Strong proficiency in SQL, skilled in using data analysis tools such as Python/R, and possesses excellent visualization skills. Familiar with common machine learning algorithm principles and understands methods such as causal inference and A/B testing. Familiarity with internet/content platform safety business. Excellent logical thinking, problem analysis and solving abilities, as well as good communication, expression, and cross-team collaboration skills. Experience in content security, integrity, or risk management is preferred. Job Information The base salary range for this position in the selected city is $219,000 - $422,400 annually. Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units. Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure). Equal Opportunity Statement For Los Angeles County (unincorporated) Candidates: Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment: Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems. Exercising sound judgment. #J-18808-Ljbffr