Senior Data Enrichment – Annotation Manager

Job Description:

• Lead the team that manually codes grants and organizations using Candid’s taxonomy, the Philanthropy Classification System, with a focus on scaling operations and improving classification accuracy and consistency.
• Partner with subject matter experts to develop and maintain additional ontologies, taxonomies, and semantic models that enable knowledge representation and reasoning across applications, including AI applications.
• Design and implement quality control processes and metrics to ensure coding quality and strong inter-rater reliability, including guidance for handling ambiguous edge cases.
• Monitor and address data quality drift, including maintaining annotator calibration and detecting shifts in labeling standards over time.
• Collaborate with Candid’s data science team to evaluate AI models (including LLMs) used for autocoding tasks.
• Coordinate efforts to generate the training data needed to build effective AI/ML solutions.
• Build strong relationships with key teams across Candid to understand how knowledge engineering can support their needs and advance desired outcomes.

Requirements:

• 7+ years of experience in taxonomy development, data annotation operations, knowledge management, or related fields
• 3+ years managing teams that perform manual data coding, classification or annotation work
• Proven experience designing and implementing taxonomies, ontologies, or classification systems used across multiple applications
• Experience designing annotation guidelines or codebooks that achieve high inter-annotator agreement
• Demonstrated ability to balance quality with throughput when scaling coding operations
• Demonstrated ability to translate complex domain knowledge into structured frameworks
• Experience working cross-functionally with technical teams, product managers, and subject matter experts
• Excellent communication skills across technical and non-technical audiences
• Experience with AI/ML applications and their use in classification or coding tasks
• Familiarity with semantic web technologies, knowledge graphs, or linked data
• Experience with data annotation and training data generation for machine learning models
• Background in the nonprofit or philanthropic sector a bonus
• Willingness to perform other duties and special projects as needed/requested.

Benefits:

• Health insurance (medical, dental, vision)
• Retirement contribution with additional option for a match
• Paid life insurance and AD&D
• Paid leave time (PTO, compassionate leave, volunteer, holiday, parental)
• Short-term and long-term disability
• Pre-tax transit
• Flexible spending accounts
• Supplemental insurance
• Summer hours
• Public Service Loan Forgiveness (PSLF) program eligible employer

Apply tot his job Apply To this Job