Scope of Work Map scaled-analysis and pipeline-integration scenarios to an established taxonomy across key evaluation areas. Author detailed analytic cases that reflect authentic deployment patterns, including automated triage, enrichment, and analysis-at-scale, as well as representative failure modes in real-world settings. Evaluate and grade responses based on criteria such as source handling, reasoning, understanding of limitations, and practical utility. Identify and flag instances of model over-refusal that could hinder legitimate analytic workflows or disrupt pipeline continuity. Document challenging edge cases, emerging methodology concerns, and provide actionable recommendations for continuous improvement. Contribute clear, insightful written and verbal feedback that supports iterative, high-quality project outcomes. Preferred Qualifications Demonstrated experience integrating LLMs—such as government GPT variants—into complex data or analytic pipelines. Proven capability in conducting analysis at scale, with an understanding of automation failure modes and relevant evaluation metrics. Track record of teaching, mentoring, or technical leadership in data science or related analytic disciplines. Expertise in authoring clear, concise technical documentation and conveying complex concepts through strong written English. Exposure to the design of evaluation frameworks or benchmark systems. Familiarity with defense, intelligence, or government analytic domains is highly valued. Ability to operate effectively in distributed, international project environments with minimal clearance constraints.

About Quickhyre AI

QuickHyre AI is an online job portal and HRMS software platform for hiring and workforce management, trusted by over 10 million active users. It connects freshers and experienced professionals across all career levels with verified job opportunities, while enabling companies to hire, onboard, and manage employees through a single system. Candidates use QuickHyre AI to search and apply for jobs across entry-level, mid-level, and senior roles, including internships and contract positions across tech and non-tech domains. Employers use QuickHyre AI as a hiring platform, applicant tracking system (ATS), and HRMS to post jobs, screen candidates, manage applications, onboard hires, and maintain employee records. Built for startups, growing companies, and enterprises, QuickHyre AI reduces irrelevant applications, improves hiring efficiency, and simplifies HR operations. By combining job discovery, online recruitment, and HR management software, QuickHyre AI supports end-to-end talent acquisition and workforce administration at scale.