AI Assurance Researcher
AI Assurance Researcher
Contribute to artificial intelligence / machine learning (AI/ML) assurance research over a diverse project portfolio in the national defense domain. Make a tangible impact for mission-driven work with great pay and benefits.
What does AI/ML T&E research look like in this position?
We collaborate with civilian government agencies to test and evaluate military AI/ML-enabled technology to provide our warfighters with safe, effective, and usable technology. We work on a variety of efforts, including:
- Authoring test and evaluation guidance and educational resources for AI/ML that include performance, security, integration, ethical, and DoD acquisition considerations;
- Monitoring AI/ML advancements across the DoD by interviewing program offices and attending conferences and workshops to inform investments in testing infrastructure;
- Developing or adapting AI/ML testing methods to address challenges posed by complex use cases and environments alongside various time, monetary, and safety constraints;
- Providing AI/ML guidance and consultations to government sponsors and IDA researchers to inform AI/ML evaluations across diverse technologies and use cases;
- Communicating project nuances and analytical results via writing and presentations to diverse audiences, including government and military leadership, system end-users, and technical audiences without AI/ML expertise; and
- Identifying AI/ML testing challenges posed by DoD use cases and contributing to strategic-level efforts to advocate for AI/ML testing best practices throughout the DoD.
What qualifications and skillsets do you need?
Required:
- PhD or MS with 8+ years of relevant experience. We value diverse perspectives and expertise and will consider applicants from a wide array of disciplines, including:
- Responsible AI (RAI), AI Ethics, Data Management, Science and Technology Policy, Artificial Intelligence, Machine Learning, Data Science, and Computer Science
- Foundational understanding of common machine learning algorithms, including their limitations and failure modes.
- Proficiency with at least one common scripting language (i.e., Python, R);
- Availability to travel (approx. 10% time); and
- Ability to obtain or currently holds a security clearance
- Successful completion of a background check is required.
Preferred:
- Experience consulting/advising groups in AI/ML design, methods, and analysis; and
- Experience with AI/ML in complex applications with high-risk consequences, messy data and/or poorly defined objectives.
Why work at IDA?
IDA, as a non-profit, is uniquely positioned to answer the most challenging U.S. security and science questions with objective and rigorous analysis leveraging extraordinary scientific, technical, and analytic expertise. This position is located in Alexandria, VA, just outside Washington, D.C.
IDA offers the following benefits and resources to their employees:
- Comprehensive benefits including diverse health insurance options, generous 11% contribution to retirement, maternity/paternity leave, 20 days paid time off, and relocation reimbursement;
- Mission-oriented work at a non-profit that supports and protects our warfighters; as a non-profit, IDA employees are eligible for Public Service Loan Forgiveness (PSFL);
- Professional development including tuition reimbursement, internal and external trainings, and funding for researcher-pitched projects and publications;
- A culture of work-life balance, including flex time, partial telework, and limiting work communication to core business hours;
- A brand-new facility located in Alexandria’s high-tech corridor in Potomac Yard; amenities include a cafeteria, gym, and close proximity to local dining and shopping; and
- Easy access to Potomac Yard Metro stop and Potomac Yard DASH bus stop. Employer contributes $300/month (IRS max) to commuter benefits.
What are the next steps?
- Complete the application and submit your resume.
The application process consists of three interviews.
- A short screening call with HR;
- A 30 min – 60 min screening call with researchers; and
- A full day interview with various researchers and staff; includes giving an hour presentation on a research project.
Prior to the full day interview, you will be asked to provide:
- Transcripts (unofficial accepted);
- 3 letters of recommendation; and
- A writing sample.
U.S. Citizenship is required
Ability to obtain and maintain a security clearance is required
IDA is an equal opportunity employer committed to providing a fair recruiting process and working environment free from discrimination. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identify, national origin, disability or protected veteran status. Click here to learn more about IDA's commitment to diversity, equity, and inclusion.
IDA is committed to working with and providing reasonable accommodations to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the application process or in order to perform the essential functions of a position, please send an email to employment@ida.org and let us know the nature of your request and contact information.