Bias, Accuracy, and the Statistics of AI Testing

What you’ll learn

This course works covers topics in technical testing of AI and algorithmic systems needed for auditors. Topics covered include:

Performance metrics for algorithmic systems

Quantitative

Qualitative

Sampling and estimation

Definition and types of bias and fairness

This course is part of a 5-course certification program for AI and Algorithm Auditors. Anyone can take the course and get a certification after an exam and exit interview.

About the Instructor

Shea Brown is the founder and CEO of BABL AI, a research consultancy that focuses on the ethical use and development of artificial intelligence. His research addresses algorithm auditing and bias in machine learning, and he serves as a ForHumanity Fellow that sets standards for the organizational governance of artificial intelligence.

He has a PhD in Astrophysics from the University of Minnesota and is currently an Associate Professor of Instruction in the Department of Physics & Astronomy at the University of Iowa, where he has been recognized for his teaching excellence from the College of Liberal Arts & Sciences.

Curriculum

Introduction

What you'll learn (9:01)

Course Resources

Week 1 - Foundations

The sociotechnical algorithm (8:30)

Inputs, outputs, and parameter spaces (12:25)

Statics, probability, and sampling (27:36)

Exercise 1: Putting your knowledge to work

Week 2 - Metrics & Testing

Bias testing: general strategy (18:46)

Basic performance metrics (26:28)

Robustness, and validation (18:38)

Examples (31:03)

Exercise 2: Case study

ENROLL NOW

Don’t just take our word for it

Here’s what our graduates have to say…

Thanks to the rigorous program at BABL AI, I am now equipped with the expertise to consult companies and governments on responsible AI. I can guide organizations in building AI products that prioritize fairness, transparency, and explainability.

Additionally, I can assist in sourcing AI products that adhere to responsible AI principles, educate customers about the risks associated with generative and discriminative AI, develop responsible AI governance capabilities, and collaborate with governments to implement responsible AI initiatives. My journey with BABL AI has been a remarkable one.

– Abhinav

Throughout the course, I gleaned a framework for the science, laws and critical thinking behind AI auditing. Dr. Shea Brown and his team provided an excellent balance of theoretical knowledge and practical applications so that I could feel confident in working with a team to identify, analyze and test risks of the systems all around us… BABL AI created a welcoming environment for people regardless of professional background. I felt confident in scaling my knowledge and skills without a science background and also in my lived experience being respected as part of the auditing process.

– Luna

I have done many training programs in the field of AI Ethics and AI Assessments and/or Audits and I can say that the AI and Algorithm Auditor Certificate Program from BABL AI is definitely one of the best on the market. Prof. Shea Brown does an excellent job both as Instructor and Mentor. Shea and the BABL AI team were always kind and helpful. We did a cohort based training as the first movers, I must admit that the cohort was amazing and made the training a great journey but it is also suitable for individuals who can do it on their own, adjusting their pace with their other responsibilities.

– Mert

What I particularly appreciated about this program was its ability to strengthen my understanding in areas where my knowledge was previously relatively limited. The content was not only thoroughly well-balanced, covering both foundational and advanced topics, but also very engaging and interesting. The unique nature of the program really stood out; despite my extensive search for similar courses, none matched the depth and relevance in risk management offered here.

-Tony HibbertAI Governance Expert, ING Bank

Choose a Pricing Option

Bias, Accuracy, and the Statistics of AI Testing

Essential Tools for AI and Algorithm Auditing

$599

ENROLL NOW

Additional qualifying discounts are available

Contact us today to learn more

Contact Us