How our Audit works
Pre Audit Scoping
BABL AI walks your team through a series of questions to determine where you currently stand. We then inform your team what documentation is needed for our audit process, and help you understand everything for compliance, including how to test the various selection rates and impact ratios of protected categories as required by the law. NO SOFTWARE DOWNLOADED OR PLATFORM INTEGRATIONS REQUIRED!
Audit Review
Once all your documentary evidence has been submitted for evaluation, our well trained certified auditors review your documentation against our criteria. During this review process, BABL AI auditors might ask for more supporting documentation or interact with your internal and external stakeholders, such as employees or other third-parties, to verify the truth of statements made in the submitted documentation. At the end of the audit review, the auditors reach an overall audit opinion that determines the result of the audit.
Audit Review
Once an opinion is determined, BABL AI will draft a public summary report for each AEDT, if mandated by the regulatory body, and present the final report to your team.
FAQs
What is the New York City Bias Audit Law (Local Law 144)?
The New York City Bias Audit Law (Local Law 144) governs the use of automated hiring tools (AEDT) in New York City. It mandates that algorithm-based recruiting, hiring, or promotion technologies must undergo an annual bias audit from an independent third-party auditor before they can be used for candidates and employees.
What is an AEDT?
AEDT stands for “Automated Employment Decision Tool.” It refers to software or systems that use algorithms and automation to assist in various aspects of the employment process, such as recruiting, hiring, or promoting employees. AEDTs can be used for tasks like screening resumes, conducting initial candidate assessments, or identifying potential candidates for job openings.
Who is affected by the NYC Bias Audit Law?
New York City Local Law 144, also known as the Bias Audit Law, affects employers of all sizes within New York City that use automated employment decision tools (AEDTs) for recruiting, hiring, or promoting candidates and employees.
What are some examples of an AEDT?
The NYC Bias Law states that an AEDT is “any computational process, derived from machine learning, statistical modeling, data analytics, or artificial intelligence, that issues simplified output, including a score, classification, or recommendation, that is used to substantially assist or replace discretionary decision making for making employment decisions that impact natural persons.”
This includes but is not limited to: Applicant Tracking Systems (ATS), Pre-employment Assessment Software, Chatbots for Initial Screening, Resume Screening Algorithm, Video Interview Platforms.
What information is disclosed on the audit public summary?
We transparently provide all legally required information, along with essential context to comprehend the audit opinion and summary of results. Furthermore, we openly disclose our audit criteria and methodology, offering maximal transparency while safeguarding the intellectual property of the audited organization.
How long does the audit process take?
On average our audits take between 2-3 weeks to complete after all relevant documentation has been submitted. This timeframe can vary depending on many circumstances like readiness and resubmission of unsatisfactory documentation, but BABL AI will help you at every stage to ensure an easy process.
Why should I get an Algorithmic Audit?
In addition to ensuring compliance with emerging regulations such as New York City Local Law 144, an algorithmic audit serves as a powerful tool for reassuring your stakeholders that your algorithms undergo vigilant bias monitoring and testing. This proactive approach helps mitigate potential risks posed by your systems while significantly enhancing transparency, ultimately fostering greater trust in your AI systems.
Can you do multiple audits at the same time?
Absolutely! Our audit process is highly adaptable to cater to your unique compliance and assurance requirements. Feel free to get in touch with us and have a conversation with one of our expert auditors to discover the full spectrum of solutions BABL AI can offer.
Reach out to us today for a free consultation!