Feds on the Lookout for AI Discrimination: How to Avoid Compliance Challenges
By

Four federal agencies are working together in an “Avengers: Infinity War”-style alliance to prevent AI discrimination that violates Title VII of the Civil Rights Act or the Americans with Disabilities Act (ADA): the Equal Employment Opportunity Commission (EEOC), the U.S. Department of Justice, the Federal Trade Commission, and the Consumer Financial Protection Bureau.
The EEOC, in particular, has been proactive about offering guidance for employers about unlawful technological bias against applicants and employees.
However, as Margie Faulk, PHR, SHRM-CP and compliance officer for HR Compliance Solutions LLC, pointed out in the HRMorning on-demand workshop “AI in Hiring: Navigating Risks & Complying with EEOC,” software vendors tend not to disclose their testing methods. Plus, users are typically required contractually to assume all risks associated with using AI tools.
“An AI tool may inadvertently discriminate against certain groups when analyzing resumes or making hiring decisions, such as people of color or applicants who identify as queer,” Faulk said, noting that a lack of formal federal legislation governing AI use in hiring has opened the door to lawsuits.
Amazon discovered AI discrimination in the machine learning process of an automated applicant rating tool it was using. The e-commerce giant subsequently stopped using the tool in its hiring process.
“The algorithm Amazon used was based on the number of resumes submitted over the past decade, most of which were from men. This resulted in the tool being trained to favor men over women” when hiring, Faulk noted.
AI Discrimination Shouldn’t Stop You From Using Recruiting Tech
Although AI discrimination generally occurs inadvertently during the software development process, the EEOC says employers are on the hook to understand how the algorithms that screen individuals in or out work. But that shouldn’t stop you from using resume scanners, chatbots, video interviewing software or applicant testing software to streamline your talent acquisition process.
“[Software] vendors work for you. … Find out if their system meets the criteria of the Equal Employment Opportunity Commission and the Civil Rights Act of 1964, as well as the Americans with Disabilities Act,” Faulk commented.
She recommended bookmarking the EEOC’s guidance on avoiding AI violation of Title VII and the ADA. Also, stay tuned to HRMorning for future updates on this guidance.
Background Checks and AI Discrimination
Many background check companies use AI to gather information on applicants. Because an employer could get sued if this process looks discriminatory, Faulk recommended human-to-human conversations about why you’re doing a background check and what company you’re using.
This aligns with Title VII, which requires individual assessments to determine the job-relatedness and business necessity of background check information.
Faulk described tools that analyze applicant social media activity as potential litigation minefields.
Compliance Best Practices
Faulk highlighted these best practices from the EEOC for avoiding AI discrimination complaints:
- Inform applicants about your use of AI in hiring and explain its purpose and how it works
- Use only AI tools that measure traits necessary for the job
- If your organization develops its own recruiting software, engage experts to analyze the algorithms for potential AI discrimination
- Make a general announcement that applicants may request reasonable accommodations for completing applications or tests and provide instructions on how to ask for them
- Train supervisors and managers how to recognize and respond to requests (the ADA-mandated interactive process). If a third party is in charge of the AI tool, it needs to notify you when there’s an accommodation request, and
- For third-party AI recruiting software, ask whether it accommodates people with disabilities. If the answer is yes, ask how it ensures alternative application formats for disabled individuals.
Faulk also noted that AI software is not allowed to ask questions likely to elicit medical or disability-related information.
Staying Away From AI Discrimination Lawsuits
A program that processes resumes and makes recommended hires, without any documentation of the process, exposes your company to legal and regulatory risks.
“Employers leveraging automation should be able to explain what criteria are being used,” Faulk said. While it’s AI that crunches all the raw data, it’s still important for a human to validate why candidates were prioritized or rejected.
Bottom line: Final hiring decisions must be made by humans in case the decisions are challenged. “You can’t go to a judge, jury or arbitrator with, ‘We did what the machine told us to do,'” she said.
Further Reading
70+ U.S. Companies Affected by Remote Worker Fraud: FBI Issues New Guidance
You’ve reviewed an applicant’s resume and conducted an interview. But how can you be sure the remote worker you’re planning to bring onto your payroll is who they claim to be? More hiring managers are finding out that a candidate who looks great on paper and interviews well may still be an impostor. In a […]
How Military Veterans Can Improve Hiring and Retention
As our nation celebrates Veterans’ Day, consider increasing your efforts to find, recruit and retain veterans to your organization. Try it now as a catalyst to hire and retain more veterans for years to come. The voluntary quit rate is about 2%, according to data from the Labor Department. But if companies continue to hire […]
Posting Ghost Jobs Could Be Illegal: 7 Better Ways to Recruit
Lawmakers in several states have proposed bills targeting Ghost Jobs – roles posted that don’t exist or employers don’t intend to fill immediately. One state attorney general is investigating the legality of posting Ghost Jobs and profiting from it. The numbers speak some truth behind lawmakers’ concerns. About 25% of employers that have an open […]
Why Candidates Apply Everywhere: 5 Tips for a Better Experience
Employers are seeing more “spray and pray” applications from job seekers who submit dozens, or even hundreds, of applications with limited assessment of whether each role is a strong fit. But this behavior is not just about impatient candidates. It is often a survival response to a hiring process that feels unclear, automated, and silent. […]
Skills Flipping: 3 Things HR Needs to Know About Job Candidates’ New Trick
Skills-based hiring calls for a new trend that will help employers and employees get hiring even closer to perfect: Job candidates are “skills flipping” — turning what might be considered negative traits into strengths. It’s causing employers to reconsider how that trait could work in the increasingly skills-based hiring environment. That’s reflected in job postings: […]
The Return of ‘Blue Book’ Hiring in the Age of AI-Enabled Candidates: 6 Critical Factors
Candidates are increasingly using AI to strengthen their applications, draft resumes and prepare for interviews. In remote hiring environments, some are even using AI to answer recruiters’ questions in real time or to have AI avatars attend interviews on their behalf. Used appropriately, AI can be a helpful tool. It can make it easier for […]