Open Source
LangFair
LangFair is a Python library for conducting use-case level LLM bias and fairness assessments
Our verdict
We have not reviewed LangFair yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About LangFair
LangFair is a Python library for conducting use-case level bias and fairness assessments on large language model outputs. It provides metrics and tests to evaluate demographic parity, equalized odds, and other fairness criteria for specific applications.
Best for
Developers and researchers who need to evaluate and mitigate bias in LLM-based applications at the use-case level.
Use cases
- Auditing LLM outputs for demographic bias in classification tasks
- Comparing fairness metrics across different model versions or prompts
- Integrating bias checks into LLM evaluation pipelines
Notes
258 stars on GitHub. Last updated 2026-01-09.
Pros
- Open source and free to use with a permissive license
- Focused on use-case level assessment, not just aggregate metrics
- Python-native, easy to integrate into existing ML workflows
Cons
- Small community (258 stars) may mean limited support and documentation
- Requires manual setup and configuration for each use case
- Only supports Python, limiting use in polyglot environments
Key facts
What we have checked
- Days since the last commit
- 55
- GitHub forks
- 50
- GitHub stars
- 261
- Days to a first reply on issues
- 62.1
- Open issues
- 16
- Releases in the last 90 days
- 0
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How LangFair is growing
258 to 261
Health and security
Is LangFair looked after, and what do its setup files show
Health score
53 out of 100
| Part | Points | What we saw |
|---|---|---|
| Recent activity | 27.8 of 30 | Last push 55 days ago |
| Releases | 0 of 15 | 0 releases in 90 days |
| Issue replies | 0 of 20 | First reply in 62.1 days (median) |
| Maintainer | 15 of 15 | Owned by an organisation |
| Official source | Not counted | MCP servers only |
Sources
Where this comes from
- GitHubRegistry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.