Fixes 27911: recognizer inclusion based on language

[edg956]

Summary

Fixes #27911

TagAnalyzer.get_recognizers_by() was silently dropping recognizers configured with supportedLanguage = any (language-agnostic) whenever the auto-classification agent ran with a specific language (e.g. en).

The old two-clause filter:

if (
    self._language is not ClassificationLanguage.any
    and created.supported_language != self._language.value
):
    continue

evaluated "any" != "en" → True for any-language recognizers, causing them to be skipped regardless of intent. The any sentinel is supposed to mean "this recognizer works for all languages".

Changes

• ingestion/src/metadata/pii/tag_analyzer.py: extracted the language-filter condition into a _supports_language(created) method with correct positive logic — a recognizer is included if the agent is in any-mode, OR the recognizer itself is any-language, OR the languages match exactly.
• ingestion/tests/unit/metadata/pii/test_language_filtering.py: added TestAnyLanguageRecognizerPassthrough with three regression tests covering the fixed case (any-recognizer + specific-language agent), the already-passing case (any-recognizer + any-agent), and the existing exclusion behavior (mismatched specific languages).

Test plan

• pytest ingestion/tests/unit/metadata/pii/test_language_filtering.py::TestAnyLanguageRecognizerPassthrough -v — 3 new tests pass
• pytest ingestion/tests/unit/metadata/pii/ -v — full PII unit suite passes (no regressions)

[github-actions]

🟡 Playwright Results — all passed (9 flaky)

✅ 4003 passed · ❌ 0 failed · 🟡 9 flaky · ⏭️ 86 skipped

Shard	Passed	Failed	Flaky	Skipped
🟡 Shard 1	298	0	1	4
🟡 Shard 2	750	0	2	8
🟡 Shard 3	760	0	1	7
🟡 Shard 4	773	0	2	18
🟡 Shard 5	686	0	1	41
🟡 Shard 6	736	0	2	8

🟡 9 flaky test(s) (passed on retry)

• Pages/AuditLogs.spec.ts › should apply both User and EntityType filters simultaneously (shard 1, 1 retry)
• Features/ActivityAPI.spec.ts › Activity event shows the actor who made the change (shard 2, 1 retry)
• Features/BulkEditEntity.spec.ts › Glossary (shard 2, 1 retry)
• Features/RTL.spec.ts › Verify Following widget functionality (shard 3, 1 retry)
• Pages/DataContractsSemanticRules.spec.ts › Validate Description Rule Is_Set (shard 4, 1 retry)
• Pages/DomainAdvanced.spec.ts › Remove multiple assets from domain at once (shard 4, 1 retry)
• Pages/EntityDataConsumer.spec.ts › Tier Add, Update and Remove (shard 5, 1 retry)
• Pages/GlossaryImportExport.spec.ts › Glossary Bulk Import Export (shard 6, 1 retry)
• Pages/Lineage/LineageFilters.spec.ts › Verify lineage schema filter selection (shard 6, 1 retry)

📦 Download artifacts

How to debug locally

# Download playwright-test-results-<shard> artifact and unzip
npx playwright show-trace path/to/trace.zip    # view trace

[gitar-bot]

Code Review ✅ Approved

Refactors PII recognition logic by centralizing language validation and ensuring language-agnostic recognizers are correctly included. Includes new regression tests to verify consistent behavior across language settings; no issues found.

Options

Display: compact → Showing less information.

Comment with these commands to change:

Compact

gitar display:verbose

_{Was this helpful? React with 👍 / 👎 | Gitar}

[sonarqubecloud]

Quality Gate passed for 'open-metadata-ingestion'

Issues
1 New issue
0 Accepted issues

Measures
0 Security Hotspots
100.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

[github-actions]

Changes have been cherry-picked to the 1.12.7 branch.

[github-actions]

Changes have been cherry-picked to the 1.13 branch.