Deidentification, Python tool for removing personal info using NLP

Hacker News

I created a Python library and CLI to automatically identify and remove personal information from text documents using Natural Language Processing. It has been used to de-identify internal employee surveys and patient satisfaction surveys. What my project does: * Identifies and replaces person names using spaCy's transformer model * Converts gender-specific pronouns to neutral alternatives * Handles possessives and hyphenated names * Offers HTML output with color-coded replacements ___ Here's a quick example: Input: John Smith's report was excellent. He clearly understands the topic. Output: [PERSON]'s report was excellent. HE/SHE clearly understands the topic. ___ This was a fun project to work on - especially solving the challenge of maintaining correct character positions during replacements. The backwards processing approach was a neat solution to avoid recalculating positions after each replacement. * blog post: https://gitgist.com/posts/introducing-deidentification-pytho... * github: https://github.com/jftuga/deidentification * PyPI: https://pypi.org/project/text-deidentification

Visit product View on Hacker NewsJan 28, 2025

Share card

Actual performance

1points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Indie HackersFits the IH revenue-focused audience · Strong signals: created · Missing: supports, reddit linkedin, podcasting

58%58% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Product HuntOn track for Day 1 leaderboard · Strong signals: model, using, code · Missing: mac, agents, macos

54%54% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

AppSumoStrong fit for a featured deal · Missing: plus, platform, intuitive

54%54% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: ide, io · Missing: https docs, excited, just released

51%51% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Strong signals: personal · Missing: mobile apps, ios, entrepreneurs

43%43% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

11%11% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Solid IMAP and SMTP in Go Using Python52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Solid IMAP and SMTP in Go Using Python

Hacker News2

Using functions to construct Regex in Python54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Using functions to construct Regex in Python

Hacker News105

WebRTC implementation for Python using Asyncio64%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

WebRTC implementation for Python using Asyncio

Hacker News216

Manipulate NumPy arrays in Python using Uiua44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Manipulate NumPy arrays in Python using Uiua

Hacker News2

PlatformInfo – Python system info library44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

PlatformInfo – Python system info library

Hacker News2

System Info Tool for Rustaceans42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

System Info Tool for Rustaceans

Hacker News1

Matroschka – A Python steganography tool54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Matroschka – A Python steganography tool

Hacker News69

Tool for pinpointing circular imports in Python54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Tool for pinpointing circular imports in Python

Hacker News1

(Crocs) Regex and Backus-Naur on Python classes. A parsing tool38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

(Crocs) Regex and Backus-Naur on Python classes. A parsing tool

Hacker News2

Tracking Personal Finances using Python49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Learn to track your personal finances using Python

Indie Hackers2$200/mobooks

Browse all products Analyze your launch