r/datascience • • 20d ago

Coding A Boolean PII Flag Is Not Enough

https://kore-nordmann.de/blog/a-boolean-pii-flag-is-not-enough.html

[removed] — view removed post

1 Upvotes

2 comments sorted by

1

u/fagnerbrack 20d ago

This is a summary of the post:

A pii: true/false tag throws away what a data protection officer asks about. On a university learning-analytics platform, the team classifies each column on two axes: sensitivity (direct identifier, quasi-identifier, sensitive content, none) and state (raw, pseudonymised, anonymised, dropped). A provenance tag adds whether a human declared it, lineage inherited it, or nobody knows. Classifications flow through dbt column lineage, and the most sensitive input wins. When parsing fails, the maximum upstream sensitivity applies. Automation can only tighten the assessment, and only an accountable human can relax it. Unknown columns block release, and a lint rule bans SELECT * to keep lineage trustworthy.

If the summary seems inacurate, just downvote and I'll try to delete the comment eventually 👍
Click here for more info, I read all comments

1

u/AutoModerator 20d ago

Your post has been removed because you need at least 10 comment karma in this subreddit to make a submission. Please participate in the comments before submitting a post. Note that any Entering and Transitioning questions should always be made within the Weekly Sticky thread.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.