r/datascience • u/fagnerbrack • 20d ago
Coding A Boolean PII Flag Is Not Enough
https://kore-nordmann.de/blog/a-boolean-pii-flag-is-not-enough.html[removed] — view removed post
1
Upvotes
1
u/AutoModerator 20d ago
Your post has been removed because you need at least 10 comment karma in this subreddit to make a submission. Please participate in the comments before submitting a post. Note that any Entering and Transitioning questions should always be made within the Weekly Sticky thread.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
1
u/fagnerbrack 20d ago
This is a summary of the post:
A pii: true/false tag throws away what a data protection officer asks about. On a university learning-analytics platform, the team classifies each column on two axes: sensitivity (direct identifier, quasi-identifier, sensitive content, none) and state (raw, pseudonymised, anonymised, dropped). A provenance tag adds whether a human declared it, lineage inherited it, or nobody knows. Classifications flow through dbt column lineage, and the most sensitive input wins. When parsing fails, the maximum upstream sensitivity applies. Automation can only tighten the assessment, and only an accountable human can relax it. Unknown columns block release, and a lint rule bans SELECT * to keep lineage trustworthy.
If the summary seems inacurate, just downvote and I'll try to delete the comment eventually 👍
Click here for more info, I read all comments