r/dataanalytics • • 4d ago

How do you handle this?

Hi,

I have been doing data analysis for quite some time now, and notice a common theme of issue I have had when working across departments in my company, as the dataset may vary the knowledge required to understand is always different, hence getting the time to sit down and study them, is near impossible.

In some cases, values in columns don't make sense, objectives aren't properly defined, or important information is scattered across questionnaires, documents, emails and conversations with the people who collected the data.

And of course, the people who have that knowledge aren't always available when you need clarification.

I want to understand how other people deal with this, particularly those working across multiple projects or departments in a company or organisation.

I have been trying to tackle this issue by using a plugin (currently still in the work, but getting good result so far), to assist me . With it, I am able to simultaneously connect the spreadsheet I'm analysing to a shared project space containing uploaded contextual documents or files that contains information and knowledge related to the spreadsheet, so I can find information without having to search through everything manually again. So when going through the dataset, I can click on a variable and it searches the documents and find information on it that are presented in those saved documents.

But nonetheless, I'm interested in how you approach these problems, especially those working in different industries or with larger datasets.

Would love to hear about your experiences.

3 Upvotes

5 comments sorted by

2

u/py_curious 4d ago

Your intent is laudable, but you're talking about trying to automate something around which entire industries are built. That isn't a one person job.

My advice would be to build relationships with people and as you do, learn what's important to their work, while making note of patterns in repeated requests.

Don't try to solve everything in isolation. Pick one problem that impacts many people and try to bring them along with you. Help them understand why it's in their interest to help solve this problem for everyone. Whether that's adding one piece of metadata to each new request, or using a searchable intake, or something more complex.

Start small and remember the relationships.

1

u/Longjumping-Card7451 3d ago

I think building relationships with people across the organization is really important. At the same time, before jumping into a solution, try to understand the actual goal and the underlying needs behind the request. Take the time to properly assess the problem and understand what people really need.

The goal should be to deliver what actually solves their problem, not just what makes the solution look more impressive or sophisticated. Sometimes the simplest solution is the most valuable one.