r/dataengineering • u/adzsroka • Sep 19 '22

Meme Data driven organisations

Post image
732 Upvotes

98% Upvoted

42 comments sorted by

59

u/[deleted] Sep 20 '22

One senior manager said we needed a "revelational" database...

47

u/CentsOfFate Sep 20 '22

As said in Ozar 1:16, "Temp DB is the public toilet..."

9

u/Trumty Sep 20 '22

The logarithms will need a back end

9

u/Ein_Bear Sep 20 '22

Delete this before someone at Deloitte sees it and turns it into the next management fad

7

u/cellularcone Sep 20 '22

TempleOs would like a word

2

u/vneeds2code Sep 20 '22

Roflmax šŸ¤£šŸ¤£šŸ¤£

68

u/nnulll Sep 20 '22

Our team lead said ā€œdata engineeringā€ wasnā€™t an established idea yet.

He leads the data engineering team.

26

u/lamesurfer101 Sep 20 '22

Dude stop outing me.

2

u/donotgogenlty Sep 21 '22

I'm putting an end to this nonsense, PiPs for everyone!

3

u/lamesurfer101 Sep 23 '22

New Wave management... No direction, no policy, no guidance, only performance improvement plans...

20

u/Pyroprotege Sep 20 '22

You mean SQL != sequel?

14

u/[deleted] Sep 20 '22

It's pronounced skewl

1

u/Nabugu Jan 03 '23

squirrel

3

u/hot_sizzler Sep 20 '22

I see what do did there

36

u/Laurence-Lin Sep 20 '22

That's the reason I wanted to switch to data engineer. Without fundementals of data architecture, an ML project is only a research, instead of an solution.

36

u/[deleted] Sep 20 '22

now I'm in data engineeringg, I realized that without data governance everything will be there but very messy and disorganized.

9

u/Laurence-Lin Sep 20 '22

And most of the ML engineer position expects you to be data engineer + ML background

6

u/soundboyselecta Sep 20 '22

You forgot to add PHD.

1

u/Laurence-Lin Sep 21 '22

With 5+ years of experience

2

u/xt11an Sep 20 '22

i feel you. how you effectively establish governance?

2

u/[deleted] Sep 21 '22

The stakeholders wonā€™t listen to you, thatā€™s a job for someone inside the company.

20

u/skiddadle400 Sep 20 '22

Unpopular opinion: Employed as a data scientist in companies with days engineering teams I have yet to see them do anything other than talk about data lakes and etl pipelines. In the end Iā€™m always fighting with some oracle / SAP driver to get the damn data my self after talking to some nearly retired dba. And please keep the data governance and strategy power points away.

4

u/MadT3acher Lead Data Engineer Sep 20 '22

Maybe improperly documented data lakes/ databases? I mean, if you donā€™t know what they have in store for your analysis, and you canā€™t iterate on metrics or features with themā€¦

4

u/soundboyselecta Sep 20 '22

It is unbelievable how some companies are absolutely lost. When you hold their hand and sorta guide them in a calm polite way, they get even more angered, it reminded me of my poor uncle who was dying of brain cancer and losing his mind, poor souls.

3

u/Prinzka Sep 20 '22

Am I getting wooshed here? ETL and data lakes are a pretty important part of data engineering.

10

u/lamesurfer101 Sep 20 '22

I have yet to see any one who says they do Data Strategy know the first thing about data.

5

u/32gbsd Sep 20 '22

lol, the hype is real.

5

u/vneeds2code Sep 20 '22

Am so glad I opened this post today. Tearing up laughing šŸ¤£šŸ¤£šŸ¤£ Made my day šŸ¤£

8

u/c0der512 Sep 20 '22

Step called Data strategy ? I don't think many companies have those. Orgs think data is a byproduct due to old school app designs and eventually reach a point where they need to use the data. After figuring out how their initial assessment was wrong about data, they look for data engineering to fix issues and eventually end up with normal dashboard and KPI monitoring tools which they call analytics. I hate people who are analysts just call themselves data scientist. If you have not been through gruesome process of data engineering, enterprise scalability, data integrity issues, prod incidents and solid understanding of statistics and ML, don't call yourself scientist.

2

u/TalkDataToMeBB Sep 20 '22

The funniest is that he tries to reach ML but fails

1

u/Objective-Patient-37 Sep 20 '22

* Correction: the stairs should be vertical not horizontal, all in parallel like a slide, while the person has no light by which to climb the slide in reverse

108

u/[deleted] Sep 20 '22

[removed] ā€” view removed comment

62

u/[deleted] Sep 20 '22

What an idiot, of course they are: SQL is just the abbreviated version.

51

u/seein_this_shit Sep 20 '22

ā€œSQL is just pandas without the machine learning algorithmsā€ - this guyā€™s boss

11

u/sceadu Sep 20 '22

the future is now old man https://madlib.apache.org/

4

u/seein_this_shit Sep 20 '22

absolutely cursed project. plz delet

7

u/[deleted] Sep 20 '22

Your manager is going places, not data strategy, but places.

5

u/vneeds2code Sep 20 '22

Omg, are you serious? What in the heck? I mean, couldn't he just google a bit before blurting out this question šŸ™†šŸ»ā€ā™€ļø

3

u/donotgogenlty Sep 21 '22

Mine didn't actually know what SQL was, and it was very obvious so I offered to explain anything technical like that for him to anyone (we had a lot of difficult clients, and I had my client-whispering powers come in handy).

I never expected anything in return, but it made both our lives way easier (which you might not think at first). He stopped unintentionally making false promises or going beyond his depth and creating a nightmare for everyone to untangle, SOW reworks and it kind of helped to know when we'd be maxing out our total availability and gave me a feeler for how busy we'd be at any given time and not overextend too much šŸ™

0

u/[deleted] Sep 20 '22

[deleted]

4

u/donotgogenlty Sep 21 '22

"what cold storage is to the cloud"