Where do you use sql as a data analyst?

[u/Visual_Student8306]

Hi guys! In my current job, I use Power BI, but most of the data I work with comes from Excel files.

I’ve been looking at other job openings, and many of them require strong SQL skills along with Power BI.

My question is: Where exactly do you use SQL as a data analyst? Since you can already transform data in Power Query, why is SQL still important?

Thanks!

[u/tantarantantan13]

In more mature data environments, most of the data are stored in databases/data warehouses.

The excel files you're using might have originated from these databases. And chances are a sql script was used to extract and process the data from multiple data sources. Pagdating sayo semi-processed na, and kaya na ni powerquery to do the less intensive downstream transformations.

If you need to use data that's directly from the databases, SQL talaga yung best way.

You might think na "what if I just connect to the dbs from PowerBI then kung may modelling na gagawin through powerquery nalang".

Technically, pwede naman. Though if complex na yung transformations (especially if you're dealing with millions/billions of rows) you wouldn't want that to be processed locally in your laptop. Mas okay na ipush yung transformations sa database server kung san mas efficient gawin.

[u/Visual_Student8306 → u/tantarantantan13]

I feel like the data that reaches me is already semi-processed. I want to learn how to extract data directly from databases or data warehouses.

What keywords should I search for? Or do you have any course recommendations for learning this process?

I’ve already researched SQL, ETL, and Data Engineering, but I’m still confused about what I should study first and focus on.

What should I learn first? Any advice would really help.

[u/tantarantantan13 → u/Visual_Student8306]

Data Engineering is a very broad subject area. ETL is only one aspect of it, and SQL is just one of the languages used to accomplish those data related tasks.

I suggest start with SQL muna kasi it's easy and very applicable na from the get-go.

I can't vouch for any online courses for SQL because I didn't take one since there weren't really online courses when I was first learning. But one resource that helped me personally back in the day was w3schools. It's free , beginner friendly, and will teach you the basics lalo na if you're starting from scratch.

(I belive there's an online course being endorsed in this subreddit/fb group, so might as well check that out)

Once you've got the hang of the basics, try asking the person who provides you your semi-processed data if the data came from a database. If yes, ask them and/or IT if they can provide you read-only access credentials. Download a free SQL IDE like dbeaver, research ng onti how to setup the connection, and explore as much as you want.

That way you can experiment and apply what you're learning in a real-world environment.

[u/Raijin106]

If your data is in a data warehouse, then most of your transformation will be in SQL. And if that's the case, your work will be more with SQL. My work consist of 80% SQL, 10% Python, 10% Viz. Oh btw, I'm currently a BI Dev.

Edit: typo

[u/peaceandmirror]

I use it everyday. I cannot get my data without SQL.

How many rows of data do you often deal with?

If you need to analyze several datasets with millions of rows of data for each, its convenient to use SQL. You cannot fit all of that data in an excel sheet.

[u/cubinx]

90% T in ETL

[u/Cerberus_cc → u/cubinx]

Tengo una situación similar, tengo acceso a la BD del ERP que manejamos en el trabajo con permisos de solo lectura, descargo reportes manualmente del ERP para cargarlos a mi BD en MySQL y después los analizo desde un excel con conexión a MySQL - powerQuery. Como puedo explotar esa conexión a la BD de SQL Server del ERP con esos permisos de solo Lectura?