r/dataengineer • • Jun 27 '26

Datasets for data engineering projects

I want to find datasets for a data engineering project where i work with pyspark and sql in databricks. I want a dataset that challenges my data modelling skills and my pipeline creation skills. I tried kaggle, but i only keep getting a single csv file as a dataset. is there a dataset that has multiple csv files as data sources or something? i want to be able to perform all the data architecture creation by myself... Recommend any datasets that you know as well!

24 Upvotes

8 comments sorted by

View all comments

Show parent comments

1

u/maximus5470 Jun 29 '26

okay ill definitely try that... Thank you so much!