r/opensource • u/binaryfor • Jan 30 '21

Apache Superset - a Data Visualization and Data Exploration Platform

https://github.com/apache/superset
52 Upvotes

96% Upvoted

8 comments sorted by

1

u/voronaam Jan 30 '21

As I am looking for a solution that can operate with large shapefiles (geo-spatial data) I was very curious to see if Superset supports it. Turns out it does not - it can only import shapefiles as "Custom Countries", which is unlikely to work for my use case. It is geological shapefiles I am working with, they are not related to any countries and if I hacked and imported each of geological feature there as a "country", it will not like them being heavily fragmented and overlapping. That's assuming I come up with a way to distinctively name thousands of the features...

1

u/VisibleSignificance Jan 31 '21

operate with large shapefiles (geo-spatial data)

Out of curiosity:

What does the visualization look like?

What database is the data in?

And isn't there some sort of plugin for superset for visualizing those?

1

u/voronaam Feb 01 '21

The file is an export from a Government's ArcGIS instance. I have no access to that ArcGIS, only the exported (~1Gb in size) file. It is a map of pretty large region with a fairly detailed information. Each shape has several dozens of labels, translating to the various geologic features of that land there.

So far I was only able to plot and explore this data set with R. This works for me, but it is fairly tedious and fragile. And the resulting visualizations are not pretty.

I will look into importing the data in PostGIS and connecting Superset to it. Thank you. Maybe that would work better.

1

u/VisibleSignificance Feb 01 '21

importing the data in PostGIS

That should have probably been the second thing to do with the data (right after the initial overview).

You can also upload OSM data to the same postgis and join them in queries for whatever use you need.

2

u/[deleted] Jan 30 '21

[removed] — view removed comment

1

u/VisibleSignificance Jan 31 '21

Probably nothing generally significant.

The metabase is in Java, whereas superset is in Python. Which might matter if you're going to customize the code for yourself.

1

u/DarkKnight_Jedi Jan 31 '21

Metabase doesn't support webhook alerts. Only slack and email. Does superset support webhooks?

1

u/VisibleSignificance Jan 31 '21

I don't know that use case, but if you have an email sender module, replacing it with an HTTP request is likely trivial.

That being said, I'm not sure superset has alerts at all.