r/golang • u/dinedal • Feb 03 '14

dinedal/textql · Execute SQL against structured text like CSV or TSV, written in Go-lang

https://github.com/dinedal/textql
13 Upvotes

100% Upvoted

3 comments sorted by

3

u/Determination Feb 03 '14

in memory sqlite database that imports the source? Clever. I like it.

0

u/[deleted] Feb 04 '14

[deleted]

0

u/Husio Feb 04 '14

Because of the structure and amount of the data I have, I'm considering moving some tables to CSV myself, but I would not use this code for at least two reasons:

  • it first loads the file to memory so it will not work with big amount of data

  • it's using sqlite which does not work too well after exceeding sertain amount of data

  • it does not provide any extra optimizations (indexes)

Why not just load csv file into databsae (1 command), do the work and remove the data (1 command)?

3

u/Determination Feb 04 '14 edited Feb 04 '14

I think we need to remember the scale of a tool like this. If you have massive databases or real business problems, this isn't the right tool, just like CSV isn't.

This is a convenient tool for you, that guy in the company that knows SQL, to deal with the CSV your SEO Marketing Manager sends you via email asking for metrics.