No video :(

justforfunc #41: CSVQL - serving CSV with SQL (part 2)

Подписаться 40 тыс.

Просмотров 5 тыс.

50% 1

This is the second part of CSVQL: • justforfunc #40: CSVQL...
CSV files are the basic format for data sharing, but they're not always the best way to consume it.
So, what if we created a SQL server that reads the content directly from the CSV files in a folder ... all of it in Go?

Опубликовано:

25 авг 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 15

@Phscyoman 5 лет назад

Really love watching your videos. Always excited when another one come up.

@fullmuppet 5 лет назад

Things working when they shouldn't always seems to me even worse than things not working when you think they should!

@djhworld_ 5 лет назад

Hi Francesc, really enjoyed these videos. I've wanted to do something like this but the SQL layer always seemed incredibly daunting - really interesting that you could use that mysql library to do a lot of the heavy lifting!

@markuswerner1166 5 лет назад

7:30 to 7:52 :-D Watching you, while discovering that it works unexpectedly -> Priceless :-D *scnr* This makes even more fun to whatch your videos. It is cool to not have a perfect prescripted Video, instead it is like a colleague shows you somthing. Thanks again that you spend your time for this great videos.

@augur43 5 лет назад

I love the idea behind this, i am curious if we can expose csv files stored in an s3 bucket.

@Phscyoman 5 лет назад

That would be interesting.

@prophetson 5 лет назад

Definitely possible, I managed to take this idea and use it to expose AVRO files stored in Google Cloud Storage via MySQL. So S3 isn't really a stretch.

@emrahkorkmaz3991 5 лет назад

i love your contents :)

@danaadalaide5648 4 года назад

You could pretty much make your own apache drill in go using this library, very cool.

@bertverstraete2832 5 лет назад

Hi Frances, will you be attending FOSDEM next February?

@JustForFunc 5 лет назад

Yup, I'm one of the organizers of the go Devroom!

@quillaja 5 лет назад

This is cool, but I had been hoping you would implement the std lib's "database/sql/driver" for csv for this 2 part episode.

@JustForFunc 5 лет назад

That's a cool idea!

@quillaja 5 лет назад

@@JustForFunc I was looking at how some of the sqlite drivers are implemented recently. I think writing a 'sql driver' for csv would be too much work, since I think you'd also have to process SQL statements/queries. Using an actual db to back to driver, you get that part for 'free' and the driver just intermediates between the database/sql package interface and the (usually C) library that actually provides database functionality. Since CSV doesn't provide the later, you'd have to write it into your csv driver, basically implementing a full SQL parser/processor. =( Probably the best 'hack' way around would be to import the CSV into a sqlite memory db and run the queries against that, dumping the memory sqlite db to a CSV file at the end.