hi, Hope this helps someone else. I use Julia. I have a table with close to 70million rows(QuestDB hosted locally on my M1 Mac.). a few observations:
1. Inserting rows in batches is considerably faster than storing all rows at a time
2. Querying:
a. using Postgres: querying 7 millions rows is fast, however, marshalling into DataFrame takes about 2 mins.
b. using Rest API, querying data as CSV and marshalling into DataFrames takes about 13 secs. Not sure why Rest is order of magnitudes Faster.
I understand issues are not all related to QuestDB(for instance, LibPQ.jl issue). Overall, I am super impressed with the Query performance. am still looking into improving insert performance etc. Awesome product! thanks guys for making it available to us