Title
#users-market-data
s

Suren Markosov

11/24/2022, 1:04 AM
Hi QuestDB team. I’m a not a user yet (except for your https://demo.questdb.io/ website), so I probably don’t belong here (pardon the Radiohead reference), but I am a fan of your product… just wanted to let you know that the BTC-USD data (in the ‘trades’ table on the https://demo.questdb.io/ website appears to have stopped at 2022-11-22T10:51:40.000000Z. The ETH-USD data is fine, still ticking.
1:05 AM
the query I used for the BTC-USD data is as follows
SELECT 
    timestamp,
    first(price) AS open,
    last(price) AS close,
    min(price),
    max(price),
    sum(amount) AS volume
FROM trades
WHERE symbol ='BTC-USD' 
AND timestamp > '2022-11-22 01:32:08'
--AND timestamp <= '2022-11-22 11:44:00'
SAMPLE BY 1s ALIGN TO CALENDAR
order by timestamp desc;
1:08 AM
the same query but for ETH produces up-to-date/live-ticking results
SELECT 
    timestamp,
    first(price) AS open,
    last(price) AS close,
    min(price),
    max(price),
    sum(amount) AS volume
FROM trades
WHERE symbol ='ETH-USD' 
AND timestamp > '2022-11-22 01:32:08'
SAMPLE BY 1s ALIGN TO CALENDAR
order by timestamp desc;
1:13 AM
my guess is - the ETL pipeline is broken for BTC-USD , either the “listener” ( Websocket subscription for trades from some crypto exchange website) , or perhaps the component that feeds/pumps the data to the database. Or, equally likely, the crypto exchange(s) from which the BTC-USD data gets streamed to QuestDB has a malfunction in their public websocket API channel (tho strange that it’s limited to BTC-USD and doesn’t affect ETH-USD).
1:19 AM
also QuestDB sales team (if you’re on this channel), I’d love to have a discussion of a commercial / supported user license for QuestDB… our company has purchased a fair amount (1 PB at least) of historical tick data, but it’s all sitting in gzipped CSVs on Amazon S3 buckets. And we have subscription to more live tick data with Coinmetrics, but the interface to retrieve that data is clunky. Our Engineering department is leaning toward BigQuery for a solution, but I personally think QuestDB or a similar time series database would work better for this use case.
Pei

Pei

11/24/2022, 2:57 AM
Hi Suren, thanks a lot for reporting the issue on the demo site. We’ll look into that. 🙏
s

Suren Markosov

11/24/2022, 2:59 AM
hi @Pei, thanks , glad to help you help me 🙂
Pei

Pei

11/24/2022, 3:06 AM
We can chat about your use case and regarding the commercial license via DM if that’s better for you. 🙂
s

Suren Markosov

11/24/2022, 3:08 AM
yeah, I’d like to organize something, a call at least , to get to you know your commercial offering better. my email is : suren.markosov@bullish.com (company URL = https://bullish.com/ … yeah, I know a crypto exchange… but we’re not a scam, I swear 🙂 ) you can also connect on LinkedIn : https://www.linkedin.com/in/surenmarkosov/ or you can start a room in this slack space, and ping me there, that works too
3:09 AM
but in the mean-time, if you could let me know when this BTC-USD thing is fixed on the demo site, that would help me sell (demo) your guys product internally 🙂 ,
Pei

Pei

11/24/2022, 3:10 AM
sure, our devs are mostly in european time zone so that would take some time.
s

Suren Markosov

11/24/2022, 3:15 AM
No worries, my internal demo sessions can wait till then…for production purposes we use other data sources, not your demo website 🙂
Pei

Pei

11/24/2022, 3:15 AM
Just DMed you regarding scheduling the call. 🙂
s

Suren Markosov

11/24/2022, 3:38 AM
in case anyone is curious about the “_(pardon the Radiohead reference)_” in my earlier post, “_I (probably) don’t belong here_” (in my post) is from the lyrics from

this Radiohead song

(it’s an oldie by goodie)
Nicolas Hourcard

Nicolas Hourcard

11/24/2022, 9:44 AM
nice to meet you @Suren Markosov!
s

Suren Markosov

11/24/2022, 9:46 AM
nice to meet you too @Nicolas Hourcard, QuestDB is a very impressive product (and open-source too 💪 )
9:47 AM
I’ve spent my fair share of time with tick databases (KDB, Reuters FASTick, etc) and DBs in general… yours ranks nicely , in my view
j

javier ramirez

11/24/2022, 9:47 AM
Hey Suren, as a fan of Radiohead I’d like to say every QuestDB user is f*ckin’ special, even if some of us are a bit weirdo 😃
s

Suren Markosov

11/24/2022, 9:48 AM
words to live by @javier ramirez (and nice to e-meet. you also, btw)
9:51 AM
I didn’t even know I was making a Radiohead reference, until I typed it up and posted…happens a lot with me, this spontaneous song reference generation. Happy Thanksgiving 🦃 to those who celebrate
Pei

Pei

11/24/2022, 10:36 AM
Hey Suren, was great chatting with you this afternoon! Btw, for further comparisons between QuestDB and BigQuery, my colleague @javier ramirez can also share more insights on this topic.
s

Suren Markosov

11/24/2022, 10:59 AM
Thanks Pei, likewise, I really enjoyed our chat. And I’ll DM @javier ramirez in second, to introduce myself + to get a little more insight on benchmarking etc
11:03 AM
btw, Pei, thanks for the heads-up about the demo project being fixed for BTC-USD now (and for the explanation as to the root causes & the fix that was done ) , Also, checked the demo website, it’s working correctly for BTC-USD now ,
thanks a lot team
🙏 (now I really have something to be thankful for 🙂 )
11:10 AM
I’m stepping away to get some dinner for now (8pm here in Korea), but I’ll be back with questions (hopefully useful ones) soon
Nicolas Hourcard

Nicolas Hourcard

11/24/2022, 11:48 AM
of course !