https://questdb.io logo
Docs
Join the conversationJoin Slack
Channels
announcement
contributors
github
questdb-linen
random
users-market-data
users-public
Powered by Linen
users-public
  • s

    Sadaiyandi Ramadoss

    02/02/2022, 11:20 PM
    Hi Guys, I'm getting this error. What is the meaning of this error "String is outside of file boundary". Can someone help me to understand this problem? i.q.c.l.t.LineTcpConnectionContext [54] could not process line data [table=ssh, msg=String is outside of file boundary [offset=894, len=131072, size=4096], errno=0]
    a
    j
    • 3
    • 8
  • k

    Krzysztof Ogrodnik

    02/03/2022, 8:24 PM
    Good evening. My name is Krzysztof Ogrodnik. Thank you for accepting me in your Slack channel.
    👋 6
    p
    • 2
    • 1
  • c

    Clovis Warlop

    02/04/2022, 6:04 AM
    Hi Guys, Is there a reason why we cant join on GEOHASH ?
    b
    p
    v
    • 4
    • 11
  • a

    Akshay Hartalkar

    02/04/2022, 9:41 AM
    Hi, i am inserting data via ILP and its as following
    sock.sendall((f'data,symbol={row["symbol"] or "NA"},exchange={row["exchange"] or "CCCAGG"} conversion_symbol={row["conversionSymbol"] or "NA"},composite_key={row["composite_key"] or "NA"},close={row["close"] or 0} {row["time"] * 1000000}\n').encode())
    a
    • 2
    • 10
  • o

    Orrin

    02/07/2022, 8:33 PM
    I made a small test case for the EXCEPT keyword so that I can maintain unique property of a table by only inserting new rows. however, when I EXCEPT all fields & rows from two almost identical tables, I find that more rows are excepted than appears true or expected. in a 20k rows, i have a handful of unexpected and inexplicably excepted rows. I have narrowed it down to a single field in one such case as per the following query
    SELECT Volume FROM smallTable WHERE TradeDate = '2022-02-04T00:00:00.000000Z' AND RIC = 'SPXWb042245500.U' EXCEPT SELECT Volume FROM HJGIHL WHERE TradeDate = '2022-02-04T00:00:00.000000Z' AND RIC = 'SPXWb042245500.U';
    weirdly though, when I run each side of the EXCEPT independently, I see that the single value returns to be identical. is this a bug or am i missing some behavioral quirk?
    🙄 1
    b
    • 2
    • 12
  • p

    Pao

    02/08/2022, 5:27 AM
    Hi guys, I want to ask about: 1. Horizontal scaling in questdb. Are there any docs for this? 2. I notice, horizonal scaling available only on enterprise version of questdb. Are there any pricing for enterprise version? 3. How the backup at GCP works? AFAIK, we create cron to backup (time-series backup), then it will create backup file in backup root folder at GCP, then we create scheduled filesystem backup on GCP. Are there any best practice to backup and restore in GCP? 4. Are there any way we can use cold storage for questdb? 5. Are questdb support CDC (change data capture) tools like https://debezium.io/? This will be very helpful for development thank you 🙏
    p
    a
    i
    • 4
    • 9
  • n

    Nick Slocum

    02/08/2022, 6:24 PM
    is it possible to query config variables at run-time?
    👋 1
    v
    • 2
    • 3
  • n

    Nick Slocum

    02/08/2022, 8:17 PM
    Is there a way to query a table for the N most recent records when the table doesn't have an
    Id
    or
    timestamp
    column to order on?
    b
    • 2
    • 8
  • n

    Nick Slocum

    02/08/2022, 9:43 PM
    I'm running matrix/vector algorithms on the queried data and i'm hoping to avoid the cost of reshaping the data after each query
    b
    • 2
    • 4
  • o

    Omar M'Haimdat

    02/09/2022, 11:47 AM
    Hi @Pei thanks for the warm welcoming! I am trying to experiment on QuestDB before picking the ideal db for our use case
    p
    • 2
    • 1
  • m

    Muhammad Amal

    02/10/2022, 3:37 AM
    [ASK] can I backup data questdb on my server, and restore it to another server with transfer questdb data method ? Like using ftp, etc
    v
    i
    • 3
    • 8
  • l

    Luiz Otavio

    02/10/2022, 5:39 PM
    Hello guys, I need help on this error to insert data using influx protocol
    i
    • 2
    • 24
  • d

    Dean Markwick

    02/10/2022, 8:41 PM
    I'm uploading csvs via the rest API, but the timestamps are inconsistent. Is there any way I can make the format flexible? For example: some timestamps are like 2022-02-10T19:00:00.123Z Others: 2022-02-10T19:00:00.123123Z
    v
    • 2
    • 8
  • n

    Nick Slocum

    02/10/2022, 11:12 PM
    also, if I increase
    http.json.query.float.scale
    > 10, quest throws exception
    / by zero
    a
    • 2
    • 15
  • c

    chin lim

    02/11/2022, 11:35 AM
    Hi Team, I like to know whether you provide manage Questdb on AWS in the Sydney Region?
    n
    • 2
    • 1
  • a

    Andy

    02/12/2022, 9:17 AM
    how to deal with this problem,when I want to TRUNCATE TABLE, theere is a error "here is an active query agai nst 'rinei'. Try again."
    a
    • 2
    • 2
  • h

    Holger

    02/12/2022, 8:43 PM
    I setup questdb on docker and would like to optimize some config parameters. I ingest 100k/sec data using the influx line protocol and display the data in Grafana with little delayin real-time. What parameter set would be appropriate for this scenario (threads\worker, mem, cpu).
    a
    • 2
    • 7
  • a

    Andy

    02/14/2022, 10:31 AM
    Ihave import a excel format data via webconsole, how can I delete or drop it ?
    v
    • 2
    • 4
  • a

    Aleks

    02/14/2022, 5:00 PM
    hei, is this an expected behavior? lets say I use the balances table example from https://questdb.io/docs/reference/sql/latest-by/. Then running select * from 'balances' where cust_id = 1; -- returns nothing select * from 'balances' where cust_id = '1'; --returns correct rows select * from 'balances' where cust_id = 1 latest on ts partition by cust_id; -- returns correct latest row It seems that the cust_id (symbol) is only converted from int if I add latest on/partition on, otherwise I must use str value. I might be misremembering but I think this conversion always worked before 6.2? I am running 6.2 with default config (same with JIT).
    a
    n
    • 3
    • 4
  • o

    Orrin

    02/14/2022, 8:00 PM
    can I use the postgres interface to emforce authentication. more than just the single user as specified by the documentation? I’d like to be able to see what each user does with the database and to issue individual credentials
    b
    • 2
    • 3
  • b

    Beetzn

    02/15/2022, 10:57 AM
    Hi guys, I am just evaluating QuestDB for a current poject. Is there a way to insert a data blob into a QuestDB table using Influx DB line protocol? I have already managed to do that with the Postgres wire protocol as data type binary, but Influx DB line protocol would be preferred because of perfomance issues as we have lots of data.
    i
    • 2
    • 4
  • p

    Pei

    02/15/2022, 12:31 PM
    @Alex Alekseichuk @Beetzn welcome! 👋 would love to hear what projects you’re working on
    a
    n
    • 3
    • 24
  • p

    Pei

    02/15/2022, 12:36 PM
    Hi @Alex Alekseichuk could you maybe give more context on how you use it? Maybe a sample query?
    a
    n
    +2
    • 5
    • 26
  • j

    Jaromir Hamala

    02/15/2022, 2:15 PM
    hi, I read https://questdb.io/blog/2022/01/12/jit-sql-compiler pretty interesting! It could be quite interesting to learn more about the evaluation process. I don't know much about this area, but I believe Postgres uses LLVM. Some other projects uses libgccjit which I guess is problematic license-wise. You could also generate just specialized bytecode and let hotspot compile it, etc. A blog about considerations when selecting a JIT compiler would be awesome!
    👍 5
    a
    • 2
    • 2
  • b

    Beetzn

    02/16/2022, 1:35 PM
    Hi, could you please tell me some facts about read/write performances with the different connection mechanisms apart from what is already published in the docs? We have a Java application and want to store a large number of datasets that basically consist of a timestamp and a blob. Simultaneously reading these datasets with high performance is also a requirement. As I learned before influx line protocol offers no binary support, so we can either use Postgres wire protocol or the Java embedded version. Which one would you prefer? I found no statements about performance with the Java embedded version.
    👋 1
    i
    • 2
    • 3
  • d

    David Williams

    02/16/2022, 1:51 PM
    Can I start QuestDB as an in-memory process or thread with main Java process?
    i
    b
    • 3
    • 3
  • i

    Imre

    02/16/2022, 2:00 PM
    Hi David, yes, you can embed QuestDB in your app
    d
    • 2
    • 21
  • e

    Eugene teu

    02/17/2022, 3:01 AM
    Hey team, im trying to insert some
    long256
    value into quest db. I currently have an hexdecimal value of
    4f338f76
    and want to use long256 to represent this. However when i insert this via the rest api, quest changes the value to
    0x338f76
    . was wondering is there any guide on this?
    b
    • 2
    • 43
  • b

    Beetzn

    02/17/2022, 8:55 AM
    Hi, is there a tool to monitor the database if it is set up embedded in the application?
    b
    i
    • 3
    • 3
  • o

    Orrin

    02/18/2022, 3:19 AM
    hi all, i just cloned a new table and tried to load a csv into it using the usual rest api. for some reason though, the timestamp failed on 50% of the rows. I’m guessing that they were out of order…I thought this wasn’t an issue now…is there a bug or a flag? or something else? thoughts welcome… I’ve done this action many times before and it seemingly never failed on these matters..has this changed in 6.2 or is it something else?
    a
    • 2
    • 1
Powered by Linen
Title
o

Orrin

02/18/2022, 3:19 AM
hi all, i just cloned a new table and tried to load a csv into it using the usual rest api. for some reason though, the timestamp failed on 50% of the rows. I’m guessing that they were out of order…I thought this wasn’t an issue now…is there a bug or a flag? or something else? thoughts welcome… I’ve done this action many times before and it seemingly never failed on these matters..has this changed in 6.2 or is it something else?
a

Alex Pelagenko

02/18/2022, 8:38 AM
Is the table partitioned?
View count: 3