Title
#users-public
w

Weibo Lei

11/17/2022, 4:50 AM
Hi QuestDB Team, environment QuestDB version: questdb-6.5.4 linux-amd64 Client: golangclient with 20 senders.(always keep connection) I found something weird when using QuestDB, Even though there is no data wring or reading during the time. but the system load is higher than data writing. I checked out the logs, and there are tons of logs printing. Does anyone have ideas about this?
5:16 AM
And now, the data start to write to quest again at 13:00(GMT+8), and I can see the system load is higher than before. I also find some of queue full logs.
2022-11-17T05:09:54.765003Z D i.q.c.l.t.LineTcpConnectionContext [258] queue full
2022-11-17T05:10:01.961007Z D i.q.c.l.t.LineTcpConnectionContext [257] queue full
2022-11-17T05:10:02.688002Z D i.q.c.l.t.LineTcpConnectionContext [248] queue full
2022-11-17T05:10:02.811008Z D i.q.c.l.t.LineTcpConnectionContext [253] queue full
2022-11-17T05:10:03.146003Z D i.q.c.l.t.LineTcpConnectionContext [255] queue full
2022-11-17T05:10:03.705002Z D i.q.c.l.t.LineTcpConnectionContext [260] queue full
2022-11-17T05:10:04.126006Z D i.q.c.l.t.LineTcpConnectionContext [256] queue full
My application's(the only one writer) throughput is almost the same as the morning time. and I don't anything change in my code, I don't why this happened.
5:22 AM
more "queue full" log
2022-11-17T05:21:36.088008Z D i.q.c.l.t.LineTcpConnectionContext [243] queue full
2022-11-17T05:21:36.125004Z D i.q.c.l.t.LineTcpConnectionContext [245] queue full
2022-11-17T05:21:36.238004Z D i.q.c.l.t.LineTcpConnectionContext [244] queue full
2022-11-17T05:21:37.563003Z D i.q.c.l.t.LineTcpConnectionContext [258] queue full
2022-11-17T05:21:39.342001Z D i.q.c.l.t.LineTcpConnectionContext [253] queue full
2022-11-17T05:21:39.430005Z D i.q.c.l.t.LineTcpConnectionContext [260] queue full
2022-11-17T05:21:40.029004Z D i.q.c.l.t.LineTcpConnectionContext [257] queue full
2022-11-17T05:21:40.596908Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=260]
2022-11-17T05:21:40.597178Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=243]
2022-11-17T05:21:40.597336Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=253]
2022-11-17T05:21:40.598179Z D i.q.c.l.t.LineTcpConnectionContext [248] queue full
2022-11-17T05:21:40.598180Z D i.q.c.l.t.LineTcpNetworkIOJob context is waiting on a full queue [fd=248]
2022-11-17T05:21:40.598184Z D i.q.c.l.t.LineTcpConnectionContext [250] queue full
2022-11-17T05:21:40.598186Z D i.q.c.l.t.LineTcpNetworkIOJob context is waiting on a full queue [fd=250]
2022-11-17T05:21:40.598186Z D i.q.c.l.t.LineTcpConnectionContext [261] queue full
2022-11-17T05:21:40.598189Z D i.q.c.l.t.LineTcpNetworkIOJob context is waiting on a full queue [fd=261]
2022-11-17T05:21:40.610949Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=258]
2022-11-17T05:21:40.612176Z D i.q.c.l.t.LineTcpConnectionContext [249] queue full
2022-11-17T05:21:40.612181Z D i.q.c.l.t.LineTcpNetworkIOJob context is waiting on a full queue [fd=249]
2022-11-17T05:21:40.614401Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=244]
2022-11-17T05:21:40.614887Z D i.q.c.l.t.LineTcpConnectionContext [246] queue full
2022-11-17T05:21:40.614890Z D i.q.c.l.t.LineTcpNetworkIOJob context is waiting on a full queue [fd=246]
2022-11-17T05:21:40.619765Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=257]
2022-11-17T05:21:40.620173Z D i.q.c.l.t.LineTcpConnectionContext [252] queue full
2022-11-17T05:21:40.620176Z D i.q.c.l.t.LineTcpNetworkIOJob context is waiting on a full queue [fd=252]
2022-11-17T05:21:40.634748Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=245]
2022-11-17T05:21:40.635858Z D i.q.c.l.t.LineTcpConnectionContext [259] queue full
2022-11-17T05:21:40.635861Z D i.q.c.l.t.LineTcpNetworkIOJob context is waiting on a full queue [fd=259]
2022-11-17T05:21:50.687263Z D i.q.c.l.t.LineTcpConnectionContext [250] queue full
2022-11-17T05:21:51.099341Z D i.q.c.l.t.LineTcpConnectionContext [259] queue full
2022-11-17T05:21:51.225129Z D i.q.c.l.t.LineTcpConnectionContext [252] queue full
2022-11-17T05:21:51.433521Z D i.q.c.l.t.LineTcpConnectionContext [261] queue full
2022-11-17T05:21:51.986024Z D i.q.c.l.t.LineTcpConnectionContext [249] queue full
2022-11-17T05:21:54.665955Z D i.q.c.l.t.LineTcpConnectionContext [246] queue full
2022-11-17T05:21:54.964307Z D i.q.c.l.t.LineTcpConnectionContext [248] queue full
2022-11-17T05:22:02.396091Z D i.q.c.l.t.LineTcpConnectionContext [250] queue full
2022-11-17T05:22:02.795628Z D i.q.c.l.t.LineTcpConnectionContext [259] queue full
2022-11-17T05:22:02.955080Z D i.q.c.l.t.LineTcpConnectionContext [252] queue full
2022-11-17T05:22:04.964006Z D i.q.c.l.t.LineTcpConnectionContext [248] queue full
2022-11-17T05:22:05.447962Z D i.q.c.l.t.LineTcpConnectionContext [261] queue full
2022-11-17T05:22:05.894672Z D i.q.c.l.t.LineTcpConnectionContext [249] queue full
2022-11-17T05:22:06.307099Z D i.q.c.l.t.LineTcpConnectionContext [246] queue full
2022-11-17T05:22:12.396003Z D i.q.c.l.t.LineTcpConnectionContext [250] queue full
2022-11-17T05:22:12.795003Z D i.q.c.l.t.LineTcpConnectionContext [259] queue full
2022-11-17T05:22:12.955002Z D i.q.c.l.t.LineTcpConnectionContext [252] queue full
2022-11-17T05:22:14.964004Z D i.q.c.l.t.LineTcpConnectionContext [248] queue full
2022-11-17T05:22:15.447005Z D i.q.c.l.t.LineTcpConnectionContext [261] queue full
2022-11-17T05:22:15.894004Z D i.q.c.l.t.LineTcpConnectionContext [249] queue full
2022-11-17T05:22:16.307005Z D i.q.c.l.t.LineTcpConnectionContext [246] queue full
2022-11-17T05:22:16.789418Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=261]
2022-11-17T05:22:16.790311Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=246]
2022-11-17T05:22:16.792652Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=250]
2022-11-17T05:22:16.800655Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=252]
2022-11-17T05:22:16.804119Z D i.q.c.l.t.LineTcpNetworkIOJob context is no longer waiting on a full queue [fd=259]
6:12 AM
as a result, my application is OOM!!!
Nicolas Hourcard

Nicolas Hourcard

11/17/2022, 9:13 AM
thx @Weibo Lei, let the engineering look into this