--- contention: cycles/second=3092884196 2027754773879189 10927 @ 0x45d74e 0xf535fe 0xf522e9 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0xf535fd github.com/FerretDB/FerretDB/internal/handler.(*Handler).runCappedCleanup+0x1dd github.com/FerretDB/FerretDB/internal/handler/handler.go:400 # 0xf522e8 github.com/FerretDB/FerretDB/internal/handler.New.func1+0x48 github.com/FerretDB/FerretDB/internal/handler/handler.go:221 2027725955405635 10927 @ 0x45d74e 0xf539de 0xf52209 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0xf539dd github.com/FerretDB/FerretDB/internal/handler.(*Handler).runTTLCleanup+0x1dd github.com/FerretDB/FerretDB/internal/handler/handler.go:426 # 0xf52208 github.com/FerretDB/FerretDB/internal/handler.New.func2+0x48 github.com/FerretDB/FerretDB/internal/handler/handler.go:229 2027709997715094 131126 @ 0x45d74e 0xf95d11 0xf52129 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0xf95d10 github.com/FerretDB/FerretDB/internal/handler.(*Handler).runSelfRegulation+0x250 github.com/FerretDB/FerretDB/internal/handler/selfregulate.go:224 # 0xf52128 github.com/FerretDB/FerretDB/internal/handler.New.func3+0x48 github.com/FerretDB/FerretDB/internal/handler/handler.go:237 2027455198161599 655632 @ 0x45d74e 0x140acad 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x140acac github.com/arl/statsviz.(*Server).init.func1+0x12c github.com/arl/statsviz@v0.8.1/statsviz.go:147 3647634551477 75332 @ 0x45d74e 0xe0dab6 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0xe0dab5 github.com/FerretDB/FerretDB/internal/util/ctxutil.WithDelay.func1+0xb5 github.com/FerretDB/FerretDB/internal/util/ctxutil/ctxutil.go:37 3641845329627 75332 @ 0x45d74e 0x10e8205 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x10e8204 github.com/FerretDB/FerretDB/internal/clientconn.(*conn).run.func2+0x84 github.com/FerretDB/FerretDB/internal/clientconn/conn.go:161 941269948559 25 @ 0x45d74e 0x874d07 0x871cc5 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x874d06 net/http.(*persistConn).writeLoop+0xe6 net/http/transport.go:2600 # 0x871cc4 net/http.(*Transport).dialConn.gowrap3+0x24 net/http/transport.go:1948 205578065799 7 @ 0x45d74e 0x13eba73 0x13ec1e5 0x858ee9 0x85adc7 0x87984e 0x856fe5 0x85cd88 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x13eba72 net/http/pprof.sleep+0x92 net/http/pprof/pprof.go:117 # 0x13ec1e4 net/http/pprof.Profile+0x344 net/http/pprof/pprof.go:163 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x85adc6 net/http.(*ServeMux).ServeHTTP+0x1c6 net/http/server.go:2861 # 0x87984d net/http.serverHandler.ServeHTTP+0x8d net/http/server.go:3340 # 0x856fe4 net/http.(*conn).serve+0x664 net/http/server.go:2109 # 0x85cd87 net/http.(*Server).Serve.gowrap3+0x27 net/http/server.go:3493 77822487403 50 @ 0x45d74e 0x875bad 0x869caf 0x878f98 0x805e82 0x805731 0x807c49 0x14252e5 0x14252d1 0x858ee9 0x85adc7 0x87984e 0x856fe5 0x85cd88 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x875bac net/http.(*persistConn).roundTrip+0x74c net/http/transport.go:2836 # 0x869cae net/http.(*Transport).roundTrip+0xa8e net/http/transport.go:696 # 0x878f97 net/http.(*Transport).RoundTrip+0x17 net/http/roundtrip.go:33 # 0x805e81 net/http.send+0x5e1 net/http/client.go:259 # 0x805730 net/http.(*Client).send+0x90 net/http/client.go:180 # 0x807c48 net/http.(*Client).do+0x9c8 net/http/client.go:729 # 0x14252e4 net/http.(*Client).Do+0xa24 net/http/client.go:587 # 0x14252d0 github.com/FerretDB/FerretDB/internal/util/debug.Listen.func1+0xa10 github.com/FerretDB/FerretDB/internal/util/debug/debug.go:189 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x85adc6 net/http.(*ServeMux).ServeHTTP+0x1c6 net/http/server.go:2861 # 0x87984d net/http.serverHandler.ServeHTTP+0x8d net/http/server.go:3340 # 0x856fe4 net/http.(*conn).serve+0x664 net/http/server.go:2109 # 0x85cd87 net/http.(*Server).Serve.gowrap3+0x27 net/http/server.go:3493 11165832317 18786 @ 0x45d74e 0xc8ca4b 0xc8c938 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0xc8ca4a database/sql.(*Rows).awaitDone+0xea database/sql/sql.go:3009 # 0xc8c937 database/sql.(*Rows).initContextClose.gowrap1+0x37 database/sql/sql.go:2996 9556547807 18786 @ 0x45d74e 0xe03d4f 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0xe03d4e github.com/FerretDB/FerretDB/internal/clientconn/cursor.(*Registry).NewCursor.func1+0xae github.com/FerretDB/FerretDB/internal/clientconn/cursor/registry.go:159 9311567447 31 @ 0x414b12 0x46d0f6 0x4728c5 0x4892c1 # 0x414b11 runtime.chanrecv1+0x11 runtime/chan.go:509 # 0x46d0f5 runtime.(*wakeableSleep).sleep+0x95 runtime/trace.go:1056 # 0x4728c4 runtime.traceStartReadCPU.func1+0x44 runtime/tracecpu.go:56 9293495153 6 @ 0x414b12 0x46d0f6 0x46cfc8 0x4892c1 # 0x414b11 runtime.chanrecv1+0x11 runtime/chan.go:509 # 0x46d0f5 runtime.(*wakeableSleep).sleep+0x95 runtime/trace.go:1056 # 0x46cfc7 runtime.(*traceAdvancerState).start.func1+0x27 runtime/trace.go:993 9284822765 3 @ 0x45d74e 0x13eba73 0x13ec5a8 0x858ee9 0x85adc7 0x87984e 0x856fe5 0x85cd88 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x13eba72 net/http/pprof.sleep+0x92 net/http/pprof/pprof.go:117 # 0x13ec5a7 net/http/pprof.Trace+0x347 net/http/pprof/pprof.go:189 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x85adc6 net/http.(*ServeMux).ServeHTTP+0x1c6 net/http/server.go:2861 # 0x87984d net/http.serverHandler.ServeHTTP+0x8d net/http/server.go:3340 # 0x856fe4 net/http.(*conn).serve+0x664 net/http/server.go:2109 # 0x85cd87 net/http.(*Server).Serve.gowrap3+0x27 net/http/server.go:3493 459612572 5706 @ 0x45d74e 0x13aaabd 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x13aaabc modernc.org/sqlite.interruptOnDone.func1+0x7c modernc.org/sqlite@v1.53.0/sqlite.go:94 312295020 3 @ 0x45d74e 0x86df6d 0x869c74 0x878f98 0x805e82 0x805731 0x807c49 0x14252e5 0x14252d1 0x858ee9 0x85adc7 0x87984e 0x856fe5 0x85cd88 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x86df6c net/http.(*Transport).getConn+0x4ac net/http/transport.go:1523 # 0x869c73 net/http.(*Transport).roundTrip+0xa53 net/http/transport.go:685 # 0x878f97 net/http.(*Transport).RoundTrip+0x17 net/http/roundtrip.go:33 # 0x805e81 net/http.send+0x5e1 net/http/client.go:259 # 0x805730 net/http.(*Client).send+0x90 net/http/client.go:180 # 0x807c48 net/http.(*Client).do+0x9c8 net/http/client.go:729 # 0x14252e4 net/http.(*Client).Do+0xa24 net/http/client.go:587 # 0x14252d0 github.com/FerretDB/FerretDB/internal/util/debug.Listen.func1+0xa10 github.com/FerretDB/FerretDB/internal/util/debug/debug.go:189 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x85adc6 net/http.(*ServeMux).ServeHTTP+0x1c6 net/http/server.go:2861 # 0x87984d net/http.serverHandler.ServeHTTP+0x8d net/http/server.go:3340 # 0x856fe4 net/http.(*conn).serve+0x664 net/http/server.go:2109 # 0x85cd87 net/http.(*Server).Serve.gowrap3+0x27 net/http/server.go:3493 108764216 32 @ 0x45d74e 0x8aad3d 0x8adabb 0x140e07c 0x858ee9 0x140f316 0x858ee9 0x1410cc3 0x858ee9 0x85adc7 0x87984e 0x856fe5 0x85cd88 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x8aad3c github.com/prometheus/client_golang/prometheus.(*Registry).Gather+0x9fc github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:523 # 0x8adaba github.com/prometheus/client_golang/prometheus.(*noTransactionGatherer).Gather+0x1a github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:1074 # 0x140e07b github.com/prometheus/client_golang/prometheus/promhttp.HandlerForTransactional.func1+0x33b github.com/prometheus/client_golang@v1.23.2/prometheus/promhttp/http.go:171 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x140f315 github.com/prometheus/client_golang/prometheus/promhttp.InstrumentMetricHandler.InstrumentHandlerInFlight.func1+0xb5 github.com/prometheus/client_golang@v1.23.2/prometheus/promhttp/instrument_server.go:60 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x1410cc2 github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerCounter.func1+0xc2 github.com/prometheus/client_golang@v1.23.2/prometheus/promhttp/instrument_server.go:147 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x85adc6 net/http.(*ServeMux).ServeHTTP+0x1c6 net/http/server.go:2861 # 0x87984d net/http.serverHandler.ServeHTTP+0x8d net/http/server.go:3340 # 0x856fe4 net/http.(*conn).serve+0x664 net/http/server.go:2109 # 0x85cd87 net/http.(*Server).Serve.gowrap3+0x27 net/http/server.go:3493 97370631 25 @ 0x45d74e 0x873dd9 0x871d25 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x873dd8 net/http.(*persistConn).readLoop+0xc58 net/http/transport.go:2398 # 0x871d24 net/http.(*Transport).dialConn.gowrap2+0x24 net/http/transport.go:1947 19400286 10 @ 0x494f25 0x8ab1e9 0x4892c1 # 0x494f24 sync.(*WaitGroup).Wait+0x84 sync/waitgroup.go:206 # 0x8ab1e8 github.com/prometheus/client_golang/prometheus.(*Registry).Gather.func2+0x28 github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:473 19333099 7 @ 0x414b12 0x8c10f3 0x13ec1ea 0x858ee9 0x85adc7 0x87984e 0x856fe5 0x85cd88 0x4892c1 # 0x414b11 runtime.chanrecv1+0x11 runtime/chan.go:509 # 0x8c10f2 runtime/pprof.StopCPUProfile+0x92 runtime/pprof/pprof.go:893 # 0x13ec1e9 net/http/pprof.Profile+0x349 net/http/pprof/pprof.go:164 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x85adc6 net/http.(*ServeMux).ServeHTTP+0x1c6 net/http/server.go:2861 # 0x87984d net/http.serverHandler.ServeHTTP+0x8d net/http/server.go:3340 # 0x856fe4 net/http.(*conn).serve+0x664 net/http/server.go:2109 # 0x85cd87 net/http.(*Server).Serve.gowrap3+0x27 net/http/server.go:3493 6795397 211 @ 0x493153 0x851656 0x856247 0x857025 0x85cd88 0x4892c1 # 0x493152 sync.(*Cond).Wait+0x72 sync/cond.go:71 # 0x851655 net/http.(*connReader).abortPendingRead+0x95 net/http/server.go:750 # 0x856246 net/http.(*response).finishRequest+0x86 net/http/server.go:1712 # 0x857024 net/http.(*conn).serve+0x6a4 net/http/server.go:2116 # 0x85cd87 net/http.(*Server).Serve.gowrap3+0x27 net/http/server.go:3493 2594431 13 @ 0x94c61e 0x94c603 0x94daa9 0xf53c3e 0xf53a05 0xf52209 0x4892c1 # 0x94c61d sync.(*Mutex).Lock+0x7d sync/mutex.go:46 # 0x94c602 go.opentelemetry.io/otel/internal/global.(*tracerProvider).Tracer+0x62 go.opentelemetry.io/otel@v1.44.0/internal/global/trace.go:78 # 0x94daa8 go.opentelemetry.io/otel.Tracer+0x88 go.opentelemetry.io/otel@v1.44.0/trace.go:16 # 0xf53c3d github.com/FerretDB/FerretDB/internal/handler.(*Handler).cleanupAllTTLCollections+0x5d github.com/FerretDB/FerretDB/internal/handler/handler.go:441 # 0xf53a04 github.com/FerretDB/FerretDB/internal/handler.(*Handler).runTTLCleanup+0x204 github.com/FerretDB/FerretDB/internal/handler/handler.go:428 # 0xf52208 github.com/FerretDB/FerretDB/internal/handler.New.func2+0x48 github.com/FerretDB/FerretDB/internal/handler/handler.go:229 772093 18 @ 0x414b12 0x8740c7 0x876a55 0x876a42 0x4f9810 0x1423569 0x142350d 0x142530c 0x858ee9 0x85adc7 0x87984e 0x856fe5 0x85cd88 0x4892c1 # 0x414b11 runtime.chanrecv1+0x11 runtime/chan.go:509 # 0x8740c6 net/http.(*persistConn).readLoop.func4+0xa6 net/http/transport.go:2370 # 0x876a54 net/http.(*bodyEOFSignal).condfn+0x1f4 net/http/transport.go:3031 # 0x876a41 net/http.(*bodyEOFSignal).Read+0x1e1 net/http/transport.go:3007 # 0x4f980f io.copyBuffer+0x18f io/io.go:429 # 0x1423568 io.Copy+0x148 io/io.go:388 # 0x142350c github.com/FerretDB/FerretDB/internal/util/debug.addToZip+0xec github.com/FerretDB/FerretDB/internal/util/debug/debug.go:101 # 0x142530b github.com/FerretDB/FerretDB/internal/util/debug.Listen.func1+0xa4b github.com/FerretDB/FerretDB/internal/util/debug/debug.go:191 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x85adc6 net/http.(*ServeMux).ServeHTTP+0x1c6 net/http/server.go:2861 # 0x87984d net/http.serverHandler.ServeHTTP+0x8d net/http/server.go:3340 # 0x856fe4 net/http.(*conn).serve+0x664 net/http/server.go:2109 # 0x85cd87 net/http.(*Server).Serve.gowrap3+0x27 net/http/server.go:3493 721174 3 @ 0x506945 0x72ba32 0x73bcd6 0x8765c8 0x8763e5 0x872dfd 0x887f05 0x4892c1 # 0x506944 internal/poll.(*FD).Close+0x64 internal/poll/fd_unix.go:114 # 0x72ba31 net.(*netFD).Close+0x31 net/fd_posix.go:50 # 0x73bcd5 net.(*conn).Close+0x35 net/net.go:220 # 0x8765c7 net/http.(*persistConn).closeLocked+0x127 net/http/transport.go:2929 # 0x8763e4 net/http.(*persistConn).close+0xa4 net/http/transport.go:2914 # 0x872dfc net/http.(*persistConn).closeConnIfStillIdle+0xbc net/http/transport.go:2176 # 0x887f04 net/http.(*persistConn).closeConnIfStillIdle-fm+0x24 :1 464227 13 @ 0x4baeab 0x4bae92 0xe0da5c 0x4892c1 # 0x4baeaa sync.(*Mutex).Lock+0xaa sync/mutex.go:46 # 0x4bae91 context.(*cancelCtx).Done+0x91 context/context.go:453 # 0xe0da5b github.com/FerretDB/FerretDB/internal/util/ctxutil.WithDelay.func1+0x5b github.com/FerretDB/FerretDB/internal/util/ctxutil/ctxutil.go:38 369061 5 @ 0x414b32 0x8999d4 0x13c1265 0x13c124f 0xc2cc1b 0xf551aa 0x10ec225 0x8a9e25 0x4892c1 # 0x414b31 runtime.chanrecv2+0x11 runtime/chan.go:514 # 0x8999d3 github.com/prometheus/client_golang/prometheus.DescribeByCollect+0xd3 github.com/prometheus/client_golang@v1.23.2/prometheus/collector.go:93 # 0x13c1264 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata.(*Registry).Describe+0x24 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata/registry.go:605 # 0x13c124e github.com/FerretDB/FerretDB/internal/backends/sqlite.(*backend).Describe+0xe github.com/FerretDB/FerretDB/internal/backends/sqlite/backend.go:143 # 0xc2cc1a github.com/FerretDB/FerretDB/internal/backends.(*backendContract).Describe+0x1a github.com/FerretDB/FerretDB/internal/backends/backend.go:202 # 0xf551a9 github.com/FerretDB/FerretDB/internal/handler.(*Handler).Describe+0x29 github.com/FerretDB/FerretDB/internal/handler/handler.go:595 # 0x10ec224 github.com/FerretDB/FerretDB/internal/clientconn.(*Listener).Describe+0xc4 github.com/FerretDB/FerretDB/internal/clientconn/listener.go:332 # 0x8a9e24 github.com/prometheus/client_golang/prometheus.(*Registry).Register.func1+0x24 github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:279 328500 2 @ 0x413bf7 0x4603dc 0x483265 0xe0c39a 0xe0c395 0xe0c22e 0xe0ccc5 0x1429cad 0x1429c5f 0x1428d15 0x44ab1d 0x4892c1 # 0x413bf6 runtime.chansend1+0x16 runtime/chan.go:161 # 0x4603db runtime.sigenable+0x5b runtime/signal_unix.go:202 # 0x483264 os/signal.signal_enable+0x64 runtime/sigqueue.go:223 # 0xe0c399 os/signal.enableSignal+0x59 os/signal/signal_unix.go:49 # 0xe0c394 os/signal.Notify.func1+0x54 os/signal/signal.go:146 # 0xe0c22d os/signal.Notify+0x18d os/signal/signal.go:166 # 0xe0ccc4 os/signal.NotifyContext+0x104 os/signal/signal.go:286 # 0x1429cac github.com/FerretDB/FerretDB/internal/util/ctxutil.SigTerm+0x7cc github.com/FerretDB/FerretDB/internal/util/ctxutil/sigterm_unix.go:31 # 0x1429c5e main.run+0x77e github.com/FerretDB/FerretDB/cmd/ferretdb/main.go:415 # 0x1428d14 main.main+0x74 github.com/FerretDB/FerretDB/cmd/ferretdb/main.go:226 # 0x44ab1c runtime.main+0x29c runtime/proc.go:285 314733 1 @ 0x414b32 0x8a9549 0x8aa2de 0x1429190 0x1429578 0x1428d15 0x44ab1d 0x4892c1 # 0x414b31 runtime.chanrecv2+0x11 runtime/chan.go:514 # 0x8a9548 github.com/prometheus/client_golang/prometheus.(*Registry).Register+0x248 github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:290 # 0x8aa2dd github.com/prometheus/client_golang/prometheus.(*Registry).MustRegister+0x5d github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:405 # 0x142918f main.setupMetrics+0x1ef github.com/FerretDB/FerretDB/cmd/ferretdb/main.go:293 # 0x1429577 main.run+0x97 github.com/FerretDB/FerretDB/cmd/ferretdb/main.go:376 # 0x1428d14 main.main+0x74 github.com/FerretDB/FerretDB/cmd/ferretdb/main.go:226 # 0x44ab1c runtime.main+0x29c runtime/proc.go:285 299395 2 @ 0x414b12 0x4729f3 0x485ceb 0x10bbd96 0x10bbd8c 0x10bbb92 0x13ec5b5 0x13ec5a9 0x858ee9 0x85adc7 0x87984e 0x856fe5 0x85cd88 0x4892c1 # 0x414b11 runtime.chanrecv1+0x11 runtime/chan.go:509 # 0x4729f2 runtime.traceStopReadCPU+0x72 runtime/tracecpu.go:96 # 0x485cea runtime.traceAdvance+0x7aa runtime/trace.go:626 # 0x10bbd95 runtime.StopTrace+0x35 runtime/trace.go:325 # 0x10bbd8b runtime/trace.(*traceMultiplexer).removingSubscriber+0x2b runtime/trace/subscribe.go:126 # 0x10bbb91 runtime/trace.(*traceMultiplexer).unsubscribeTraceStartWriter+0x71 runtime/trace/subscribe.go:93 # 0x13ec5b4 runtime/trace.Stop+0x354 runtime/trace/trace.go:125 # 0x13ec5a8 net/http/pprof.Trace+0x348 net/http/pprof/pprof.go:190 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x85adc6 net/http.(*ServeMux).ServeHTTP+0x1c6 net/http/server.go:2861 # 0x87984d net/http.serverHandler.ServeHTTP+0x8d net/http/server.go:3340 # 0x856fe4 net/http.(*conn).serve+0x664 net/http/server.go:2109 # 0x85cd87 net/http.(*Server).Serve.gowrap3+0x27 net/http/server.go:3493 271458 3 @ 0x8732c3 0x873300 0x871d25 0x4892c1 # 0x8732c2 sync.(*Mutex).Lock+0x142 sync/mutex.go:46 # 0x8732ff net/http.(*persistConn).readLoop+0x17f net/http/transport.go:2280 # 0x871d24 net/http.(*Transport).dialConn.gowrap2+0x24 net/http/transport.go:1947 261378 1 @ 0x414b32 0x8999d4 0xe0dfa5 0x8a9e25 0x4892c1 # 0x414b31 runtime.chanrecv2+0x11 runtime/chan.go:514 # 0x8999d3 github.com/prometheus/client_golang/prometheus.DescribeByCollect+0xd3 github.com/prometheus/client_golang@v1.23.2/prometheus/collector.go:93 # 0xe0dfa4 github.com/FerretDB/FerretDB/internal/util/state.(*metricsCollector).Describe+0x24 github.com/FerretDB/FerretDB/internal/util/state/metrics.go:49 # 0x8a9e24 github.com/prometheus/client_golang/prometheus.(*Registry).Register.func1+0x24 github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:279 243714 6 @ 0x414b32 0x8a9549 0x8aa2de 0x142a799 0x1428d15 0x44ab1d 0x4892c1 # 0x414b31 runtime.chanrecv2+0x11 runtime/chan.go:514 # 0x8a9548 github.com/prometheus/client_golang/prometheus.(*Registry).Register+0x248 github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:290 # 0x8aa2dd github.com/prometheus/client_golang/prometheus.(*Registry).MustRegister+0x5d github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:405 # 0x142a798 main.run+0x12b8 github.com/FerretDB/FerretDB/cmd/ferretdb/main.go:578 # 0x1428d14 main.main+0x74 github.com/FerretDB/FerretDB/cmd/ferretdb/main.go:226 # 0x44ab1c runtime.main+0x29c runtime/proc.go:285 194561 4 @ 0x414b12 0x72d86b 0x44685e 0x72d39a 0x7411bc 0x740cfb 0x7359f8 0x744987 0x744829 0x74482a 0x7222ae 0x721a88 0x72116a 0x720a49 0x887549 0x86cfb2 0x86ff65 0x86ea78 0x86e8b5 0x4892c1 # 0x414b11 runtime.chanrecv1+0x11 runtime/chan.go:509 # 0x72d86a net.(*netFD).connect.func1+0x4a net/fd_unix.go:95 # 0x44685d runtime.deferreturn+0x5d runtime/panic.go:589 # 0x72d399 net.(*netFD).connect+0x759 net/fd_unix.go:158 # 0x7411bb net.(*netFD).dial+0x3bb net/sock_posix.go:124 # 0x740cfa net.socket+0x29a net/sock_posix.go:70 # 0x7359f7 net.internetSocket+0xf7 net/ipsock_posix.go:167 # 0x744986 net.(*sysDialer).doDialTCPProto+0xe6 net/tcpsock_posix.go:85 # 0x744828 net.(*sysDialer).doDialTCP+0x68 net/tcpsock_posix.go:75 # 0x744829 net.(*sysDialer).dialTCP+0x69 net/tcpsock_posix.go:71 # 0x7222ad net.(*sysDialer).dialSingle+0x3cd net/dial.go:721 # 0x721a87 net.(*sysDialer).dialSerial+0x247 net/dial.go:686 # 0x721169 net.(*sysDialer).dialParallel+0x309 net/dial.go:587 # 0x720a48 net.(*Dialer).DialContext+0x6a8 net/dial.go:578 # 0x887548 net.(*Dialer).DialContext-fm+0x48 :1 # 0x86cfb1 net/http.(*Transport).dial+0xd1 net/http/transport.go:1278 # 0x86ff64 net/http.(*Transport).dialConn+0x7e4 net/http/transport.go:1783 # 0x86ea77 net/http.(*Transport).dialConnFor+0xb7 net/http/transport.go:1618 # 0x86e8b4 net/http.(*Transport).startDialConnForLocked.func1+0x34 net/http/transport.go:1600 184915 2 @ 0x413bf7 0x47b7fe 0x4892c1 # 0x413bf6 runtime.chansend1+0x16 runtime/chan.go:161 # 0x47b7fd runtime.ensureSigM.func1+0x13d runtime/signal_unix.go:1096 182928 2 @ 0x45d74e 0x72d77a 0x4892c1 # 0x45d74d runtime.selectgo+0x52d runtime/select.go:535 # 0x72d779 net.(*netFD).connect.func2+0x79 net/fd_unix.go:107 125535 7 @ 0x493eaa 0x493ea9 0x493e26 0x493b9c 0x5926bb 0x5926d4 0x5931a5 0xc2fa4f 0xc2fa27 0xc2fa13 0xc2c5a8 0xf53ebb 0xf53a05 0xf52209 0x4892c1 # 0x493ea9 sync.(*Mutex).Lock+0x49 sync/mutex.go:46 # 0x493ea8 sync.(*Pool).pinSlow+0x48 sync/pool.go:227 # 0x493e25 sync.(*Pool).pin+0x45 sync/pool.go:220 # 0x493b9b sync.(*Pool).Get+0x1b sync/pool.go:135 # 0x5926ba regexp.newOnePassMachine+0x9a regexp/exec.go:384 # 0x5926d3 regexp.(*Regexp).doOnePass+0xb3 regexp/exec.go:403 # 0x5931a4 regexp.(*Regexp).doExecute+0x2a4 regexp/exec.go:532 # 0xc2fa4e regexp.(*Regexp).doMatch+0x4e regexp/exec.go:514 # 0xc2fa26 regexp.(*Regexp).MatchString+0x26 regexp/regexp.go:527 # 0xc2fa12 github.com/FerretDB/FerretDB/internal/backends.validateDatabaseName+0x12 github.com/FerretDB/FerretDB/internal/backends/validation.go:43 # 0xc2c5a7 github.com/FerretDB/FerretDB/internal/backends.(*backendContract).Database+0x27 github.com/FerretDB/FerretDB/internal/backends/backend.go:121 # 0xf53eba github.com/FerretDB/FerretDB/internal/handler.(*Handler).cleanupAllTTLCollections+0x2da github.com/FerretDB/FerretDB/internal/handler/handler.go:461 # 0xf53a04 github.com/FerretDB/FerretDB/internal/handler.(*Handler).runTTLCleanup+0x204 github.com/FerretDB/FerretDB/internal/handler/handler.go:428 # 0xf52208 github.com/FerretDB/FerretDB/internal/handler.New.func2+0x48 github.com/FerretDB/FerretDB/internal/handler/handler.go:229 120838 1 @ 0x494930 0x49492f 0xc8e9ba 0xc8cb59 0xc8c938 0x4892c1 # 0x49492f sync.(*Mutex).Lock+0xf sync/mutex.go:46 # 0x49492e sync.(*RWMutex).Lock+0xe sync/rwmutex.go:150 # 0xc8e9b9 database/sql.(*Rows).close+0x99 database/sql/sql.go:3443 # 0xc8cb58 database/sql.(*Rows).awaitDone+0x1f8 database/sql/sql.go:3020 # 0xc8c937 database/sql.(*Rows).initContextClose.gowrap1+0x37 database/sql/sql.go:2996 99883 3 @ 0x414b12 0x8740c7 0x876a55 0x876a42 0x5b3db7 0x4f93ae 0x65191f 0x65189b 0x65149a 0x876e46 0x876e1d 0x4f9810 0x1423569 0x142350d 0x142530c 0x858ee9 0x85adc7 0x87984e 0x856fe5 0x85cd88 0x4892c1 # 0x414b11 runtime.chanrecv1+0x11 runtime/chan.go:509 # 0x8740c6 net/http.(*persistConn).readLoop.func4+0xa6 net/http/transport.go:2370 # 0x876a54 net/http.(*bodyEOFSignal).condfn+0x1f4 net/http/transport.go:3031 # 0x876a41 net/http.(*bodyEOFSignal).Read+0x1e1 net/http/transport.go:3007 # 0x5b3db6 bufio.(*Reader).Read+0x196 bufio/bufio.go:245 # 0x4f93ad io.ReadAtLeast+0x8d io/io.go:335 # 0x65191e io.ReadFull+0x9e io/io.go:354 # 0x65189a compress/gzip.(*Reader).readHeader+0x1a compress/gzip/gunzip.go:175 # 0x651499 compress/gzip.(*Reader).Reset+0x299 compress/gzip/gunzip.go:113 # 0x876e45 compress/gzip.NewReader+0x65 compress/gzip/gunzip.go:94 # 0x876e1c net/http.(*gzipReader).Read+0x3c net/http/transport.go:3048 # 0x4f980f io.copyBuffer+0x18f io/io.go:429 # 0x1423568 io.Copy+0x148 io/io.go:388 # 0x142350c github.com/FerretDB/FerretDB/internal/util/debug.addToZip+0xec github.com/FerretDB/FerretDB/internal/util/debug/debug.go:101 # 0x142530b github.com/FerretDB/FerretDB/internal/util/debug.Listen.func1+0xa4b github.com/FerretDB/FerretDB/internal/util/debug/debug.go:191 # 0x858ee8 net/http.HandlerFunc.ServeHTTP+0x28 net/http/server.go:2322 # 0x85adc6 net/http.(*ServeMux).ServeHTTP+0x1c6 net/http/server.go:2861 # 0x87984d net/http.serverHandler.ServeHTTP+0x8d net/http/server.go:3340 # 0x856fe4 net/http.(*conn).serve+0x664 net/http/server.go:2109 # 0x85cd87 net/http.(*Server).Serve.gowrap3+0x27 net/http/server.go:3493 92784 11 @ 0x94c61e 0x94c603 0x94daa9 0xf553fe 0xf53625 0xf522e9 0x4892c1 # 0x94c61d sync.(*Mutex).Lock+0x7d sync/mutex.go:46 # 0x94c602 go.opentelemetry.io/otel/internal/global.(*tracerProvider).Tracer+0x62 go.opentelemetry.io/otel@v1.44.0/internal/global/trace.go:78 # 0x94daa8 go.opentelemetry.io/otel.Tracer+0x88 go.opentelemetry.io/otel@v1.44.0/trace.go:16 # 0xf553fd github.com/FerretDB/FerretDB/internal/handler.(*Handler).cleanupAllCappedCollections+0x5d github.com/FerretDB/FerretDB/internal/handler/handler.go:615 # 0xf53624 github.com/FerretDB/FerretDB/internal/handler.(*Handler).runCappedCleanup+0x204 github.com/FerretDB/FerretDB/internal/handler/handler.go:402 # 0xf522e8 github.com/FerretDB/FerretDB/internal/handler.New.func1+0x48 github.com/FerretDB/FerretDB/internal/handler/handler.go:221 91889 1 @ 0x413bf7 0x10ef4c5 0x13b9b69 0x13bf8e5 0x899a45 0x4892c1 # 0x413bf6 runtime.chansend1+0x16 runtime/chan.go:161 # 0x10ef4c4 github.com/FerretDB/FerretDB/internal/util/fsql.(*metricsCollector).Collect+0x8a4 github.com/FerretDB/FerretDB/internal/util/fsql/metrics.go:124 # 0x13b9b68 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata/pool.(*Pool).Collect+0x1c8 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata/pool/pool.go:270 # 0x13bf8e4 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata.(*Registry).Collect+0x44 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata/registry.go:610 # 0x899a44 github.com/prometheus/client_golang/prometheus.DescribeByCollect.func1+0x24 github.com/prometheus/client_golang@v1.23.2/prometheus/collector.go:90 69885 4 @ 0x94c61e 0x94c603 0x94daa9 0xc2c689 0xf53dae 0xf53a05 0xf52209 0x4892c1 # 0x94c61d sync.(*Mutex).Lock+0x7d sync/mutex.go:46 # 0x94c602 go.opentelemetry.io/otel/internal/global.(*tracerProvider).Tracer+0x62 go.opentelemetry.io/otel@v1.44.0/internal/global/trace.go:78 # 0x94daa8 go.opentelemetry.io/otel.Tracer+0x88 go.opentelemetry.io/otel@v1.44.0/trace.go:16 # 0xc2c688 github.com/FerretDB/FerretDB/internal/backends.(*backendContract).ListDatabases+0x68 github.com/FerretDB/FerretDB/internal/backends/backend.go:152 # 0xf53dad github.com/FerretDB/FerretDB/internal/handler.(*Handler).cleanupAllTTLCollections+0x1cd github.com/FerretDB/FerretDB/internal/handler/handler.go:455 # 0xf53a04 github.com/FerretDB/FerretDB/internal/handler.(*Handler).runTTLCleanup+0x204 github.com/FerretDB/FerretDB/internal/handler/handler.go:428 # 0xf52208 github.com/FerretDB/FerretDB/internal/handler.New.func2+0x48 github.com/FerretDB/FerretDB/internal/handler/handler.go:229 61856 9 @ 0x4baeab 0x4bae92 0x4bb1bb 0x4ba659 0x4ba61d 0x10e6109 0x10eb8b4 0x4892c1 # 0x4baeaa sync.(*Mutex).Lock+0xaa sync/mutex.go:46 # 0x4bae91 context.(*cancelCtx).Done+0x91 context/context.go:453 # 0x4bb1ba context.(*cancelCtx).propagateCancel+0x7a context/context.go:478 # 0x4ba658 context.withCancel+0x58 context/context.go:278 # 0x4ba61c context.WithCancelCause+0x1c context/context.go:269 # 0x10e6108 github.com/FerretDB/FerretDB/internal/clientconn.(*conn).run+0x48 github.com/FerretDB/FerretDB/internal/clientconn/conn.go:142 # 0x10eb8b3 github.com/FerretDB/FerretDB/internal/clientconn.acceptLoop.func1+0x573 github.com/FerretDB/FerretDB/internal/clientconn/listener.go:294 61856 7 @ 0x94c61e 0x94c603 0x94daa9 0xc2eb2c 0xf53ef7 0xf53a05 0xf52209 0x4892c1 # 0x94c61d sync.(*Mutex).Lock+0x7d sync/mutex.go:46 # 0x94c602 go.opentelemetry.io/otel/internal/global.(*tracerProvider).Tracer+0x62 go.opentelemetry.io/otel@v1.44.0/internal/global/trace.go:78 # 0x94daa8 go.opentelemetry.io/otel.Tracer+0x88 go.opentelemetry.io/otel@v1.44.0/trace.go:16 # 0xc2eb2b github.com/FerretDB/FerretDB/internal/backends.(*databaseContract).ListCollections+0x6b github.com/FerretDB/FerretDB/internal/backends/database.go:111 # 0xf53ef6 github.com/FerretDB/FerretDB/internal/handler.(*Handler).cleanupAllTTLCollections+0x316 github.com/FerretDB/FerretDB/internal/handler/handler.go:466 # 0xf53a04 github.com/FerretDB/FerretDB/internal/handler.(*Handler).runTTLCleanup+0x204 github.com/FerretDB/FerretDB/internal/handler/handler.go:428 # 0xf52208 github.com/FerretDB/FerretDB/internal/handler.New.func2+0x48 github.com/FerretDB/FerretDB/internal/handler/handler.go:229 50116 1 @ 0x413bf7 0x10eedce 0x13b9b69 0x13bf8e5 0x899a45 0x4892c1 # 0x413bf6 runtime.chansend1+0x16 runtime/chan.go:161 # 0x10eedcd github.com/FerretDB/FerretDB/internal/util/fsql.(*metricsCollector).Collect+0x1ad github.com/FerretDB/FerretDB/internal/util/fsql/metrics.go:54 # 0x13b9b68 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata/pool.(*Pool).Collect+0x1c8 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata/pool/pool.go:270 # 0x13bf8e4 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata.(*Registry).Collect+0x44 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata/registry.go:610 # 0x899a44 github.com/prometheus/client_golang/prometheus.DescribeByCollect.func1+0x24 github.com/prometheus/client_golang@v1.23.2/prometheus/collector.go:90 47537 1 @ 0x94c61e 0x94c603 0x94daa9 0xc2eb2c 0xf557c2 0xf53625 0xf522e9 0x4892c1 # 0x94c61d sync.(*Mutex).Lock+0x7d sync/mutex.go:46 # 0x94c602 go.opentelemetry.io/otel/internal/global.(*tracerProvider).Tracer+0x62 go.opentelemetry.io/otel@v1.44.0/internal/global/trace.go:78 # 0x94daa8 go.opentelemetry.io/otel.Tracer+0x88 go.opentelemetry.io/otel@v1.44.0/trace.go:16 # 0xc2eb2b github.com/FerretDB/FerretDB/internal/backends.(*databaseContract).ListCollections+0x6b github.com/FerretDB/FerretDB/internal/backends/database.go:111 # 0xf557c1 github.com/FerretDB/FerretDB/internal/handler.(*Handler).cleanupAllCappedCollections+0x421 github.com/FerretDB/FerretDB/internal/handler/handler.go:639 # 0xf53624 github.com/FerretDB/FerretDB/internal/handler.(*Handler).runCappedCleanup+0x204 github.com/FerretDB/FerretDB/internal/handler/handler.go:402 # 0xf522e8 github.com/FerretDB/FerretDB/internal/handler.New.func1+0x48 github.com/FerretDB/FerretDB/internal/handler/handler.go:221 45627 1 @ 0x413bf7 0x8999c5 0x13c1265 0x13c124f 0xc2cc1b 0xf551aa 0x10ec225 0x8a9e25 0x4892c1 # 0x413bf6 runtime.chansend1+0x16 runtime/chan.go:161 # 0x8999c4 github.com/prometheus/client_golang/prometheus.DescribeByCollect+0xc4 github.com/prometheus/client_golang@v1.23.2/prometheus/collector.go:94 # 0x13c1264 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata.(*Registry).Describe+0x24 github.com/FerretDB/FerretDB/internal/backends/sqlite/metadata/registry.go:605 # 0x13c124e github.com/FerretDB/FerretDB/internal/backends/sqlite.(*backend).Describe+0xe github.com/FerretDB/FerretDB/internal/backends/sqlite/backend.go:143 # 0xc2cc1a github.com/FerretDB/FerretDB/internal/backends.(*backendContract).Describe+0x1a github.com/FerretDB/FerretDB/internal/backends/backend.go:202 # 0xf551a9 github.com/FerretDB/FerretDB/internal/handler.(*Handler).Describe+0x29 github.com/FerretDB/FerretDB/internal/handler/handler.go:595 # 0x10ec224 github.com/FerretDB/FerretDB/internal/clientconn.(*Listener).Describe+0xc4 github.com/FerretDB/FerretDB/internal/clientconn/listener.go:332 # 0x8a9e24 github.com/prometheus/client_golang/prometheus.(*Registry).Register.func1+0x24 github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:279 30928 5 @ 0x414b32 0x8a9549 0x1411145 0x14110ca 0x140fcb6 0x1423d3a 0x142b3a8 0x4892c1 # 0x414b31 runtime.chanrecv2+0x11 runtime/chan.go:514 # 0x8a9548 github.com/prometheus/client_golang/prometheus.(*Registry).Register+0x248 github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:290 # 0x1411144 github.com/prometheus/client_golang/prometheus.(*Registry).MustRegister+0x204 github.com/prometheus/client_golang@v1.23.2/prometheus/registry.go:405 # 0x14110c9 github.com/prometheus/client_golang/prometheus/promhttp.checkLabels+0x189 github.com/prometheus/client_golang@v1.23.2/prometheus/promhttp/instrument_server.go:340 # 0x140fcb5 github.com/prometheus/client_golang/prometheus/promhttp.InstrumentHandlerDuration+0x1b5 github.com/prometheus/client_golang@v1.23.2/prometheus/promhttp/instrument_server.go:91 # 0x1423d39 github.com/FerretDB/FerretDB/internal/util/debug.Listen+0x659 github.com/FerretDB/FerretDB/internal/util/debug/debug.go:204 # 0x142b3a7 main.run.func3+0x227 github.com/FerretDB/FerretDB/cmd/ferretdb/main.go:441