There was an error and the list of applications could not be displayed

benjamin_mukoro · October 8, 2023, 10:15am

Greetings All

I hope someone here can point me in the right direction, I recently upgraded my TTS Open Source instance [docker-based] to the latest from v3.24. Upgrade seem to go well, When I log into the console, I am unable to display applications all other views [Gateways, Organizations, Overview are all okay]
I appreciate any pointers, comments, questions.

Cheers
Ben
TTS_Err1

KrishnaIyerEaswaran2 · October 9, 2023, 11:05am

Did you run a database migration ttn-lw-stack is-db migrate?

benjamin_mukoro · October 9, 2023, 10:09pm

Hi @KrishnaIyerEaswaran2

Thanks for asking. Yes, I have run database migration just like I do with every upgrade, the docker environment just works until now…

KrishnaIyerEaswaran2 · October 10, 2023, 3:22am

Can you enable debug logging and check what’s in the server logs?

benjamin_mukoro · October 10, 2023, 10:13am

Hi @KrishnaIyerEaswaran2 this may sound really dumb, but please can you point in the right direction, to enable debug logging? is there a file I need to edit or is there a parameter I need to pass when I start the server? I currently start the server in a detached mode => docker compose up -d stack, is debug mode the same as running in a console?

My server was installed following the docker installation steps found in by following the [Getting Started Guide] (https://ttn.fyi/v3/getting-started)

Thanks for taking the time to respond and support.

KrishnaIyerEaswaran2 · October 10, 2023, 10:16am

Sure. If you’re using a YAML file for configuration then do the following

log:
  level: debug

If you’re using env then set TTN_LW_LOG_LEVEL=debug. If you’re using flags then set, --log.level=debug.

benjamin_mukoro · October 10, 2023, 12:44pm

Maybe this helps, I set debug level and started up in console mode, so that I can see messages. when I click on the Application menu, the console displays the following…for sure something is broken.

Thanks again.

stack_1 | ERROR Server error {"auth.token_id":"3DME2BVL4S7FRW57XPOGO7V2VWWRLLHCBPNMNYA", "auth.token_type":"AccessToken", "duration": 0.0163, "http.method": "GET","http.path": "/api/v3/applications", "http.status": 500,"namespace": "web", "peer.address": "81.236.157.76:54785","peer.real_ip": "81.236.157.76","request_id":"01HCCQSRJN5Z6BP9Z6BQE52D21"}
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/log.(*zapHandler).HandleLog
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/log/zap_handler.go:84
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/log.(*Logger).Use.func1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/log/logger.go:55
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/log.HandlerFunc.HandleLog
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/log/handler.go:38
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/log/middleware/observability.(*observability).Wrap.func1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/log/middleware/observability/observability.go:86
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/log.HandlerFunc.HandleLog
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/log/handler.go:38
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/log.(*Logger).commit
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/log/logger.go:75
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/log.(*entry).commit
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/log/entry.go:69
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/log.(*entry).Error
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/log/entry.go:94
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webmiddleware.Log.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webmiddleware/log.go:94
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webmiddleware.SecurityHeaders.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webmiddleware/security_headers.go:27
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webmiddleware.MaxBody.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webmiddleware/max_body.go:35
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webmiddleware.Metadata.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webmiddleware/metadata.go:43
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webmiddleware.ProxyHeaders.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webmiddleware/proxy_headers.go:109
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webmiddleware.RequestID.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webmiddleware/request_id.go:36
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webmiddleware.RequestURL.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webmiddleware/request_url.go:28
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webmiddleware.Peer.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webmiddleware/peer.go:34
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webmiddleware.FillContext.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webmiddleware/fillcontext.go:34
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | go.opentelemetry.io/contrib/instrumentation/github.com/gorilla/mux/otelmux.traceware.ServeHTTP
stack_1 | /home/runner/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/github.com/gorilla/mux/otelmux@v0.42.0/mux.go:170
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webmiddleware.Recover.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webmiddleware/recover.go:49
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/webhandlers.WithErrorHandlers.func1.1
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/webhandlers/error.go:74
stack_1 | net/http.HandlerFunc.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2122
stack_1 | github.com/gorilla/mux.(*Router).ServeHTTP
stack_1 | /home/runner/go/pkg/mod/github.com/gorilla/mux@v1.8.0/mux.go:210
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/web.(*Server).ServeHTTP
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/web/web.go:312
stack_1 | go.thethings.network/lorawan-stack/v3/pkg/component.(*Component).ServeHTTP
stack_1 | /home/runner/work/lorawan-stack/lorawan-stack/pkg/component/component.go:441
stack_1 | net/http.serverHandler.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:2936
stack_1 | net/http.initALPNRequest.ServeHTTP
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/server.go:3545
stack_1 | net/http.(*http2serverConn).runHandler
stack_1 | /opt/hostedtoolcache/go/1.20.8/x64/src/net/http/h2_bundle.go:6049
stack_1 | INFO Request handled {"duration": 0.0001,"http.method": "GET", "http.path": "/assets/console-favicon.svg","http.status": 200, "namespace": "web", "peer.address":"81.236.157.76:54785", "peer.real_ip": "81.236.157.76","request_id": "01HCCQSRR1FTSX0KAHGJKBG4CK"}
stack_1 | INFO Request handled {"duration": 0.0001,"http.method": "GET", "http.path": "/assets/console-favicon.png","http.status": 200, "namespace": "web", "peer.address":"81.236.157.76:54785", "peer.real_ip": "81.236.157.76","request_id": "01HCCQSS0FJGPX5S9DG5HCR4AH"}
stack_1 | DEBUG Run database query {"duration": 0.000317,"error": "error:pkg/util/store:not_found (no results found)","error_cause": "sql: no rows in result set", "namespace": "db","operation": "SELECT", "query": "SELECT \"gtw\".\"id\", \"gtw\".\"created_at\", \"gtw\".\"updated_at\", \"gtw\".\"deleted_at\",\"gtw\".\"gateway_id\", \"gtw\".\"gateway_eui\" FROM \"gateways\" AS\"gtw\" WHERE (\"gtw\".gateway_eui = 'AC1F09FFFE0468C0') AND\"gtw\".\"deleted_at\" IS NULL", "rows": 0}
stack_1 | INFO Finished unary call {"duration": 0

descartes · October 10, 2023, 1:27pm

Please use </> not " for logs - makes topics more readable, cheers.

benjamin_mukoro · October 10, 2023, 2:13pm

Thanks for that.