failed to parse in console log

[cloudcafetech]

Running on Vanila K8s (RKE2 + Cilium + HCO + OKD Console)

I know its design for Openshift but trying to setup in Vanila K8s,

• Deployment

helm repo add netobserv https://netobserv.io/static/helm/ --force-update
helm install netobserv --create-namespace -n netobserv --set standaloneConsole.enable=true netobserv/netobserv-operator

cat <<EOF > netobserv-flow-collector.yaml
apiVersion: flows.netobserv.io/v1beta2
kind: FlowCollector
metadata:
  name: cluster
spec:
  namespace: netobserv
  consolePlugin:
    advanced:
      env:
        TEST_CONSOLE: "true"
  loki:
    enable: true
    mode: Monolithic
    monolithic:
      url: http://loki.logging:3100/
      tls:
        enable: false
        insecureSkipVerify: false
  prometheus:
    querier:
      manual:
        url: http://kube-prometheus-stack-prometheus.monitoring:9090
EOF

kubectl apply -f netobserv-flow-collector.yaml
kubectl -n netobserv patch service/netobserv-plugin -p '{"spec": {"type": "NodePort"}}

• POD SVC status

k get pods -n kube-system -l app=console
NAME                      READY   STATUS    RESTARTS   AGE
console-ddb6895cc-nckc5   3/3     Running   0          16m

k  get po,svc
NAME                                               READY   STATUS    RESTARTS   AGE
pod/flowlogs-pipeline-ms9vx                        1/1     Running   0          21m
pod/flowlogs-pipeline-nfq72                        1/1     Running   0          21m
pod/netobserv-controller-manager-546bb84fb-lr5z8   1/1     Running   0          21m
pod/netobserv-plugin-9774b5c58-bj7mg               1/1     Running   0          21m

NAME                                TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)          AGE
service/flowlogs-pipeline-prom      ClusterIP   10.105.160.161   <none>        9401/TCP         21m
service/netobserv-metrics-service   ClusterIP   10.104.119.201   <none>        8443/TCP         21m
service/netobserv-plugin            NodePort    10.107.95.88     <none>        9001:32742/TCP   21m
service/netobserv-plugin-metrics    ClusterIP   10.97.47.53      <none>        9002/TCP         21m
service/netobserv-webhook-service   ClusterIP   10.100.159.80    <none>        443/TCP          21m

• OKD Console POD Log

k logs -f console-ddb6895cc-nckc5 -n kube-system

Defaulted container "console-app" out of: console-app, monitoring-plugin, kubevirt-plugin
I0503 10:54:07.530674       1 main.go:217] The following console plugins are enabled:
I0503 10:54:07.530692       1 main.go:219]  - monitoring-plugin
I0503 10:54:07.530695       1 main.go:219]  - kubevirt-plugin
I0503 10:54:07.530698       1 main.go:219]  - netobserv-plugin
I0503 10:54:07.530700       1 main.go:219]  - forklift-console-plugin
W0503 10:54:07.530705       1 authoptions.go:112] Flag inactivity-timeout is set to less then 300 seconds and will be ignored!
W0503 10:54:07.530729       1 main.go:543] DEPRECATED: --k8s-auth is deprecated and setting it has no effect
W0503 10:54:07.530765       1 authoptions.go:265] running with AUTHENTICATION DISABLED -- for development use only!
I0503 10:54:07.532188       1 server.go:544] The following console endpoints are now proxied to these services:
I0503 10:54:07.532219       1 server.go:547]  - /api/proxy/plugin/forklift-console-plugin/forklift-inventory/ -> https://forklift-inventory.konveyor-forklift.svc.cluster.local:8443
I0503 10:54:07.532260       1 server.go:547]  - /api/proxy/plugin/forklift-console-plugin/must-gather-api/ -> https://must-gather-api.konveyor-forklift.svc.cluster.local:8443
I0503 10:54:07.532424       1 main.go:650] Binding to 0.0.0.0:9000...
I0503 10:54:07.532445       1 main.go:655] not using TLS
I0503 10:54:08.747012       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/api/v1/namespaces/kubevirt-hyperconverged/pods?watch=true&fieldSelector=metadata.name%3Daaq-operator-74d8bb6cf6-gdmvl
E0503 10:54:08.761351       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
I0503 10:54:08.792734       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/apis/cdi.kubevirt.io/v1beta1/cdiconfigs?watch=true&fieldSelector=metadata.name%3Dconfig
I0503 10:54:10.532511       1 metrics.go:133] serverconfig.Metrics: Update ConsolePlugin metrics...
E0503 10:54:10.538708       1 metrics.go:138] serverconfig.Metrics: Failed to get all installed ConsolePlugins: the server could not find the requested resource
I0503 10:54:10.538724       1 metrics.go:143] serverconfig.Metrics: Update ConsolePlugin metrics: &map[forklift:map[notfound:1] kubevirt:map[notfound:1] monitoring:map[notfound:1] netobserv:map[notfound:1]] (took 6.18586ms)
I0503 10:54:12.533225       1 metrics.go:80] usage.Metrics: Count console users...
I0503 10:54:12.537385       1 metrics.go:156] usage.Metrics: Update console users metrics: 0 kubeadmin, 0 cluster-admins, 0 developers, 0 unknown/errors (took 4.085526ms)
I0503 10:54:22.770499       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/api/v1/namespaces?watch=true&resourceVersion=325301
I0503 10:54:22.801629       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/apis/discovery.k8s.io/v1/namespaces/kubevirt-hyperconverged/endpointslices?watch=true&resourceVersion=325301
I0503 10:54:22.827450       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/apis/policy/v1/namespaces/kubevirt-hyperconverged/poddisruptionbudgets?watch=true&resourceVersion=325301
I0503 10:54:24.527563       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/apis/apiextensions.k8s.io/v1/customresourcedefinitions?watch=true&resourceVersion=325301
E0503 10:55:08.797550       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 10:56:08.983457       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 10:57:08.731337       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 11:06:05.709636       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 11:06:10.772135       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
I0503 11:06:11.219985       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/api/v1/namespaces/openshift-console-user-settings/configmaps?watch=true&fieldSelector=metadata.name%3Duser-settings-5e309e0f-95b2-4c0b-bae9-4e0b33bef017
E0503 11:06:11.568562       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 11:06:11.588880       1 handler.go:110] Failed to get operator: packagemanifests.packages.operators.coreos.com "lightspeed-operator" not found
E0503 11:06:11.771741       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:11.771822       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:11.771924       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:11.772012       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:11.772123       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:12.667101       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:12.667914       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:12.673134       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:12.674571       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
I0503 11:06:13.507693       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/apis/apiextensions.k8s.io/v1/customresourcedefinitions?watch=true&resourceVersion=331772
I0503 11:06:13.721006       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/api/v1/namespaces/openshift-console-user-settings/configmaps?watch=true&fieldSelector=metadata.name%3Duser-settings-5e309e0f-95b2-4c0b-bae9-4e0b33bef017
I0503 11:06:13.746781       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/apis/cdi.kubevirt.io/v1beta1/cdiconfigs?watch=true&fieldSelector=metadata.name%3Dconfig
E0503 11:06:17.331652       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:17.332753       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:19.254971       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
E0503 11:06:19.389634       1 handlers.go:76] Failed to get user data to handle user setting request: Post "https://kubernetes.default/apis/authentication.k8s.io/v1/selfsubjectreviews": tls: failed to verify certificate: x509: certificate signed by unknown authority
I0503 11:06:20.124887       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/api/v1/namespaces?watch=true&resourceVersion=331836
E0503 11:10:08.734237       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 11:11:08.762779       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 11:12:08.736142       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin

• Plugins POD logs

k logs -f pod/netobserv-plugin-9774b5c58-bj7mg
time="2025-05-03T10:50:11Z" level=info msg="Starting netobserv-console-plugin [build version: v1.8.2-community-011f3a4, build date: 2025-03-20 11:27] at log level info" module=main
time="2025-05-03T10:50:11Z" level=info msg="Loki is enabled (http://loki.logging:3100/)" module=config
time="2025-05-03T10:50:11Z" level=info msg="Prometheus is enabled:\n - admin: http://kube-prometheus-stack-prometheus.monitoring:9090\n - dev: \n" module=config
time="2025-05-03T10:50:11Z" level=warning msg="INSECURE: auth checker is disabled" module=config
time="2025-05-03T10:50:11Z" level=info msg="listening on http://:9002" module=metrics-server
time="2025-05-03T10:50:11Z" level=info msg="listening on http://:9001" module=server
time="2025-05-03T10:51:50Z" level=error msg="cannot unmarshal, response was: 404 page not found\n" error="invalid character 'p' after top-level value" module=handler
time="2025-05-03T10:51:50Z" level=error msg="Could not get max chunk age: error when fetching Loki ingester max chunk age: Error from Loki query: [404] Unknown error from Loki\ncannot unmarshal\n404 page not found\n" module=handler
time="2025-05-03T11:03:42Z" level=error msg="cannot unmarshal, response was: 404 page not found\n" error="invalid character 'p' after top-level value" module=handler
time="2025-05-03T11:03:42Z" level=error msg="Could not get max chunk age: error when fetching Loki ingester max chunk age: Error from Loki query: [404] Unknown error from Loki\ncannot unmarshal\n404 page not found\n" module=handler

[jotak]

Hi @cloudcafetech ,
The error is about the console not being able to reach loki. How did you install loki? The configuration may vary according to the installation mode.
The error suggests that the host name is ok, but not the rest of the URL, so perhaps there's a suffix or something added to the url?
For example, can you check if curl http://loki.logging:3100/loki/api/v1/labels works ? (from within the cluster)

[cloudcafetech]

@jotak Thanks for looking the issue.

can you check if curl http://loki.logging:3100/loki/api/v1/labels works ? (from within the cluster)

k  exec -it netobserv-plugin-68ccdbc746-9t66g -n netobserv -- sh
sh-5.1# curl http://loki.logging:3100/loki/api/v1/labels
{"status":"success","data":["DstK8S_Namespace","DstK8S_OwnerName","DstK8S_Type","FlowDirection","K8S_FlowLayer","SrcK8S_Namespace","SrcK8S_OwnerName","SrcK8S_Type","__name__","app","app_kubernetes_io_component","app_kubernetes_io_instance","app_kubernetes_io_managed_by","app_kubernetes_io_name","app_kubernetes_io_part_of","app_kubernetes_io_version","apps_kubernetes_io_pod_index","cdi_kubevirt_io","chart","component","container","control_plane","controller_revision_hash","controller_tools_k8s_io","filename","helm_sh_chart","heritage","job","kubevirt_io","kubevirt_io_created_by","kubevirt_io_domain","kubevirt_io_nodeName","level","name","namespace","operator_cdi_kubevirt_io_createVersion","operator_prometheus_io_name","operator_prometheus_io_shard","pod","pod_template_generation","pod_template_hash","prometheus","prometheus_cdi_kubevirt_io","prometheus_cnao_io","prometheus_forklift_konveyor_io","prometheus_kubevirt_io","release","service","statefulset_kubernetes_io_pod_name","status_code","version","vm","vm_kubevirt_io_name"]}

But I am more interested for console POD Log error (failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin)

k logs -f console-ddb6895cc-nckc5 -n kube-system

Defaulted container "console-app" out of: console-app, monitoring-plugin, kubevirt-plugin
I0503 10:54:07.530674       1 main.go:217] The following console plugins are enabled:
I0503 10:54:07.530692       1 main.go:219]  - monitoring-plugin
I0503 10:54:07.530695       1 main.go:219]  - kubevirt-plugin
I0503 10:54:07.530698       1 main.go:219]  - netobserv-plugin
I0503 10:54:07.530700       1 main.go:219]  - forklift-console-plugin
W0503 10:54:07.530705       1 authoptions.go:112] Flag inactivity-timeout is set to less then 300 seconds and will be ignored!
W0503 10:54:07.530729       1 main.go:543] DEPRECATED: --k8s-auth is deprecated and setting it has no effect
W0503 10:54:07.530765       1 authoptions.go:265] running with AUTHENTICATION DISABLED -- for development use only!
I0503 10:54:07.532188       1 server.go:544] The following console endpoints are now proxied to these services:
I0503 10:54:07.532219       1 server.go:547]  - /api/proxy/plugin/forklift-console-plugin/forklift-inventory/ -> https://forklift-inventory.konveyor-forklift.svc.cluster.local:8443
I0503 10:54:07.532260       1 server.go:547]  - /api/proxy/plugin/forklift-console-plugin/must-gather-api/ -> https://must-gather-api.konveyor-forklift.svc.cluster.local:8443
I0503 10:54:07.532424       1 main.go:650] Binding to 0.0.0.0:9000...
I0503 10:54:07.532445       1 main.go:655] not using TLS
I0503 10:54:08.747012       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/api/v1/namespaces/kubevirt-hyperconverged/pods?watch=true&fieldSelector=metadata.name%3Daaq-operator-74d8bb6cf6-gdmvl
E0503 10:54:08.761351       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
I0503 10:54:08.792734       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/apis/cdi.kubevirt.io/v1beta1/cdiconfigs?watch=true&fieldSelector=metadata.name%3Dconfig
I0503 10:54:10.532511       1 metrics.go:133] serverconfig.Metrics: Update ConsolePlugin metrics...
E0503 10:54:10.538708       1 metrics.go:138] serverconfig.Metrics: Failed to get all installed ConsolePlugins: the server could not find the requested resource
I0503 10:54:10.538724       1 metrics.go:143] serverconfig.Metrics: Update ConsolePlugin metrics: &map[forklift:map[notfound:1] kubevirt:map[notfound:1] monitoring:map[notfound:1] netobserv:map[notfound:1]] (took 6.18586ms)
I0503 10:54:12.533225       1 metrics.go:80] usage.Metrics: Count console users...
I0503 10:54:12.537385       1 metrics.go:156] usage.Metrics: Update console users metrics: 0 kubeadmin, 0 cluster-admins, 0 developers, 0 unknown/errors (took 4.085526ms)
I0503 10:54:22.770499       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/api/v1/namespaces?watch=true&resourceVersion=325301
I0503 10:54:22.801629       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/apis/discovery.k8s.io/v1/namespaces/kubevirt-hyperconverged/endpointslices?watch=true&resourceVersion=325301
I0503 10:54:22.827450       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/apis/policy/v1/namespaces/kubevirt-hyperconverged/poddisruptionbudgets?watch=true&resourceVersion=325301
I0503 10:54:24.527563       1 proxy.go:251] CheckOrigin: Proxy has no configured Origin. Allowing origin [http://192.168.0.126:31090] to wss://kubernetes.default/apis/apiextensions.k8s.io/v1/customresourcedefinitions?watch=true&resourceVersion=325301
E0503 10:55:08.797550       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 10:56:08.983457       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 10:57:08.731337       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 11:06:05.709636       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
E0503 11:06:10.772135       1 handlers.go:141] failed to parse "=http://netobserv-plugin.netobserv.svc:9001" endpoint for "netobserv-plugin" plugin
I0503 11:06:11.219985

Note: I am running on Vanila K8s (RKE2 + Cilium + HCO + OKD Console)

[jotak]

oh, I didn't noticed that you are running the OKD Console - sorry, I read too fast.
In that case you should install netobserv without the helm flag --set standaloneConsole.enable=true
because that's only when you don't want the integration with the openshift/okd console.

You may need also to remove the TEST_CONSOLE part of the FlowCollector config, this:

    advanced:
      env:
        TEST_CONSOLE: "true"

Note that I'm still not 100% sure that's going to work, even with these changes: I don't think anyone has tested that console plugin integration before, without running on openshift. There might be some tweaks to do in the operator code, but it's worth trying.

[jotak]

Beside that, you said you run on Cilium, which as far as I know will also cause you troubles because I think cilium blocks the injection of our eBPF programs.
Can you check if you see any error in the ebpf agent pods logs? (by default they're in the namespace netobserv-privileged)

[cloudcafetech]

If I did (without the helm flag --set standaloneConsole.enable=true & flowcollector env part) then plugins pod NOT spin up

if I use above then I can see GUI.

root@esxi-ubuntu:~# oc get po -n netobserv-privileged
NAME                         READY   STATUS    RESTARTS        AGE
netobserv-ebpf-agent-chfbc   1/1     Running   0               9d
netobserv-ebpf-agent-mxdz8   1/1     Running   1 (7d22h ago)   9d

root@esxi-ubuntu:~# oc logs -f netobserv-ebpf-agent-chfbc -n netobserv-privileged
time="2025-05-06T03:30:25Z" level=info msg="starting NetObserv eBPF Agent [build version: v1.8.2-community-c3ddb88, build date: 2025-03-20 11:21]"
time="2025-05-06T03:30:25Z" level=info msg="initializing Flows agent" component=agent.Flows
time="2025-05-06T03:30:26Z" level=info msg="StartServerAsync: addr = :9400" component=prometheus
time="2025-05-06T03:30:26Z" level=info msg="push CTRL+C or send SIGTERM to interrupt execution"
time="2025-05-06T03:30:26Z" level=info msg="starting Flows agent" component=agent.Flows
time="2025-05-06T03:30:26Z" level=warning msg="can't detect any network-namespaces err: open /var/run/netns: no such file or directory [Ignore if the agent privileged flag is not set]" component=ifaces.Watcher
time="2025-05-06T03:30:26Z" level=warning msg="failed to add watcher to netns directory err: no such file or directory [Ignore if the agent privileged flag is not set]" component=ifaces.Watcher
time="2025-05-06T03:30:26Z" level=info msg="Flows agent successfully started" component=agent.Flows
time="2025-05-06T03:30:26Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{eno2 2 NS(none)}"
time="2025-05-06T03:30:26Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{wlo1 3 NS(none)}"
time="2025-05-06T03:30:26Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{cilium_net 4 NS(none)}"


 oc logs -f netobserv-ebpf-agent-mxdz8 -n netobserv-privileged
time="2025-05-07T14:44:40Z" level=info msg="starting NetObserv eBPF Agent [build version: v1.8.2-community-c3ddb88, build date: 2025-03-20 11:21]"
time="2025-05-07T14:44:40Z" level=info msg="initializing Flows agent" component=agent.Flows
time="2025-05-07T14:44:41Z" level=info msg="StartServerAsync: addr = :9400" component=prometheus
time="2025-05-07T14:44:41Z" level=info msg="push CTRL+C or send SIGTERM to interrupt execution"
time="2025-05-07T14:44:41Z" level=info msg="starting Flows agent" component=agent.Flows
time="2025-05-07T14:44:41Z" level=warning msg="can't detect any network-namespaces err: open /var/run/netns: no such file or directory [Ignore if the agent privileged flag is not set]" component=ifaces.Watcher
time="2025-05-07T14:44:41Z" level=warning msg="failed to add watcher to netns directory err: no such file or directory [Ignore if the agent privileged flag is not set]" component=ifaces.Watcher
time="2025-05-07T14:44:41Z" level=info msg="Flows agent successfully started" component=agent.Flows
time="2025-05-07T14:44:41Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{ens192 2 NS(none)}"
time="2025-05-07T14:44:46Z" level=error msg="couldn't send flow records to collector" collector="192.168.0.126:2055" component=exporter/GRPCProto error="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 192.168.0.126:2055: connect: connection refused\""
time="2025-05-07T14:44:49Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{cilium_net 3 NS(none)}"
time="2025-05-07T14:44:49Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{cilium_host 4 NS(none)}"
time="2025-05-07T14:44:50Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{lxc_health 7 NS(none)}"
time="2025-05-07T14:44:51Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{lxca24005cc9721 9 NS(none)}"
time="2025-05-07T14:44:51Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{lxcb7a728cd4886 11 NS(none)}"
time="2025-05-07T14:44:51Z" level=error msg="couldn't send flow records to collector" collector="192.168.0.126:2055" component=exporter/GRPCProto error="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 192.168.0.126:2055: connect: connection refused\""
time="2025-05-07T14:44:55Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{lxc0cff9e0222f5 13 NS(none)}"
time="2025-05-07T14:44:55Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{lxcec5b20ec0cf5 15 NS(none)}"
time="2025-05-07T14:44:56Z" level=error msg="couldn't send flow records to collector" collector="192.168.0.126:2055" component=exporter/GRPCProto error="rpc error: code = Unavailable desc = connection error: desc = \"transport: Error while dialing: dial tcp 192.168.0.126:2055: connect: connection refused\""
time="2025-05-07T14:44:56Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{lxced32a16b15ee 19 NS(none)}"
time="2025-05-07T14:44:56Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{lxc689399c23c50 17 NS(none)}"
time="2025-05-07T14:44:57Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{lxc2e37fb98c7f8 23 NS(none)}"
time="2025-05-07T14:44:57Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{lxc98e15a2a3032 25 NS(none)}"
time="2025-05-07T14:44:57Z" level=info msg="interface detected. trying to attach TCX hook" component=agent.Flows interface="{lxc451fcbeea729 21 NS(none)}"