Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pod ip in edge node still be docker ip not configured CIDR ip #566

Open
LiShuang-codes opened this issue Jun 17, 2024 · 0 comments
Open

pod ip in edge node still be docker ip not configured CIDR ip #566

LiShuang-codes opened this issue Jun 17, 2024 · 0 comments
Labels
kind/bug Categorizes issue or PR as related to a bug.

Comments

@LiShuang-codes
Copy link

What happened:
pod ip in edge node still be docker ip not configured CIDR ip. for example:

root@master:~# kubectl describe pod lm-mpi-job-mpiworker-0
Name:         lm-mpi-job-mpiworker-0
...
Status:       Running
IP:           128.128.0.5
IPs:
  IP:           128.128.0.5
Controlled By:  Job/lm-mpi-job
...

What you expected to happen:
It's ip should be 10.x.x.x(In UNIFIED controlled cidr ip)
How to reproduce it (as minimally and precisely as possible):
deploy any pod after configure edgemesh
Anything else we need to know?:
if i configure edgemesh wrongly?
Environment:

  • EdgeMesh version: 1.17(newest)

  • Kubernetes version (use kubectl version):1.23.17

  • KubeEdge version(e.g. cloudcore --version and edgecore --version):1.13.0

  • Cloud nodes Environment:
    • Hardware configuration (e.g. lscpu):amd64 in cloud
    • OS (e.g. cat /etc/os-release):ubuntu22.04.3 in edge
    • Kernel (e.g. uname -a):6.5.0-35-generic in cloud,
    • Go version (e.g. go version): 1.22
    • Others:temprarory nothing
  • Edge nodes Environment:
    • edgecore version (e.g. edgecore --version):.1.13.0
    • Hardware configuration (e.g. lscpu): arm64 in edges
    • OS (e.g. cat /etc/os-release):, kylin os in edges
    • Kernel (e.g. uname -a):5.4.18-53-generic in egdes
    • Go version (e.g. go version):1.22
    • Others:temprarory nothing

** Detail

Document for edgemesh： https://edgemesh.netlify.app/

This document lacks a lot of new featues such as edge cni. I still cannot use the feature even if i use edgemesh-1.17. Pod in edge node still be allocated with docker ip rather than unified cidr. The configuration file as follow:

modules:
  edgeProxy:
    enable: true
  edgeTunnel:
    enable: true
  edgeCNI:
    enable: true
    meshCIDRConfig:
      cloudCIDR:
        - 10.244.1.0/24
        - 10.244.1.0/24
      edgeCIDR:
        - 10.244.5.0/24
        - 10.244.6.0/24

The part of the log of the agent in master:

 I0617 10:26:25.158475       1 server.go:58] Version: v1.17.0-dirty

 I0617 10:26:25.158585       1 server.go:94] [1] Prepare agent to run

 I0617 10:26:25.158921       1 netif.go:96] bridge device edgemesh0 already exists

 I0617 10:26:25.159102       1 server.go:98] edgemesh-agent running on CloudMode

 I0617 10:26:25.159130       1 server.go:101] [2] New clients

 W0617 10:26:25.159198       1 client_config.go:617] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.

 I0617 10:26:25.160309       1 server.go:108] [3] Register beehive modules

 W0617 10:26:25.160373       1 module.go:55] Module EdgeDNS is disabled, do not register

 I0617 10:26:25.161848       1 server.go:68] Using userspace Proxier.

 I0617 10:26:25.270569       1 module.go:52] Module EdgeProxy registered successfully

 I0617 10:26:25.273278       1 util.go:273] Listening to docker0 is meaningless, skip it.

 I0617 10:26:25.273378       1 util.go:273] Listening to kube-ipvs0 is meaningless, skip it.

 I0617 10:26:25.274635       1 util.go:273] Listening to tunl0 is meaningless, skip it.

 I0617 10:26:25.274847       1 util.go:273] Listening to edgemesh0 is meaningless, skip it.

 I0617 10:26:25.275068       1 module.go:128] Configure libp2p.ForceReachabilityPrivate()

 I0617 10:26:25.307746       1 module.go:189] I'm {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/169.254.25.10/tcp/20006 /ip4/192.168.137.195/tcp/20006]}

 I0617 10:26:25.307790       1 module.go:211] Bootstrapping the DHT

 I0617 10:26:25.313975       1 tunnel.go:85] Starting MDNS discovery service

 I0617 10:26:25.314021       1 tunnel.go:98] Starting DHT discovery service

 I0617 10:26:25.314208       1 module.go:52] Module EdgeTunnel registered successfully

 I0617 10:26:25.314303       1 adapter.go:53] the cloud CIDRs are [10.244.1.0/24 10.244.1.0/24], the edge CIDRs are [10.244.5.0/24 10.244.6.0/24]

 I0617 10:26:25.314656       1 tunnel.go:496] Starting relay finder

 I0617 10:26:25.321820       1 adapter.go:59] local CIDR is 10.233.64.0/24

 I0617 10:26:25.355874       1 tun.go:66] create TunInterface edge_tun0 successfully

 I0617 10:26:25.360473       1 tun.go:74] set dev edge_tun0 up successfully

 I0617 10:26:25.360551       1 tun.go:96] Tun Interface Name: edge_tun0

 I0617 10:26:25.361765       1 tun.go:114] set dev edge_tun0 up succeed

 I0617 10:26:25.404231       1 tunnel.go:210] Discovery service got a new stream from {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/192.168.137.233/tcp/20006]}

 I0617 10:26:25.404459       1 tunnel.go:239] [MDNS] Discovery from node01 : {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/192.168.137.233/tcp/20006]}

 I0617 10:26:25.405589       1 tun.go:141] ip route add table main 10.244.5.0/24 dev edge_tun0 succeed

 I0617 10:26:25.408689       1 tun.go:141] ip route add table main 10.244.6.0/24 dev edge_tun0 succeed

 I0617 10:26:25.411445       1 tun.go:141] ip route add table main 10.244.1.0/24 dev edge_tun0 succeed

 E0617 10:26:25.414057       1 tun.go:123] failed to execute Command ip route add 10.244.1.0/24 dev edge_tun0 , err: %!(EXTRA *exec.ExitError=exit status 2)

 E0617 10:26:25.414095       1 adapter.go:160] failed to add route to TunDev, error: failed to exec 'ip route add 10.244.1.0/24 dev edge_tun0', error: exit status 2

 E0617 10:26:25.415362       1 module.go:75] add route to table failed%!(EXTRA *errors.errorString=failed to insert iptable rule, error: error checking rule: exit status 2: Bad argument `1'

 Try `iptables -h' or 'iptables --help' for more information.

 )

 I0617 10:26:25.415397       1 module.go:52] Module EdgeCNI registered successfully

 I0617 10:26:25.415406       1 server.go:114] [4] Cache beehive modules

 I0617 10:26:25.415422       1 server.go:121] [5] Start all modules

 I0617 10:26:25.415489       1 core.go:46] starting module EdgeTunnel

 I0617 10:26:25.415530       1 core.go:46] starting module EdgeCNI

 I0617 10:26:25.415604       1 core.go:46] starting module EdgeProxy

 I0617 10:26:25.415790       1 adapter.go:144] [CNI] Start Meshadapter

 E0617 10:26:25.415876       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 I0617 10:26:25.416183       1 config.go:135] "Starting endpoints config controller"

 I0617 10:26:25.416219       1 shared_informer.go:240] Waiting for caches to sync for endpoints config

 I0617 10:26:25.416261       1 config.go:317] "Starting service config controller"

 I0617 10:26:25.416279       1 shared_informer.go:240] Waiting for caches to sync for service config

 I0617 10:26:25.416346       1 loadbalancer.go:348] "Starting loadBalancer destinationRule controller"

 I0617 10:26:25.416473       1 shared_informer.go:240] Waiting for caches to sync for loadBalancer destinationRule

 I0617 10:26:25.416433       1 tunnel.go:712] not relay, skip metrics server!

 I0617 10:26:25.416405       1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.233/tcp/20006]}

 I0617 10:26:25.416603       1 tunnel.go:161] [MDNS] New stream between peer {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.233/tcp/20006]} success

 I0617 10:26:25.417729       1 tunnel.go:197] [MDNS] Discovery to node01 : {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.233/tcp/20006]}

 I0617 10:26:25.517325       1 shared_informer.go:247] Caches are synced for service config 

 I0617 10:26:25.517358       1 shared_informer.go:247] Caches are synced for endpoints config 

 I0617 10:26:25.517343       1 shared_informer.go:247] Caches are synced for loadBalancer destinationRule 

 I0617 10:26:25.589011       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849

 I0617 10:26:25.596117       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849

 I0617 10:26:25.608441       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849

 I0617 10:26:25.619796       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000

 I0617 10:26:25.623746       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000

 I0617 10:26:25.635863       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000

 I0617 10:26:25.647697       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001

 I0617 10:26:25.652135       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001

 I0617 10:26:25.663854       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001

 I0617 10:26:25.677279       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002

 I0617 10:26:25.681451       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002

 I0617 10:26:25.704627       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002

 I0617 10:26:25.718520       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003

 I0617 10:26:25.722634       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003

 I0617 10:26:25.735115       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003

 I0617 10:26:25.754455       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004

 I0617 10:26:25.760370       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004

 I0617 10:26:25.773220       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004

 I0617 10:26:25.804061       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880

 I0617 10:26:25.808239       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880

 I0617 10:26:25.821943       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880

 I0617 10:26:25.835632       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848

 I0617 10:26:25.839695       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848

 I0617 10:26:25.851953       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848

 I0617 10:26:26.599322       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:26.600321       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:27.614091       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:27.614291       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:27.615129       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:27.617740       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:27.645470       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:27.646380       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:28.752594       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:28.753440       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 E0617 10:26:29.680198       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 I0617 10:26:30.120302       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:30.121078       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:30.121707       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:30.123084       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:30.732659       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:30.732991       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:30.733919       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:30.734511       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:30.744101       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:30.744968       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:30.773204       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:30.774210       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:30.775421       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:30.776314       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:30.787717       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:30.788862       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:30.799773       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:30.800767       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:30.806618       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:30.807635       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:31.173672       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:31.174553       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:31.312237       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:31.313220       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:32.785320       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:32.786207       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:32.799101       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:32.800080       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:35.005246       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:35.007250       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:36.051004       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:26:36.052168       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 I0617 10:26:36.065991       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

 E0617 10:26:38.387939       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 I0617 10:26:55.054061       1 loadbalancer.go:954] Dial legacy network between cloudcore-6d994c976f-nfpz2 - {tcp master 10.233.70.146:10000}

 E0617 10:26:57.840160       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 I0617 10:27:10.579913       1 loadbalancer.go:954] Dial legacy network between ks-console-6f5875968d-r6x6d - {tcp master 10.233.70.107:8000}

 I0617 10:27:10.581435       1 loadbalancer.go:954] Dial legacy network between ks-apiserver-78d77f98d7-trsqt - {tcp master 10.233.70.109:9090}

in edge node 01:

 I0617 10:26:24.021357       1 server.go:58] Version: v1.17.0-dirty

 I0617 10:26:24.021432       1 server.go:94] [1] Prepare agent to run

 I0617 10:26:24.022492       1 netif.go:96] bridge device edgemesh0 already exists

 I0617 10:26:24.022603       1 server.go:98] edgemesh-agent running on EdgeMode

 I0617 10:26:24.022620       1 server.go:101] [2] New clients

 I0617 10:26:24.024116       1 server.go:108] [3] Register beehive modules

 I0617 10:26:24.024941       1 module.go:52] Module EdgeDNS registered successfully

 I0617 10:26:24.025367       1 server.go:68] Using userspace Proxier.

 I0617 10:26:24.073602       1 module.go:52] Module EdgeProxy registered successfully

 I0617 10:26:24.081434       1 util.go:273] Listening to docker0 is meaningless, skip it.

 I0617 10:26:24.081516       1 util.go:273] Listening to edgemesh0 is meaningless, skip it.

 I0617 10:26:24.081529       1 util.go:273] Listening to kube-ipvs0 is meaningless, skip it.

 I0617 10:26:24.081618       1 module.go:128] Configure libp2p.ForceReachabilityPrivate()

 I0617 10:26:24.098860       1 module.go:189] I'm {12D3KooWDsT8fSJMMZ5qZs2zFGtWQ2hhGL69DgWFLTqhXuX7qavd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.233/tcp/20006]}

 I0617 10:26:24.098938       1 module.go:211] Bootstrapping the DHT

 I0617 10:26:24.100225       1 tunnel.go:85] Starting MDNS discovery service

 I0617 10:26:24.100253       1 tunnel.go:98] Starting DHT discovery service

 I0617 10:26:24.100401       1 module.go:52] Module EdgeTunnel registered successfully

 I0617 10:26:24.100434       1 adapter.go:53] the cloud CIDRs are [10.244.1.0/24 10.244.1.0/24], the edge CIDRs are [10.244.5.0/24 10.244.6.0/24]

 I0617 10:26:24.100472       1 tunnel.go:496] Starting relay finder

 I0617 10:26:24.160319       1 adapter.go:59] local CIDR is 10.233.65.0/24

 I0617 10:26:24.161854       1 tun.go:66] create TunInterface edge_tun0 successfully

 I0617 10:26:24.164917       1 tun.go:74] set dev edge_tun0 up successfully

 I0617 10:26:24.164959       1 tun.go:96] Tun Interface Name: edge_tun0

 I0617 10:26:24.165318       1 tunnel.go:210] Discovery service got a new stream from {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/192.168.137.195/tcp/20006]}

 I0617 10:26:24.165558       1 tunnel.go:239] [MDNS] Discovery from master : {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/192.168.137.195/tcp/20006]}

 I0617 10:26:24.166654       1 tun.go:114] set dev edge_tun0 up succeed

 I0617 10:26:24.168938       1 tun.go:141] ip route add table main 10.244.5.0/24 dev edge_tun0 succeed

 I0617 10:26:24.170655       1 tun.go:141] ip route add table main 10.244.6.0/24 dev edge_tun0 succeed

 I0617 10:26:24.172305       1 tun.go:141] ip route add table main 10.244.1.0/24 dev edge_tun0 succeed

 E0617 10:26:24.173916       1 tun.go:123] failed to execute Command ip route add 10.244.1.0/24 dev edge_tun0 , err: %!(EXTRA *exec.ExitError=exit status 2)

 E0617 10:26:24.173965       1 adapter.go:160] failed to add route to TunDev, error: failed to exec 'ip route add 10.244.1.0/24 dev edge_tun0', error: exit status 2

 E0617 10:26:24.175009       1 module.go:75] add route to table failed%!(EXTRA *errors.errorString=failed to insert iptable rule, error: error checking rule: exit status 2: Bad argument `1'

 Try `iptables -h' or 'iptables --help' for more information.

 )

 I0617 10:26:24.175040       1 module.go:52] Module EdgeCNI registered successfully

 I0617 10:26:24.175053       1 server.go:114] [4] Cache beehive modules

 I0617 10:26:24.175094       1 server.go:121] [5] Start all modules

 I0617 10:26:24.175210       1 core.go:46] starting module EdgeDNS

 I0617 10:26:24.175264       1 core.go:46] starting module EdgeProxy

 I0617 10:26:24.175314       1 core.go:46] starting module EdgeTunnel

 I0617 10:26:24.175365       1 core.go:46] starting module EdgeCNI

 I0617 10:26:24.175366       1 dns.go:37] Runs CoreDNS v1.8.0 as a local dns

 I0617 10:26:24.175837       1 adapter.go:144] [CNI] Start Meshadapter

 I0617 10:26:24.176049       1 config.go:317] "Starting service config controller"

 I0617 10:26:24.176084       1 shared_informer.go:240] Waiting for caches to sync for service config

 I0617 10:26:24.176118       1 config.go:135] "Starting endpoints config controller"

 I0617 10:26:24.176129       1 shared_informer.go:240] Waiting for caches to sync for endpoints config

 I0617 10:26:24.177435       1 loadbalancer.go:348] "Starting loadBalancer destinationRule controller"

 I0617 10:26:24.177457       1 shared_informer.go:240] Waiting for caches to sync for loadBalancer destinationRule

 I0617 10:26:24.177977       1 tunnel.go:712] not relay, skip metrics server!

 I0617 10:26:24.178010       1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]}

 I0617 10:26:24.178177       1 tunnel.go:161] [MDNS] New stream between peer {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]} success

 E0617 10:26:24.178217       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 I0617 10:26:24.179412       1 tunnel.go:197] [MDNS] Discovery to master : {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]}

 I0617 10:26:24.277133       1 shared_informer.go:247] Caches are synced for endpoints config 

 I0617 10:26:24.277150       1 shared_informer.go:247] Caches are synced for service config 

 .:53 on 169.254.96.16

 I0617 10:26:24.277518       1 shared_informer.go:247] Caches are synced for loadBalancer destinationRule 

 I0617 10:26:24.277728       1 log.go:198] [INFO] plugin/reload: Running configuration MD5 = 4ba233d14e39c5d57b4b7aa950136711

 I0617 10:26:24.291712       1 log.go:198] [INFO] 169.254.96.16:60393 - 44074 "HINFO IN 1693435269672312865.2136678649374743405. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.014065669s

 I0617 10:26:24.324401       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849

 I0617 10:26:24.327502       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849

 I0617 10:26:24.330986       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="default/fpga-frontend-service" protocol=TCP nodePort=30849

 I0617 10:26:24.360909       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880

 I0617 10:26:24.364458       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880

 I0617 10:26:24.367915       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubesphere-system/ks-console:nginx" protocol=TCP nodePort=30880

 I0617 10:26:24.417895       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848

 I0617 10:26:24.421397       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848

 I0617 10:26:24.424812       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="default/nodeip-service" protocol=TCP nodePort=30848

 I0617 10:26:24.434827       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000

 I0617 10:26:24.438082       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000

 I0617 10:26:24.441456       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub" protocol=TCP nodePort=30000

 I0617 10:26:24.461238       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001

 I0617 10:26:24.464710       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001

 I0617 10:26:24.468105       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub-quic" protocol=TCP nodePort=30001

 I0617 10:26:24.478220       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002

 I0617 10:26:24.481694       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002

 I0617 10:26:24.485253       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudhub-https" protocol=TCP nodePort=30002

 I0617 10:26:24.495239       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003

 I0617 10:26:24.498653       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003

 I0617 10:26:24.502005       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:cloudstream" protocol=TCP nodePort=30003

 I0617 10:26:24.536873       1 proxier.go:895] "Opened iptables from-containers public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004

 I0617 10:26:24.540463       1 proxier.go:906] "Opened iptables from-host public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004

 I0617 10:26:24.543925       1 proxier.go:916] "Opened iptables from-non-local public port for service" servicePortName="kubeedge/cloudcore:tunnelport" protocol=TCP nodePort=30004

 I0617 10:26:25.358720       1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]}

 I0617 10:26:25.371815       1 tunnel.go:161] [MDNS] New stream between peer {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]} success

 I0617 10:26:25.412857       1 tunnel.go:197] [MDNS] Discovery to master : {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.195/tcp/20006 /ip4/169.254.25.10/tcp/20006]}

 I0617 10:26:25.425210       1 tunnel.go:210] Discovery service got a new stream from {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/192.168.137.195/tcp/20006]}

 I0617 10:26:25.425348       1 tunnel.go:239] [MDNS] Discovery from master : {12D3KooWNRVRy1v8Lqb5nGYsVZnyDj5x6q8dsPA8eLofzaGPH9Yd: [/ip4/192.168.137.195/tcp/20006]}

 E0617 10:26:28.509315       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 E0617 10:26:36.957306       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 E0617 10:26:54.365297       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 E0617 10:27:27.133304       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 E0617 10:28:32.669320       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 E0617 10:30:39.645321       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 E0617 10:35:07.933317       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 I0617 10:40:12.415019       1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006]}

 E0617 10:40:12.464768       1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:

   * [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127

   * [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

   * [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

 I0617 10:40:53.384170       1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006]}

 E0617 10:40:53.417145       1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:

   * [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78

   * [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127

   * [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73

   * [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

   * [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

 I0617 10:43:09.481421       1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006]}

 E0617 10:43:09.567542       1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:

   * [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78

   * [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73

   * [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127

   * [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: error reading handshake message: EOF

   * [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: error reading handshake message: EOF

 E0617 10:44:08.605316       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)

 I0617 10:45:54.449145       1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006]}

 E0617 10:45:54.478894       1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:

   * [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127

   * [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78

   * [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73

   * [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

   * [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

 I0617 10:50:59.480129       1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006]}

 E0617 10:50:59.555950       1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:

   * [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73

   * [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127

   * [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78

   * [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

   * [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

 I0617 10:56:01.357609       1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006]}

 E0617 10:56:01.379468       1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006 /ip4/169.254.168.73/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:

   * [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127

   * [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73

   * [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78

   * [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

   * [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

 I0617 11:01:04.496078       1 tunnel.go:131] [MDNS] Discovery found peer: {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006]}

 E0617 11:01:04.579095       1 tunnel.go:146] [MDNS] Failed to connect to {12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8: [/ip4/169.254.168.73/tcp/20006 /ip4/127.0.0.1/tcp/20006 /ip4/192.168.137.225/tcp/20006 /ip4/192.168.137.29/tcp/20006 /ip4/169.254.154.127/tcp/20006 /ip4/169.254.66.78/tcp/20006]}, err: failed to dial 12D3KooWRLQZueiPgkRNm8DMpc5rGhjKLHymbjEbCTtmRRhjUwf8:

   * [/ip4/169.254.168.73/tcp/20006] undialable IP: 169.254.168.73

   * [/ip4/169.254.154.127/tcp/20006] undialable IP: 169.254.154.127

   * [/ip4/169.254.66.78/tcp/20006] undialable IP: 169.254.66.78

   * [/ip4/192.168.137.225/tcp/20006] failed to negotiate security protocol: error reading handshake message: read tcp4 192.168.137.233:20006->192.168.137.225:20006: read: connection reset by peer

   * [/ip4/192.168.137.29/tcp/20006] failed to negotiate security protocol: privnet: could not read full nonce

 E0617 11:01:53.565326       1 tun.go:240] Parse frame failed:%!(EXTRA *errors.errorString=header len is small than �)
@LiShuang-codes LiShuang-codes added the kind/bug Categorizes issue or PR as related to a bug. label Jun 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/bug Categorizes issue or PR as related to a bug.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@LiShuang-codes