Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Random failures in Pod Controller unit test #1294

Open
1 of 5 tasks
MondayCha opened this issue Dec 31, 2024 · 1 comment
Open
1 of 5 tasks

Random failures in Pod Controller unit test #1294

MondayCha opened this issue Dec 31, 2024 · 1 comment
Labels
kind/bug Categorizes issue or PR as related to a bug.

Comments

@MondayCha
Copy link
Contributor

MondayCha commented Dec 31, 2024 •
edited
Loading

How to use it?

  • kwok
  • kwokctl --runtime=docker (default runtime)
  • kwokctl --runtime=binary
  • kwokctl --runtime=nerdctl
  • kwokctl --runtime=kind

What happened?

A few days ago, when I submitted a new commit to the KWOK project, I noticed my PR failed to pass unit tests intermittently.

The test TestPodController occasionally fails with the following error:

--- FAIL: TestPodController (7.00s)
pod_controller_test.go:322: want pod pod-with-node1 hostIP=172.0.0.1, got 10.0.0.1

Although PR #918 attempted to address stability issues related to TestPodController, the problem still persists.

This instability in the unit test makes it difficult to merge PRs and maintain code quality, as the CI pipeline may fail due to these random test failures rather than actual code issues.

What did you expect to happen?

The test should consistently pass with the expected hostIP value of 172.0.0.1 for the pod "pod-with-node1".

How can we reproduce it (as minimally and precisely as possible)?

  1. Clone the KWOK repository.
  2. Run the following command:
go test -run ^TestPodController$ sigs.k8s.io/kwok/pkg/kwok/controllers -count=1000 -timeout=4h -failfast -parallel 1 > log.txt
  1. Wait for some time until the test fails.
  2. Check the log.txt file for the failure details. The unit test TestPodController occasionally fails with the following error:
{"time":"2024-12-31T17:28:03.532719+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:03.534713+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:03.534786+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-host-network","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:03.534856+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:03.534918+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:03.535102+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:03.53517+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod0","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:04.533084+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:04.533408+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:05.532921+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:05.534144+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:06.533636+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:06.533725+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:07.539191+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:07.539892+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:07.540315+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:07.54064+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:07.540795+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-host-network","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:07.541032+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:07.541339+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod0","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:08.541153+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:08.541466+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:09.540052+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:09.54041+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:10.542068+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:10.542255+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:11.546135+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:11.548105+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:11.549365+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-host-network","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:11.54988+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:11.550041+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:11.550141+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:11.550303+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod0","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:12.54701+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:12.547186+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:13.547898+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:13.548408+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:14.549057+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:14.549139+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:15.552297+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:15.552465+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:15.552497+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:15.552732+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-host-network","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:15.552841+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:15.553288+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:15.553462+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod0","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:16.554837+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:16.555319+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:17.553428+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:17.553729+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:18.554728+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:18.554786+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:19.555891+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:19.556584+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:19.556817+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-host-network","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:19.556831+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:19.556912+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:19.557006+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:19.557064+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod0","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:20.557922+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:20.558223+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:21.557146+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:21.557377+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:22.559236+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:22.559631+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:23.561287+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:23.561898+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:23.562573+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:23.562748+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:23.562889+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-host-network","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:23.563008+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:23.563094+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod0","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:24.561282+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:24.561371+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:25.562169+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:25.562716+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:26.562871+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:26.563024+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:27.568365+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:27.568833+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:27.56942+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-host-network","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:27.56951+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:27.569673+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:27.570012+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:27.57012+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod0","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:28.567816+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:28.568012+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:29.568183+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:29.568762+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:30.569847+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:30.570003+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:31.572559+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:31.572741+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:31.5728+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:31.57292+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:31.573011+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-host-network","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:31.573171+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:31.573287+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod0","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:32.57321+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:32.573626+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:33.574915+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:33.576844+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:34.575482+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:34.575693+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:35.581711+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:35.581849+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:35.582811+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:35.584581+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:35.584675+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:36.581259+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:36.581508+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:37.583697+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:37.583938+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:38.58465+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:38.584743+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:39.594239+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:39.595669+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:39.595917+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:39.596424+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:39.596525+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-host-network","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:39.596561+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:39.596692+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod0","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:40.598623+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:40.59875+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:41.598571+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:41.599861+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:42.598878+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:42.598914+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:43.603285+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:43.603336+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:43.605081+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:43.605566+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:43.605695+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod-with-node1","node":"node1","reason":"not match any stages"}
{"time":"2024-12-31T17:28:44.602455+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:44.602601+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:45.602468+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:45.603041+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:46.602631+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:46.602649+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:47.606396+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:47.606924+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:47.60695+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:47.607482+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:47.607562+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod0","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:48.608732+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:48.608886+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:49.609155+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"MODIFIED","pod":"default/pod1","node":"node0"}
{"time":"2024-12-31T17:28:49.609365+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).deleteResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":171},"msg":"Delete pod","pod":"default/pod0","node":"node0"}
{"time":"2024-12-31T17:28:50.6097+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:50.609742+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
{"time":"2024-12-31T17:28:51.615842+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-host-network","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:51.616316+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod-with-node1","node":"node1","subresource":"status"}
{"time":"2024-12-31T17:28:51.616439+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod0","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:51.616459+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":440},"msg":"Skip pod","reason":"not managed","event":"SYNC","pod":"default/xxxx","node":"xxxx"}
{"time":"2024-12-31T17:28:52.616009+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).patchResource","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":388},"msg":"Patch pod","pod":"default/pod1","node":"node0","subresource":"status"}
{"time":"2024-12-31T17:28:52.616813+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocess","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":227},"msg":"Skip pod","pod":"default/pod1","node":"node0","reason":"not match any stages"}
{"time":"2024-12-31T17:28:57.615728+08:00","level":"DEBUG","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).preprocessWorker","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":181},"msg":"Stop preprocess worker"}
{"time":"2024-12-31T17:28:57.615771+08:00","level":"INFO","source":{"function":"sigs.k8s.io/kwok/pkg/kwok/controllers.(*PodController).watchResources","file":"/Users/liyilong1/github/kwok/pkg/kwok/controllers/pod_controller.go","line":477},"msg":"Stop watch pods"}
--- FAIL: TestPodController (7.00s)
    pod_controller_test.go:322: want pod pod-with-node1 hostIP=172.0.0.1, got 10.0.0.1
FAIL
FAIL	sigs.k8s.io/kwok/pkg/kwok/controllers	55.720s
FAIL

The test case fails randomly when running multiple iterations, indicating potential race conditions or inconsistent behavior in the Pod Controller implementation.

Anything else we need to know?

  • The issue appears to be non-deterministic

Kwok version

$ kwok --version
0.6.1

OS version

# On Darwin:
$ uname -a
Darwin PYW2GQ44WV 23.6.0 Darwin Kernel Version 23.6.0: Wed Jul 31 20:49:39 PDT 2024; root:xnu-10063.141.1.700.5~1/RELEASE_ARM64_T6000 arm64
@MondayCha MondayCha added the kind/bug Categorizes issue or PR as related to a bug. label Dec 31, 2024
@wzshiming
Copy link
Member

I thought this was because the controller did not fully initialize the Stage before it started handling events.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/bug Categorizes issue or PR as related to a bug.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@wzshiming @MondayCha