Token controller stops refreshing (RequeueAfter ≤ 0 kills self-requeue); JWTs silently expire

[afuller-crusoe]

Version

1.1.0

Which installation method(s) does this occur on?

Helm / Kubernetes manifests

Describe the bug.

Describe the bug

The Token controller's periodic refresh can silently stop. On the reconcile scheduled at the refresh instant,
Sync() pushes RequeueAfter = refreshTime.Sub(now) where refreshTime = exp − Lifetime/5 — so it is ≤ 0 at
that moment. durationStore uses Less (keeps the minimum, no floor), so Pop returns ≤ 0, and controller-runtime
treats RequeueAfter ≤ 0 as "do not requeue." The reconcile still mints a token and writes the Secret, so the loop
continues only via the Owns(&Secret{}) watch follow-up. When that watch event is coalesced/dropped, nothing
re-enqueues the Token: it is never refreshed again, the JWT expires, and consumers get Protocol authentication error.
It self-recovers only on the ~10h cache resync or an operator restart, so tokens flap.

Introduced by f9d0a98 ("feat(token): ensure Token is refreshed timely", first shipped in v1.1.0), which added
durationStore.Push(key, refreshTime.Sub(now)) and switched the store from Greater to Less. v1.0.1 is unaffected.

Steps/Code to reproduce bug

1. Create a Token with refresh: true (default 15m lifetime).
2. In the token-controller logs, each cycle emits two Finished syncing Token lines — one with no result
   (the mint, RequeueAfter ≤ 0) and one with result.RequeueAfter ≈ +12m (the Owns(Secret) follow-up).
3. Eventually a cycle emits only the no-result reconcile (the follow-up watch event is coalesced). After that there are
   no further Token reconciles until the ~10h resync; the Secret's JWT expires and stops being refreshed.

Expected behavior

A Token with refresh: true never expires. The controller should arm its own next refresh on every reconcile —
compute the requeue from the newly-minted token's exp, and never return RequeueAfter ≤ 0 (floor to a positive
minimum, or set Requeue: true) — removing the dependency on the Owns(Secret) watch.

Environment details (please complete the following information):

• Environment location: Cloud (Kubernetes)
• Install / deployment method: Helm; slurm-operator v1.1.0 (also present on current main and v1.1.1)

Additional context

Relevant code: internal/controller/token/token_sync.go (the refreshTime.Sub(now) push),
internal/controller/token/token_controller.go (res = reconcile.Result{RequeueAfter: durationStore.Pop(req.String())},
no floor), and internal/utils/durationstore (Less, stores ≤0 verbatim, no clamp). The fix is small and local to
the token controller.

Minimum reproducible example

Relevant log output

Additional environment details

Other/Misc.

No response

Code of Conduct

• I agree to follow Slurm Operator's Code of Conduct
• I have searched the open bugs and have found no duplicates for this bug report

[somaz94]

Opened a draft PR for this: #241

It floors the refresh requeue to a positive minimum and arms the next refresh from the freshly-minted token, so the controller no longer relies on the Owns(Secret) watch follow-up. Happy to adjust the approach if you'd prefer setting Requeue: true instead.

[vivian-hafener]

Good afternoon @afuller-crusoe and @somaz94,

I will look into this.

Best,
Vivian Hafener

[vivian-hafener]

Good afternoon @afuller-crusoe,

The provided reproducer is insufficient to reproduce this behavior on my system on main. Could you please provide me a sample Token that results in this behavior?

Could you let me know if this patch resolves it on your end? This should filter out those RequeueAfter<=0 events while retaining most of the current implementation.

diff --git a/internal/controller/token/token_sync.go b/internal/controller/token/token_sync.go
index c74da91d..0f0ca5b1 100644
--- a/internal/controller/token/token_sync.go
+++ b/internal/controller/token/token_sync.go
@@ -89,7 +89,11 @@ func (r *TokenReconciler) Sync(ctx context.Context, req reconcile.Request) error
                                if !expirationTime.IsZero() {
                                        refreshTime = expirationTime.Add(-token.Lifetime() * 1 / 5)
                                        key := objectutils.KeyFunc(token)
-                                       durationStore.Push(key, refreshTime.Sub(now))
+                                       if refreshTime.After(now) {
+                                               durationStore.Push(key, refreshTime.Sub(now))
+                                       } else {
+                                               durationStore.Push(key, 60*time.Second)
+                                       }
                                }
 
                                if now.Before(refreshTime) {

Best,
Vivian Hafener

[afuller-crusoe]

Vivian here is example Token CR. Also included current date (as you can see the issuedAt is out of date) and some logs from restd and ctld

root@cp-52d9fcbe-1:~$ k get tokens.slinky.slurm.net -n slurm -o yaml
apiVersion: v1
items:
- apiVersion: slinky.slurm.net/v1beta1
  kind: Token
  metadata:
    creationTimestamp: "2026-07-17T17:14:18Z"
    generation: 1
    name: my-slurm-cluster-operator-token
    namespace: slurm
    ownerReferences:
    - apiVersion: slurm.crusoe.ai/v1alpha1
      blockOwnerDeletion: true
      controller: true
      kind: SlurmCluster
      name: my-slurm-cluster
      uid: 5719e72b-f99e-4074-a964-3412c14ce60c
    resourceVersion: "14756456"
    uid: 180818ba-0aa9-4c94-a3ec-9032b56d9da2
  spec:
    jwtKeyRef:
      key: jwt_hs256.key
      name: my-slurm-cluster-auth-jwths256
    refresh: true
    username: slurm
  status:
    issuedAt: "2026-07-30T18:28:11Z"
kind: List
metadata:
  resourceVersion: ""

root@cp-52d9fcbe-1:~$ date -u 
Thu Jul 30 22:00:05 UTC 2026

root@cp-52d9fcbe-1:~$ k logs -n slurm slurm-my-slurm-cluster-restapi-894979564-mbhrd --tail 10
[2026-07-30T21:58:09.120] operations_router: [slurm-my-slurm-cluster-restapi-894979564-mbhrd:6820(fd:9)] GET /slurm/v0.0.44/diag/
[2026-07-30T21:58:09.120] rest_auth/jwt: slurm_rest_auth_p_authenticate: [slurm-my-slurm-cluster-restapi-894979564-mbhrd:6820(fd:9)] attempting token authentication pass through
[2026-07-30T21:58:09.148] error: op_handler_diag: [slurm-my-slurm-cluster-restapi-894979564-mbhrd:6820(fd:9)] parser=data_parser/v0.0.44 rc[1007]=Protocol authentication error -> slurm_get_statistics() failed to get slurmctld statistics
[2026-07-30T21:58:09.149] error: wrap_on_data: [slurm-my-slurm-cluster-restapi-894979564-mbhrd:6820(fd:9)] on_data returned rc: Protocol authentication error
[2026-07-30T21:59:09.206] operations_router: [slurm-my-slurm-cluster-restapi-894979564-mbhrd:6820(fd:9)] GET /slurm/v0.0.44/diag/
[2026-07-30T21:59:09.206] rest_auth/jwt: slurm_rest_auth_p_authenticate: [slurm-my-slurm-cluster-restapi-894979564-mbhrd:6820(fd:9)] attempting token authentication pass through
[2026-07-30T21:59:09.236] error: op_handler_diag: [slurm-my-slurm-cluster-restapi-894979564-mbhrd:6820(fd:9)] parser=data_parser/v0.0.44 rc[1007]=Protocol authentication error -> slurm_get_statistics() failed to get slurmctld statistics
[2026-07-30T21:59:09.236] error: wrap_on_data: [slurm-my-slurm-cluster-restapi-894979564-mbhrd:6820(fd:9)] on_data returned rc: Protocol authentication error
[2026-07-30T22:00:09.470] operations_router: [slurm-my-slurm-cluster-restapi-894979564-mbhrd:6820(fd:9)] GET /slurm/v0.0.44/diag/
[2026-07-30T22:00:09.470] rest_auth/jwt: slurm_rest_auth_p_authenticate: [slurm-my-slurm-cluster-restapi-894979564-mbhrd:6820(fd:9)] attempting token authentication pass through

root@cp-52d9fcbe-1:~$ k logs -n slurm slurm-my-slurm-cluster-controller-0 --tail 100 | grep auth
[2026-07-30T21:57:09] error: auth_p_verify: token expired
[2026-07-30T21:57:09] error: slurm_unpack_received_msg: [10-234-1-46.slurm-my-slurm-cluster-restapi.slurm.svc.cluster.local:39662] auth_g_verify: REQUEST_STATS_INFO has authentication error: Authentication credential expired
[2026-07-30T21:57:09] error: slurm_unpack_received_msg: [10-234-1-46.slurm-my-slurm-cluster-restapi.slurm.svc.cluster.local:39662] Protocol authentication error
[2026-07-30T21:58:09] error: auth_p_verify: token expired
[2026-07-30T21:58:09] error: slurm_unpack_received_msg: [10-234-1-46.slurm-my-slurm-cluster-restapi.slurm.svc.cluster.local:36176] auth_g_verify: REQUEST_STATS_INFO has authentication error: Authentication credential expired
[2026-07-30T21:58:09] error: slurm_unpack_received_msg: [10-234-1-46.slurm-my-slurm-cluster-restapi.slurm.svc.cluster.local:36176] Protocol authentication error
[2026-07-30T21:59:09] error: auth_p_verify: token expired
[2026-07-30T21:59:09] error: slurm_unpack_received_msg: [10-234-1-46.slurm-my-slurm-cluster-restapi.slurm.svc.cluster.local:58822] auth_g_verify: REQUEST_STATS_INFO has authentication error: Authentication credential expired
[2026-07-30T21:59:09] error: slurm_unpack_received_msg: [10-234-1-46.slurm-my-slurm-cluster-restapi.slurm.svc.cluster.local:58822] Protocol authentication error
[2026-07-30T22:00:09] error: auth_p_verify: token expired
[2026-07-30T22:00:09] error: slurm_unpack_received_msg: [10-234-1-46.slurm-my-slurm-cluster-restapi.slurm.svc.cluster.local:53770] auth_g_verify: REQUEST_STATS_INFO has authentication error: Authentication credential expired
[2026-07-30T22:00:09] error: slurm_unpack_received_msg: [10-234-1-46.slurm-my-slurm-cluster-restapi.slurm.svc.cluster.local:53770] Protocol authentication error

[vivian-hafener]

Good afternoon @afuller-crusoe,

Thank you for the information. I will look into this.

Best,
Vivian Hafener

[vivian-hafener]

Good afternoon @afuller-crusoe,

Could you please send me the slurm-operator logs pertaining to this token, from something like the following?

kubectl logs -n slinky deployments/slurm-operator -f | grep token

How many cycles are you generally seeing before you run into the reconciliation without RequeueAfter?

I am curious to see what is going on in the leadup to the final reconciliation where RequeueAfter is not set. On my system I am not seeing an instance where that is unset; I am seeing the expected behavior where every 12 minutes I get an event:

{"level":"info","ts":"2026-08-07T20:30:21Z","msg":"Refresh token before expiration","controller":"slurmclient-controller","controllerGroup":"slinky.slurm.net","controllerKind":"Controller","Controller":{"name":"slurm","namespace":"slurm"},"namespace":"slurm","name":"slurm","reconcileID":"04665d83-af8a-47ce-951b-9ba53b7c7b70","exp":"2026-08-07 20:45:21 +0000 UTC","refresh":"2026-08-07T20:42:21Z"}

followed by two reconciliations:

{"level":"info","ts":"2026-08-07T20:33:55Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"f8f2a51b-29eb-449b-b866-237beb695deb","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T20:33:55Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"f8f2a51b-29eb-449b-b866-237beb695deb","duration":0.024752744}
{"level":"info","ts":"2026-08-07T20:33:55Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"8cb290c5-459f-4368-b3dd-808fa1f52bff","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T20:33:55Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"8cb290c5-459f-4368-b3dd-808fa1f52bff","duration":0.000194701,"result":{"Requeue":false,"RequeueAfter":719974291592,"Priority":null}}

I observed this continue for several cycles (full token lifetime) without issue on the current main branch as well as on v1.1.0.

Best,
Vivian Hafener

[afuller-crusoe]

I haven't been seeing issues with the slurm client controller (your first attached log), only the token controller (your second attached log), these should be entirely separate reconciliation loops.

We are seeing on average (across our fleet running 1.1.0) about 9 successful refresh before a dropped requeue. This ends up being about 1.5 hours where the token is valid, then invalid until the next periodic resync (every 10 hours). I attached multiple days worth of logs so you can see this pattern. Oddly only one error is logged over the few days, while there are multiple refresh drops

$ kubectl logs -n slinky deployments/slurm-operator -f | grep "\"controller\":\"token\""
Found 2 pods, using pod/slurm-operator-6bbdcb9d69-qk5m2
{"level":"info","ts":"2026-08-07T02:36:54Z","msg":"Starting EventSource","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","source":"kind source: *v1.Secret"}
{"level":"info","ts":"2026-08-07T02:36:54Z","msg":"Starting EventSource","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","source":"kind source: *v1beta1.Token"}
{"level":"info","ts":"2026-08-07T02:36:54Z","msg":"Starting Controller","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token"}
{"level":"info","ts":"2026-08-07T02:36:54Z","msg":"Starting workers","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","worker count":1}
{"level":"info","ts":"2026-08-07T02:36:54Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"5ba1a09c-b740-4548-a8c0-ab1464e44af7","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T02:36:54Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"5ba1a09c-b740-4548-a8c0-ab1464e44af7","duration":0.084570442,"result":{"Requeue":false,"RequeueAfter":652242213924,"Priority":null}}
{"level":"info","ts":"2026-08-07T02:47:47Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"f9c804ad-c05f-4ff1-977d-252cf351045e","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T02:47:47Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"f9c804ad-c05f-4ff1-977d-252cf351045e","duration":0.007527001}
{"level":"info","ts":"2026-08-07T02:47:47Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"046aecce-7569-475a-8eaa-9a489960569d","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T02:47:47Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"046aecce-7569-475a-8eaa-9a489960569d","duration":0.002807891,"result":{"Requeue":false,"RequeueAfter":719907350167,"Priority":null}}
{"level":"info","ts":"2026-08-07T02:59:47Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"5c8a1b9c-da4b-41dd-92d6-e1d6f0b55642","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T02:59:47Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"5c8a1b9c-da4b-41dd-92d6-e1d6f0b55642","duration":0.008514268}
{"level":"info","ts":"2026-08-07T02:59:47Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"aa66cfb6-1559-43ed-9895-bfd962f2089a","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T02:59:47Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"aa66cfb6-1559-43ed-9895-bfd962f2089a","duration":0.002376833,"result":{"Requeue":false,"RequeueAfter":719987888197,"Priority":null}}
{"level":"info","ts":"2026-08-07T03:11:47Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"34b44b37-8687-4a08-bd81-efa943fc49ba","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T03:11:47Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"34b44b37-8687-4a08-bd81-efa943fc49ba","duration":0.010560706}
{"level":"info","ts":"2026-08-07T03:11:47Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"c7c2210a-9fdf-4b63-9688-73ab701829a8","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T03:11:47Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"c7c2210a-9fdf-4b63-9688-73ab701829a8","duration":0.002784894,"result":{"Requeue":false,"RequeueAfter":719986393768,"Priority":null}}
{"level":"info","ts":"2026-08-07T03:23:47Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"ea5ef20f-b5c3-4e3a-9f52-400641c44c43","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T03:23:47Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"ea5ef20f-b5c3-4e3a-9f52-400641c44c43","duration":0.006958471}
{"level":"info","ts":"2026-08-07T03:23:47Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"ff8f9288-2beb-40a0-bef4-4b0e503f2d8a","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T03:23:47Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"ff8f9288-2beb-40a0-bef4-4b0e503f2d8a","duration":0.002331402,"result":{"Requeue":false,"RequeueAfter":719989489901,"Priority":null}}
{"level":"info","ts":"2026-08-07T03:35:47Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"24cc7399-4701-4f73-8353-041e880c15ce","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T03:35:47Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"24cc7399-4701-4f73-8353-041e880c15ce","duration":0.007473144}
{"level":"info","ts":"2026-08-07T21:06:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"05db97ad-0351-4748-85f1-862544b6bf9b","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T21:06:10Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"05db97ad-0351-4748-85f1-862544b6bf9b"}
{"level":"info","ts":"2026-08-07T21:06:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"05db97ad-0351-4748-85f1-862544b6bf9b","duration":0.006515157,"result":{"Requeue":false,"RequeueAfter":30000000000,"Priority":null}}
{"level":"info","ts":"2026-08-07T21:06:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"bfda39f9-14ad-4832-81fd-c15b9a01d85d","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T21:06:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"bfda39f9-14ad-4832-81fd-c15b9a01d85d","duration":0.002623507,"result":{"Requeue":false,"RequeueAfter":719219701822,"Priority":null}}
{"level":"info","ts":"2026-08-07T21:18:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"d63f5fb3-b214-4569-8c91-4058a978d190","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T21:18:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"d63f5fb3-b214-4569-8c91-4058a978d190","duration":0.00978149}
{"level":"info","ts":"2026-08-07T21:18:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"cc51d8ad-e59e-4944-b229-4c0c7bdb4bda","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T21:18:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"cc51d8ad-e59e-4944-b229-4c0c7bdb4bda","duration":0.002957878,"result":{"Requeue":false,"RequeueAfter":719986703262,"Priority":null}}
{"level":"info","ts":"2026-08-07T21:30:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"d9531599-5244-4d27-97cf-a074869103f1","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T21:30:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"d9531599-5244-4d27-97cf-a074869103f1","duration":0.009723018}
{"level":"info","ts":"2026-08-07T21:30:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"3d11c8ff-4ed7-4f00-8086-526e5f6b7d77","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T21:30:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"3d11c8ff-4ed7-4f00-8086-526e5f6b7d77","duration":0.002708482,"result":{"Requeue":false,"RequeueAfter":719986697953,"Priority":null}}
{"level":"info","ts":"2026-08-07T21:42:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"8243eb60-b123-47e4-912e-8682134dbfce","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T21:42:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"8243eb60-b123-47e4-912e-8682134dbfce","duration":0.011869444}
{"level":"info","ts":"2026-08-07T21:42:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"07e984d1-8ca7-4e59-963e-f20ce3d7b6ca","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T21:42:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"07e984d1-8ca7-4e59-963e-f20ce3d7b6ca","duration":0.002951062,"result":{"Requeue":false,"RequeueAfter":719984340316,"Priority":null}}
{"level":"info","ts":"2026-08-07T21:54:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"fc21e7fa-e345-4f32-9e58-7fa37dccccf4","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T21:54:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"fc21e7fa-e345-4f32-9e58-7fa37dccccf4","duration":0.008670639}
{"level":"info","ts":"2026-08-07T21:54:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"c7a19cd5-c8c5-48ee-a203-f23e5e54bc3f","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T21:54:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"c7a19cd5-c8c5-48ee-a203-f23e5e54bc3f","duration":0.002809009,"result":{"Requeue":false,"RequeueAfter":719987824717,"Priority":null}}
{"level":"info","ts":"2026-08-07T22:06:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"3c17f532-81b5-4be6-84bd-ee9bbc8e286e","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T22:06:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"3c17f532-81b5-4be6-84bd-ee9bbc8e286e","duration":0.348765428}
{"level":"info","ts":"2026-08-07T22:06:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"ae5abd81-4bbc-4e03-b3d5-2ee3e14d623f","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T22:06:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"ae5abd81-4bbc-4e03-b3d5-2ee3e14d623f","duration":0.003215092,"result":{"Requeue":false,"RequeueAfter":719647199067,"Priority":null}}
{"level":"info","ts":"2026-08-07T22:18:10Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"b30253cd-a498-4938-9638-6d65c90b2b6c","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-07T22:18:10Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"b30253cd-a498-4938-9638-6d65c90b2b6c","duration":0.007238815}
{"level":"info","ts":"2026-08-08T06:20:48Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"9b162d92-614b-47db-b036-76513543c408","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-08T06:20:48Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"9b162d92-614b-47db-b036-76513543c408"}
{"level":"info","ts":"2026-08-08T06:20:48Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"9b162d92-614b-47db-b036-76513543c408","duration":0.004888917,"error":"failed to parse Slurm auth token: failed to parse JWT claims: token has invalid claims: token is expired"}
{"level":"info","ts":"2026-08-08T06:20:48Z","msg":"Warning: Reconciler returned both a result with either RequeueAfter or Requeue set and a non-nil error. RequeueAfter and Requeue will always be ignored if the error is non-nil. For more details, see: https://pkg.go.dev/sigs.k8s.io/controller-runtime/pkg/reconcile#Reconciler","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"9b162d92-614b-47db-b036-76513543c408"}
{"level":"error","ts":"2026-08-08T06:20:48Z","msg":"Reconciler error","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"9b162d92-614b-47db-b036-76513543c408","error":"failed to parse Slurm auth token: failed to parse JWT claims: token has invalid claims: token is expired","stacktrace":"sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:495\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:438\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func1.1\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.23.3/pkg/internal/controller/controller.go:313"}
{"level":"info","ts":"2026-08-08T06:20:48Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"b8a3de78-7dfd-4c03-bbf8-5a70f8f47daf","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-08T06:20:48Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"b8a3de78-7dfd-4c03-bbf8-5a70f8f47daf","duration":0.006463871,"result":{"Requeue":false,"RequeueAfter":719112844790,"Priority":null}}
{"level":"info","ts":"2026-08-08T06:20:48Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"56fd993f-73e4-4d99-8c32-58b0f888f620","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-08T06:20:48Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"56fd993f-73e4-4d99-8c32-58b0f888f620","duration":0.003047775,"result":{"Requeue":false,"RequeueAfter":719106187970,"Priority":null}}
{"level":"info","ts":"2026-08-08T06:32:48Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"fbc75d0a-15e9-430a-a8a7-00dea6143bcd","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-08T06:32:48Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"fbc75d0a-15e9-430a-a8a7-00dea6143bcd","duration":0.00999549}
{"level":"info","ts":"2026-08-08T15:35:26Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"49fb2856-7cef-41cd-bbe2-89a39b858695","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-08T15:35:26Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"49fb2856-7cef-41cd-bbe2-89a39b858695"}
{"level":"info","ts":"2026-08-08T15:35:27Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"49fb2856-7cef-41cd-bbe2-89a39b858695","duration":0.023783506,"result":{"Requeue":false,"RequeueAfter":30000000000,"Priority":null}}
{"level":"info","ts":"2026-08-08T15:35:27Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"43c7ce24-7eeb-419c-af4d-63d25ed7235c","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-08T15:35:27Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"43c7ce24-7eeb-419c-af4d-63d25ed7235c","duration":0.002749186,"result":{"Requeue":false,"RequeueAfter":718996057342,"Priority":null}}
{"level":"info","ts":"2026-08-08T15:47:26Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"28d44412-f464-4b2a-b4b0-a39784ea778c","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-08T15:47:26Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"28d44412-f464-4b2a-b4b0-a39784ea778c","duration":0.008262852}
{"level":"info","ts":"2026-08-08T15:47:26Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"23417199-b8d6-49f5-b944-131da85f726f","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-08T15:47:26Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"23417199-b8d6-49f5-b944-131da85f726f","duration":0.002688683,"result":{"Requeue":false,"RequeueAfter":719988532915,"Priority":null}}
{"level":"info","ts":"2026-08-08T15:59:26Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"74c7fcdc-75ea-482a-b279-fa587056caac","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-08T15:59:26Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"74c7fcdc-75ea-482a-b279-fa587056caac","duration":0.006243263}
{"level":"info","ts":"2026-08-09T00:50:05Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"a6fca709-368b-4489-889b-0013c288ad0e","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T00:50:05Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"a6fca709-368b-4489-889b-0013c288ad0e"}
{"level":"info","ts":"2026-08-09T00:50:05Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"a6fca709-368b-4489-889b-0013c288ad0e","duration":0.008619769,"result":{"Requeue":false,"RequeueAfter":30000000000,"Priority":null}}
{"level":"info","ts":"2026-08-09T00:50:05Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"be112f0d-68c0-489c-9c87-20554b459e69","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T00:50:05Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"be112f0d-68c0-489c-9c87-20554b459e69","duration":0.00286283,"result":{"Requeue":false,"RequeueAfter":719907668540,"Priority":null}}
{"level":"info","ts":"2026-08-09T01:02:05Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"84161053-ac76-4173-ab4f-712509c8e6a0","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T01:02:05Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"84161053-ac76-4173-ab4f-712509c8e6a0","duration":0.008024781}
{"level":"info","ts":"2026-08-09T01:02:05Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"4592bc82-2244-4e14-b548-1512449e4581","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T01:02:05Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"4592bc82-2244-4e14-b548-1512449e4581","duration":0.002383003,"result":{"Requeue":false,"RequeueAfter":719988370095,"Priority":null}}
{"level":"info","ts":"2026-08-09T01:14:05Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"50e986ff-6292-4f64-9f44-6c9fce60c642","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T01:14:05Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"50e986ff-6292-4f64-9f44-6c9fce60c642","duration":0.009092768}
{"level":"info","ts":"2026-08-09T01:14:05Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"58b1a553-dbb0-4c9f-897e-4a21ed7711cb","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T01:14:05Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"58b1a553-dbb0-4c9f-897e-4a21ed7711cb","duration":0.002958544,"result":{"Requeue":false,"RequeueAfter":719988215724,"Priority":null}}
{"level":"info","ts":"2026-08-09T01:26:05Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"2a68b6a6-8c21-4fba-9f9d-d6856ce3c339","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T01:26:05Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"2a68b6a6-8c21-4fba-9f9d-d6856ce3c339","duration":0.008687333}
{"level":"info","ts":"2026-08-09T10:04:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"55c05f5c-2e44-4bc4-be5b-98a1fbf3d300","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T10:04:43Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"55c05f5c-2e44-4bc4-be5b-98a1fbf3d300"}
{"level":"info","ts":"2026-08-09T10:04:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"55c05f5c-2e44-4bc4-be5b-98a1fbf3d300","duration":0.009418435,"result":{"Requeue":false,"RequeueAfter":30000000000,"Priority":null}}
{"level":"info","ts":"2026-08-09T10:04:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"b5433393-c88e-43cb-b06f-62c703da6aa0","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T10:04:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"b5433393-c88e-43cb-b06f-62c703da6aa0","duration":0.002552555,"result":{"Requeue":false,"RequeueAfter":719802660099,"Priority":null}}
{"level":"info","ts":"2026-08-09T10:16:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"6bd0d6d3-522d-4c05-9fb6-2b1236caa873","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T10:16:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"6bd0d6d3-522d-4c05-9fb6-2b1236caa873","duration":0.008933287}
{"level":"info","ts":"2026-08-09T10:16:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"61e52b9a-476e-4577-b029-84d61818f8ea","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T10:16:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"61e52b9a-476e-4577-b029-84d61818f8ea","duration":0.002681406,"result":{"Requeue":false,"RequeueAfter":719987284095,"Priority":null}}
{"level":"info","ts":"2026-08-09T10:28:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"17274eb7-5375-4ff0-b32f-6bb15ff15e7e","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T10:28:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"17274eb7-5375-4ff0-b32f-6bb15ff15e7e","duration":0.008898609}
{"level":"info","ts":"2026-08-09T10:28:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"6c8055eb-ff43-412e-a5e2-d114b6f34e89","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T10:28:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"6c8055eb-ff43-412e-a5e2-d114b6f34e89","duration":0.002703629,"result":{"Requeue":false,"RequeueAfter":719987558876,"Priority":null}}
{"level":"info","ts":"2026-08-09T10:40:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"b3829608-36be-461c-902c-f0707ade7045","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T10:40:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"b3829608-36be-461c-902c-f0707ade7045","duration":0.008561346}
{"level":"info","ts":"2026-08-09T10:40:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"42b825e1-30f9-4f28-ad8a-e9a8643fc9d4","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T10:40:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"42b825e1-30f9-4f28-ad8a-e9a8643fc9d4","duration":0.002160654,"result":{"Requeue":false,"RequeueAfter":719987904181,"Priority":null}}
{"level":"info","ts":"2026-08-09T10:52:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"2e4c396f-c926-460a-84ab-442900223aa3","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T10:52:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"2e4c396f-c926-460a-84ab-442900223aa3","duration":0.01918581}
{"level":"info","ts":"2026-08-09T10:52:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"dca377ca-df68-46d3-8c19-4668ff8c2a64","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T10:52:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"dca377ca-df68-46d3-8c19-4668ff8c2a64","duration":0.003072546,"result":{"Requeue":false,"RequeueAfter":719977376611,"Priority":null}}
{"level":"info","ts":"2026-08-09T11:04:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"3c89ed2c-7bad-4b15-a221-318534287fba","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T11:04:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"3c89ed2c-7bad-4b15-a221-318534287fba","duration":0.008394898}
{"level":"info","ts":"2026-08-09T11:04:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"7899a44b-367c-43c0-9369-375f2018f703","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T11:04:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"7899a44b-367c-43c0-9369-375f2018f703","duration":0.002538446,"result":{"Requeue":false,"RequeueAfter":719987370231,"Priority":null}}
{"level":"info","ts":"2026-08-09T11:16:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"dd8d6f84-007e-4455-8d29-1b4294b0d538","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T11:16:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"dd8d6f84-007e-4455-8d29-1b4294b0d538","duration":0.050354788}
{"level":"info","ts":"2026-08-09T11:16:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"09d26be9-1122-4613-bbbc-4913939e40a8","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T11:16:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"09d26be9-1122-4613-bbbc-4913939e40a8","duration":0.04402233,"result":{"Requeue":false,"RequeueAfter":719946255331,"Priority":null}}
{"level":"info","ts":"2026-08-09T11:28:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"e38fbdc6-79ea-4ca4-8c83-36569a154b65","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T11:28:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"e38fbdc6-79ea-4ca4-8c83-36569a154b65","duration":0.007848979}
{"level":"info","ts":"2026-08-09T11:28:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"e1ecb138-9ece-4330-a966-be7a59bd3791","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T11:28:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"e1ecb138-9ece-4330-a966-be7a59bd3791","duration":0.002523748,"result":{"Requeue":false,"RequeueAfter":719947780645,"Priority":null}}
{"level":"info","ts":"2026-08-09T11:40:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"ab472a8c-cdb4-4763-8b5e-7e1108419f94","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T11:40:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"ab472a8c-cdb4-4763-8b5e-7e1108419f94","duration":0.008692856}
{"level":"info","ts":"2026-08-09T11:40:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"72505497-dc67-4a27-b0e7-3505b2c6aea0","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T11:40:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"72505497-dc67-4a27-b0e7-3505b2c6aea0","duration":0.002691944,"result":{"Requeue":false,"RequeueAfter":719988363200,"Priority":null}}
{"level":"info","ts":"2026-08-09T11:52:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"02b12f80-7814-467c-9c08-1b49bbf5f6c5","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T11:52:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"02b12f80-7814-467c-9c08-1b49bbf5f6c5","duration":0.007478119}
{"level":"info","ts":"2026-08-09T11:52:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"a79fbd32-7b9f-44f5-af0d-78a0fcb3ca5b","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T11:52:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"a79fbd32-7b9f-44f5-af0d-78a0fcb3ca5b","duration":0.00290068,"result":{"Requeue":false,"RequeueAfter":719988733078,"Priority":null}}
{"level":"info","ts":"2026-08-09T12:04:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"4a0108df-a52a-4c57-9ef2-80637c7768ce","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T12:04:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"4a0108df-a52a-4c57-9ef2-80637c7768ce","duration":0.008196003}
{"level":"info","ts":"2026-08-09T12:04:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"4f73459f-f448-4327-a4e1-e142048d4474","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T12:04:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"4f73459f-f448-4327-a4e1-e142048d4474","duration":0.002315387,"result":{"Requeue":false,"RequeueAfter":719987678196,"Priority":null}}
{"level":"info","ts":"2026-08-09T12:16:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"188d272e-6d33-4c4b-939b-120b411ca7f9","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T12:16:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"188d272e-6d33-4c4b-939b-120b411ca7f9","duration":0.008141445}
{"level":"info","ts":"2026-08-09T12:16:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"3f9fe279-1b74-4347-af4b-f97356d91fbe","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T12:16:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"3f9fe279-1b74-4347-af4b-f97356d91fbe","duration":0.002168822,"result":{"Requeue":false,"RequeueAfter":719989162582,"Priority":null}}
{"level":"info","ts":"2026-08-09T12:28:43Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"5fd7991b-cc55-42c6-99cb-6abafc370645","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T12:28:43Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"5fd7991b-cc55-42c6-99cb-6abafc370645","duration":0.007122643}
{"level":"info","ts":"2026-08-09T19:19:21Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"1e1b19ae-7630-46e0-9d14-52ab26fec9a1","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T19:19:21Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"1e1b19ae-7630-46e0-9d14-52ab26fec9a1"}
{"level":"info","ts":"2026-08-09T19:19:21Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"1e1b19ae-7630-46e0-9d14-52ab26fec9a1","duration":0.009686884,"result":{"Requeue":false,"RequeueAfter":30000000000,"Priority":null}}
{"level":"info","ts":"2026-08-09T19:19:21Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"566e4102-ae4b-4e83-a77d-f6de7f31f551","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T19:19:21Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"566e4102-ae4b-4e83-a77d-f6de7f31f551","duration":0.002722838,"result":{"Requeue":false,"RequeueAfter":719698512979,"Priority":null}}
{"level":"info","ts":"2026-08-09T19:31:21Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"6045d846-1547-44ce-a38c-5880f68b54d2","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T19:31:21Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"6045d846-1547-44ce-a38c-5880f68b54d2","duration":0.008143577}
{"level":"info","ts":"2026-08-09T19:31:21Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"ebd3da82-de69-4394-abbc-01e51448a3a6","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T19:31:21Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"ebd3da82-de69-4394-abbc-01e51448a3a6","duration":0.002288637,"result":{"Requeue":false,"RequeueAfter":719988694194,"Priority":null}}
{"level":"info","ts":"2026-08-09T19:43:21Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"11378688-70ce-4ad5-845c-170e65b4a424","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T19:43:21Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"11378688-70ce-4ad5-845c-170e65b4a424","duration":0.008222289}
{"level":"info","ts":"2026-08-09T19:43:21Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"aa7d404f-b9a1-4c39-af6b-36b343c75fdc","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T19:43:21Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"aa7d404f-b9a1-4c39-af6b-36b343c75fdc","duration":0.003734285,"result":{"Requeue":false,"RequeueAfter":719989116350,"Priority":null}}
{"level":"info","ts":"2026-08-09T19:55:21Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"94def790-2e76-4b29-9512-5f1dcfc15340","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T19:55:21Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"94def790-2e76-4b29-9512-5f1dcfc15340","duration":0.01841804}
{"level":"info","ts":"2026-08-09T19:55:21Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"6ed0c733-0331-4f6f-a026-cdb4570263ed","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T19:55:21Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"6ed0c733-0331-4f6f-a026-cdb4570263ed","duration":0.002635831,"result":{"Requeue":false,"RequeueAfter":719976664835,"Priority":null}}
{"level":"info","ts":"2026-08-09T20:07:21Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"7fccceca-f21e-4575-98d4-b0d1dcbbda68","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-09T20:07:21Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"7fccceca-f21e-4575-98d4-b0d1dcbbda68","duration":0.007258475}
{"level":"info","ts":"2026-08-10T04:33:59Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"2c494a06-81bc-4e35-96fb-0d89aaf7b68c","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T04:33:59Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"2c494a06-81bc-4e35-96fb-0d89aaf7b68c"}
{"level":"info","ts":"2026-08-10T04:33:59Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"2c494a06-81bc-4e35-96fb-0d89aaf7b68c","duration":0.008149724,"result":{"Requeue":false,"RequeueAfter":30000000000,"Priority":null}}
{"level":"info","ts":"2026-08-10T04:33:59Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"e5614727-aa2c-4e82-aaab-719a0f371b60","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T04:33:59Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"e5614727-aa2c-4e82-aaab-719a0f371b60","duration":0.002798003,"result":{"Requeue":false,"RequeueAfter":719596661252,"Priority":null}}
{"level":"info","ts":"2026-08-10T04:45:59Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"d167e1f3-57d4-4762-b59d-79af01bf77e5","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T04:45:59Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"d167e1f3-57d4-4762-b59d-79af01bf77e5","duration":0.007785654}
{"level":"info","ts":"2026-08-10T04:45:59Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"1a67b477-cff7-49f0-967c-b1099f1cd54e","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T04:45:59Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"1a67b477-cff7-49f0-967c-b1099f1cd54e","duration":0.00297265,"result":{"Requeue":false,"RequeueAfter":719989116488,"Priority":null}}
{"level":"info","ts":"2026-08-10T04:57:59Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"bd48b8d1-f69d-4536-a5b3-90ce74cdd7eb","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T04:57:59Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"bd48b8d1-f69d-4536-a5b3-90ce74cdd7eb","duration":0.009066824}
{"level":"info","ts":"2026-08-10T04:57:59Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"f8b72911-f05a-43ca-bb82-e3790efcb82c","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T04:57:59Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"f8b72911-f05a-43ca-bb82-e3790efcb82c","duration":0.002356618,"result":{"Requeue":false,"RequeueAfter":719986744787,"Priority":null}}
{"level":"info","ts":"2026-08-10T05:09:59Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"3e3ae60c-fab1-4a9b-a176-ae2523318c58","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T05:09:59Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"3e3ae60c-fab1-4a9b-a176-ae2523318c58","duration":0.007918029}
{"level":"info","ts":"2026-08-10T13:48:37Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"4d71c209-9cb9-481a-acf0-c87ed967be59","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T13:48:37Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"4d71c209-9cb9-481a-acf0-c87ed967be59"}
{"level":"info","ts":"2026-08-10T13:48:37Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"4d71c209-9cb9-481a-acf0-c87ed967be59","duration":0.008617854,"result":{"Requeue":false,"RequeueAfter":30000000000,"Priority":null}}
{"level":"info","ts":"2026-08-10T13:48:37Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"86cd2f22-2ec3-41bb-97f4-43b0f375172c","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T13:48:37Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"86cd2f22-2ec3-41bb-97f4-43b0f375172c","duration":0.002565794,"result":{"Requeue":false,"RequeueAfter":719492432563,"Priority":null}}
{"level":"info","ts":"2026-08-10T14:00:37Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"b2c3b657-0624-4a5e-aca5-5517cf70a054","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T14:00:37Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"b2c3b657-0624-4a5e-aca5-5517cf70a054","duration":0.006992686}
{"level":"info","ts":"2026-08-10T23:03:15Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"a19e9fa8-1dd3-492c-ab14-c4fe11f37142","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T23:03:15Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"a19e9fa8-1dd3-492c-ab14-c4fe11f37142"}
{"level":"info","ts":"2026-08-10T23:03:15Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"a19e9fa8-1dd3-492c-ab14-c4fe11f37142","duration":0.009279142,"result":{"Requeue":false,"RequeueAfter":30000000000,"Priority":null}}
{"level":"info","ts":"2026-08-10T23:03:15Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"5356f47b-15f7-421d-a9c5-1ea6afcd86de","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T23:03:15Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"5356f47b-15f7-421d-a9c5-1ea6afcd86de","duration":0.002504951,"result":{"Requeue":false,"RequeueAfter":719387991474,"Priority":null}}
{"level":"info","ts":"2026-08-10T23:15:15Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"14aed957-e619-44f0-a898-96cd92be6254","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T23:15:15Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"14aed957-e619-44f0-a898-96cd92be6254","duration":0.008293201}
{"level":"info","ts":"2026-08-10T23:15:15Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"16abfbc7-381f-474a-bf40-eb4685dabf1c","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T23:15:15Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"16abfbc7-381f-474a-bf40-eb4685dabf1c","duration":0.002646247,"result":{"Requeue":false,"RequeueAfter":719988106062,"Priority":null}}
{"level":"info","ts":"2026-08-10T23:27:15Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"d7456e5c-ad4b-46ff-93cb-5b214a8fc6ec","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-10T23:27:15Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"d7456e5c-ad4b-46ff-93cb-5b214a8fc6ec","duration":0.008259134}
{"level":"info","ts":"2026-08-11T08:17:53Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"f030f920-b15a-4008-8fd0-06617fc461bc","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-11T08:17:53Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"f030f920-b15a-4008-8fd0-06617fc461bc"}
{"level":"info","ts":"2026-08-11T08:17:53Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"f030f920-b15a-4008-8fd0-06617fc461bc","duration":0.010328305,"result":{"Requeue":false,"RequeueAfter":30000000000,"Priority":null}}
{"level":"info","ts":"2026-08-11T08:17:53Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"325f0192-c99b-48b4-a551-432dac9a6524","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-11T08:17:53Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"325f0192-c99b-48b4-a551-432dac9a6524","duration":0.002779844,"result":{"Requeue":false,"RequeueAfter":719283827608,"Priority":null}}
{"level":"info","ts":"2026-08-11T08:29:53Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"eec8efdb-d9b4-4407-adbc-05a37380c100","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-11T08:29:53Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"eec8efdb-d9b4-4407-adbc-05a37380c100","duration":0.008065576}
{"level":"info","ts":"2026-08-11T08:29:53Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"db51c04d-859a-4a8d-bb54-5fa00f9d982e","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-11T08:29:53Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"db51c04d-859a-4a8d-bb54-5fa00f9d982e","duration":0.002545669,"result":{"Requeue":false,"RequeueAfter":719988713026,"Priority":null}}
{"level":"info","ts":"2026-08-11T08:41:53Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"6d618308-1fec-44a9-926f-17e383bb6fdf","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-11T08:41:53Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"6d618308-1fec-44a9-926f-17e383bb6fdf","duration":0.007979449}
{"level":"info","ts":"2026-08-11T17:32:31Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"8c9890c6-4dfa-48d7-9f15-97d42a7112e5","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-11T17:32:31Z","msg":"Token's JWT is expired","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"8c9890c6-4dfa-48d7-9f15-97d42a7112e5"}
{"level":"info","ts":"2026-08-11T17:32:31Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"8c9890c6-4dfa-48d7-9f15-97d42a7112e5","duration":0.008463328,"result":{"Requeue":false,"RequeueAfter":30000000000,"Priority":null}}
{"level":"info","ts":"2026-08-11T17:32:31Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"1e461638-eaf2-4078-91f6-76cc4318c6e1","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-11T17:32:31Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"1e461638-eaf2-4078-91f6-76cc4318c6e1","duration":0.002618674,"result":{"Requeue":false,"RequeueAfter":719181932020,"Priority":null}}
{"level":"info","ts":"2026-08-11T17:44:31Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"93e48c33-e198-4cce-b242-8b347fe61a98","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-11T17:44:31Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"93e48c33-e198-4cce-b242-8b347fe61a98","duration":0.008356354}
{"level":"info","ts":"2026-08-11T17:44:31Z","msg":"Started syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"1071f023-8772-41f5-9762-a6825129fb5a","request":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"}}
{"level":"info","ts":"2026-08-11T17:44:31Z","msg":"Finished syncing Token","controller":"token","controllerGroup":"slinky.slurm.net","controllerKind":"Token","Token":{"name":"my-slurm-cluster-operator-token","namespace":"slurm"},"namespace":"slurm","name":"my-slurm-cluster-operator-token","reconcileID":"1071f023-8772-41f5-9762-a6825129fb5a","duration":0.002531792,"result":{"Requeue":false,"RequeueAfter":719988076420,"Priority":null}}