Bad bundle DomainId operator error: InvalidProofOfTime

Frequent error reports:InvalidProofOfTime

E5 2680V3*2 256G

server2019

The error message keeps getting during the operation

2024-03-04T05:14:52.666359Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478394e[0m (0x96b8…1ae3)
2024-03-04T05:14:53.643668Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478394 (0x96b8…1ae3), finalized #401340 (0xba36…b20e), :arrow_down: 22.5kiB/s :arrow_up: 3.2kiB/s
2024-03-04T05:14:58.647865Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478394 (0x96b8…1ae3), finalized #401340 (0xba36…b20e), :arrow_down: 7.2kiB/s :arrow_up: 6.8kiB/s
2024-03-04T05:15:01.452649Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 3, error: InvalidProofOfTime
2024-03-04T05:15:03.286119Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:03.654474Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478394 (0x96b8…1ae3), finalized #401340 (0xba36…b20e), :arrow_down: 18.1kiB/s :arrow_up: 12.5kiB/s
2024-03-04T05:15:05.269333Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:08.663114Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478394 (0x96b8…1ae3), finalized #401340 (0xba36…b20e), :arrow_down: 9.1kiB/s :arrow_up: 3.1kiB/s
2024-03-04T05:15:13.673135Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478394 (0x96b8…1ae3), finalized #401340 (0xba36…b20e), :arrow_down: 13.0kiB/s :arrow_up: 2.7kiB/s
2024-03-04T05:15:15.899681Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 3, error: InvalidProofOfTime
2024-03-04T05:15:18.678237Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478394 (0x96b8…1ae3), finalized #401340 (0xba36…b20e), :arrow_down: 42.7kiB/s :arrow_up: 5.0kiB/s
2024-03-04T05:15:19.204761Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478395e[0m (0x4cd7…b59d)
2024-03-04T05:15:20.884711Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478395e[0m (0xdc02…bfd7)
2024-03-04T05:15:21.036193Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478396e[0m (0xbad0…2bdd)
2024-03-04T05:15:22.412525Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:23.687500Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478396 (0xbad0…2bdd), finalized #401340 (0xba36…b20e), :arrow_down: 35.2kiB/s :arrow_up: 5.1kiB/s
2024-03-04T05:15:25.297065Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478397e[0m (0xa645…af32)
2024-03-04T05:15:26.568104Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478398e[0m (0x7809…dec0)
2024-03-04T05:15:27.564008Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:28.693319Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478398 (0x7809…dec0), finalized #401340 (0xba36…b20e), :arrow_down: 26.8kiB/s :arrow_up: 8.2kiB/s
2024-03-04T05:15:28.715358Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:28.715357Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 3, error: InvalidProofOfTime
2024-03-04T05:15:32.875597Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:33.069214Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478399e[0m (0xeb45…fcd7)
2024-03-04T05:15:33.698497Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478399 (0xeb45…fcd7), finalized #401340 (0xba36…b20e), :arrow_down: 23.0kiB/s :arrow_up: 10.8kiB/s
2024-03-04T05:15:35.365472Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 3, error: InvalidProofOfTime
2024-03-04T05:15:35.515372Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478400e[0m (0xb03f…9055)
2024-03-04T05:15:35.668471Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478400e[0m (0x4824…cd8c)
2024-03-04T05:15:35.839501Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478400e[0m (0x7e05…fe38)
2024-03-04T05:15:38.708505Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478400 (0xb03f…9055), finalized #401340 (0xba36…b20e), :arrow_down: 36.0kiB/s :arrow_up: 11.5kiB/s
2024-03-04T05:15:40.656298Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 3, error: InvalidProofOfTime
2024-03-04T05:15:42.160950Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:43.063102Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:43.723820Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478400 (0xb03f…9055), finalized #401340 (0xba36…b20e), :arrow_down: 17.7kiB/s :arrow_up: 11.7kiB/s
2024-03-04T05:15:44.806799Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:47.922600Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 3, error: InvalidProofOfTime
2024-03-04T05:15:48.737085Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478400 (0xb03f…9055), finalized #401340 (0xba36…b20e), :arrow_down: 10.0kiB/s :arrow_up: 7.7kiB/s
2024-03-04T05:15:53.739003Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478400 (0xb03f…9055), finalized #401340 (0xba36…b20e), :arrow_down: 20.6kiB/s :arrow_up: 14.3kiB/s
2024-03-04T05:15:54.606172Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:54.606179Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 3, error: InvalidProofOfTime
2024-03-04T05:15:54.899550Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478401e[0m (0x3cef…5a03)
2024-03-04T05:15:57.084003Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:58.742654Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478401 (0x3cef…5a03), finalized #401340 (0xba36…b20e), :arrow_down: 39.4kiB/s :arrow_up: 6.3kiB/s
2024-03-04T05:15:58.935894Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:15:59.019739Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478402e[0m (0xbf3c…9a1c)
2024-03-04T05:16:00.824874Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:16:00.869479Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478403e[0m (0x223f…9fcc)
2024-03-04T05:16:02.934965Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:16:03.753866Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478403 (0x223f…9fcc), finalized #401340 (0xba36…b20e), :arrow_down: 15.0kiB/s :arrow_up: 5.3kiB/s
2024-03-04T05:16:04.639557Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478404e[0m (0x14cd…051e)
2024-03-04T05:16:05.286961Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478401e[0m (0x8773…79fe)
2024-03-04T05:16:06.024717Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:16:06.753989Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 4, error: InvalidProofOfTime
2024-03-04T05:16:08.545216Z INFO Consensus: substrate: :sparkles: Imported #e[1;37m478405e[0m (0xd8ac…e0fb)
2024-03-04T05:16:08.768491Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478405 (0xd8ac…e0fb), finalized #401340 (0xba36…b20e), :arrow_down: 58.2kiB/s :arrow_up: 12.0kiB/s
2024-03-04T05:16:13.519544Z WARN Consensus: runtime::domains: Bad bundle DomainId(0), operator 3, error: InvalidProofOfTime
2024-03-04T05:16:13.784338Z INFO Consensus: substrate: :zzz: Idle (10 peers), best: #478405 (0xd8ac…e0fb), finalized #401340 (0xba36…b20e), :arrow_down: 17.1kiB/s :arrow_up: 12.5kiB/s

This is safe to ignore. It is related to the domain deployment on Gemini 3h which the team are still working on. They do not affect farming performance.

Note they are WARN and not ERROR.

Thank you so much

!!!

No problem. @ning kindly provided some further information on the Dev Sync today too:

Yes, this may happen in some edge cases where the farmer didn’t run a timekeeper and the bundle is broadcasted to the farmer before the PoT.

@ved suggested we may downgrade the WARN to DEBUG.