Taurus Auto EVM operator node struggling to sync last blocks

Issue Report

Environment

  • Operating System: Windows
  • Space Acres/Advanced CLI/Docker: CLI

Problem

Syncing a fresh operator node on domain 0 goes well until about 150k blocks before chainhead. At which point sync bps drops and there are messages about slow consensus and domain block production in the logs (may or may not be related).

2025-04-09T17:33:18.317082Z  INFO Domain: substrate: ÔÜÖ´©Å  Syncing  0.0 bps, target=#1229978 (10 peers), best: #1133860 (0xd10eÔǪ5c8a), finalized #1119430 (0xe211ÔǪca1e), Ô¼ç 31.3kiB/s Ô¼å 2.7kiB/s    
2025-04-09T17:33:19.485705Z  INFO Consensus: substrate: ÔÜÖ´©Å  Syncing  0.0 bps, target=#1997536 (40 peers), best: #1850923 (0xe4b2ÔǪcc22), finalized #0 (0x295aÔǪ6c5e), Ô¼ç 48.7kiB/s Ô¼å 59.4kiB/s    
2025-04-09T17:33:23.326953Z  INFO Domain: substrate: ÔÜÖ´©Å  Syncing  0.0 bps, target=#1229979 (10 peers), best: #1133860 (0xd10eÔǪ5c8a), finalized #1119430 (0xe211ÔǪca1e), Ô¼ç 22.5kiB/s Ô¼å 1.0kiB/s    
2025-04-09T17:33:24.490655Z  INFO Consensus: substrate: ÔÜÖ´©Å  Syncing  0.0 bps, target=#1997538 (40 peers), best: #1850923 (0xe4b2ÔǪcc22), finalized #0 (0x295aÔǪ6c5e), Ô¼ç 25.8kiB/s Ô¼å 13.1kiB/s    
2025-04-09T17:33:26.330791Z  WARN Domain: domain_client_operator::bundle_processor: Slow domain block execution, took 39785ms consensus_block_info=(0x1307ffbdff39b95c0adb571555f3a83181f9dfbc68f4d346a10eaf580aeba48f, 1843722) built_block_info=(0xf9938ff550262dc1a7e72ea6be4a899314e5bcbec4c69a725c259d23993ed525, 1133861) reference_block_execution_duration_ms=167
2025-04-09T17:33:26.334399Z  INFO Domain: domain_client_operator::bundle_processor: ­ƒöÆ Finalized block: (1119433, 0x41704312a28f71abbe3f6833ee23d987c79e00664bf336f7529bcddfa3fd9a51)
2025-04-09T17:33:28.336351Z  INFO Domain: substrate: ÔÜÖ´©Å  Syncing  0.1 bps, target=#1229979 (10 peers), best: #1133861 (0xf993ÔǪd525), finalized #1119433 (0x4170ÔǪ9a51), Ô¼ç 29.2kiB/s Ô¼å 0.6kiB/s    
2025-04-09T17:33:28.868237Z  WARN Domain: domain_client_operator::bundle_processor: Slow consensus block preprocessing, took 2489ms consensus_block_info=(0x1a7dea5ac68e3a233d934b58903cea2f262ec288663f658de0d26c0bb2ef7620, 1843728)
2025-04-09T17:33:29.502558Z  INFO Consensus: substrate: ÔÜÖ´©Å  Syncing  1.1 bps, target=#1997538 (40 peers), best: #1850929 (0x8575ÔǪ43c7), finalized #0 (0x295aÔǪ6c5e), Ô¼ç 291.6kiB/s Ô¼å 74.4kiB/s    
2025-04-09T17:33:33.344465Z  INFO Domain: substrate: ÔÜÖ´©Å  Syncing  0.0 bps, target=#1229979 (10 peers), best: #1133861 (0xf993ÔǪd525), finalized #1119433 (0x4170ÔǪ9a51), Ô¼ç 1.1kiB/s Ô¼å 0.5kiB/s    
2025-04-09T17:33:34.510278Z  INFO Consensus: substrate: ÔÜÖ´©Å  Syncing  0.0 bps, target=#1997538 (40 peers), best: #1850929 (0x8575ÔǪ43c7), finalized #0 (0x295aÔǪ6c5e), Ô¼ç 388.1kiB/s Ô¼å 40.5kiB/s    
2025-04-09T17:33:38.358017Z  INFO Domain: substrate: ÔÜÖ´©Å  Syncing  0.0 bps, target=#1229980 (10 peers), best: #1133861 (0xf993ÔǪd525), finalized #1119433 (0x4170ÔǪ9a51), Ô¼ç 33.7kiB/s Ô¼å 44 B/s    
2025-04-09T17:33:39.518816Z  INFO Consensus: substrate: ÔÜÖ´©Å  Syncing  0.0 bps, target=#1997539 (40 peers), best: #1850929 (0x8575ÔǪ43c7), finalized #0 (0x295aÔǪ6c5e), Ô¼ç 11.6kiB/s Ô¼å 47.7kiB/s