Operator 75 didn't receive rewards

Support
1

Issue Report

several days ago. My node crashed. restarting the node didn’t work and repeated the logs:
thread ‘tokio-runtime-worker’ panicked at crates/sp-subspace-mmr/src/runtime_interface.rs:58:14:
No SubspaceMmrExtension associated for the current context!
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace

I deleted the fold db and domains/0/db. shortly after the node resynced I found it didn’t receiving rewards at all.

Environment

  • Operating System:
  • ubuntu 22.04

here is the logs node starting:
jin@jhm:~/Desktop/operator$ sudo ./subspace-node run
–chain taurus
–name jhm
–base-path /home/jin/subspace
–blocks-pruning archive-canonical
–state-pruning archive-canonical
–sync full
–
–domain-id 0
–operator-id 75
–blocks-pruning archive-canonical
–state-pruning 32000
[sudo] password for jin:
2025-04-11T11:27:31.235512Z INFO subspace_node::commands::run: Subspace
2025-04-11T11:27:31.235524Z INFO subspace_node::commands::run: :victory_hand: version 0.1.0-58346e8bc7ff2ba1ed836d54921d016c9865cdf8
2025-04-11T11:27:31.235528Z INFO subspace_node::commands::run: :heart: by Subspace Labs https://subspace.network
2025-04-11T11:27:31.235531Z INFO subspace_node::commands::run: :clipboard: Chain specification: Autonomys Taurus Testnet
2025-04-11T11:27:31.235538Z INFO subspace_node::commands::run: :label: Node name: jhm
2025-04-11T11:27:31.235541Z INFO subspace_node::commands::run: :floppy_disk: Node path: /home/jin/subspace
2025-04-11T11:27:33.053391Z INFO Consensus: txpool: creating SingleState txpool Limit { count: 8192, total_bytes: 20971520 }/Limit { count: 819, total_bytes: 2097152 }.
2025-04-11T11:27:33.062644Z INFO Consensus: subspace_networking::constructor: DSN instance configured. allow_non_global_addresses_in_dht=false peer_id=12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr protocol_version=/subspace/2/295aeafca762a304d92ee1505548695091f6082d3f0aa4d092ac3cd6397a6c5e
2025-04-11T11:27:33.063387Z INFO Consensus: libp2p_swarm: local_peer_id=12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:33.063485Z INFO Consensus: subspace_service: Subspace networking initialized: Node ID is 12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:33.063716Z INFO Consensus: block_relay: relay::consensus block server: starting
2025-04-11T11:27:33.063788Z INFO Consensus: subspace_service: DSN listening on /ip4/127.0.0.1/tcp/30433/p2p/12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:33.063880Z INFO Consensus: sub-libp2p: :label: Local node identity is: 12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:33.063885Z INFO Consensus: sub-libp2p: Running libp2p network backend
2025-04-11T11:27:33.064450Z INFO Consensus: libp2p_swarm: local_peer_id=12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:33.064655Z INFO Consensus: sc_consensus_subspace::archiver: Not creating object mappings
2025-04-11T11:27:33.064682Z INFO Consensus: subspace_service: DSN listening on /ip6/::1/tcp/30433/p2p/12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:33.065010Z INFO Consensus: subspace: :farmer: Starting Subspace Authorship worker
2025-04-11T11:27:33.065125Z INFO Consensus: subspace_service: DSN listening on /ip4/192.168.2.47/tcp/30433/p2p/12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:33.065163Z INFO Consensus: subspace_service: DSN listening on /ip6/fe80::6372:67dc:afd6:ed6d/tcp/30433/p2p/12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:33.065777Z INFO Consensus: sc_consensus_subspace::archiver: Resuming archiver from last archived block last_archived_block_number=2018366
2025-04-11T11:27:33.065842Z INFO Consensus: sc_consensus_subspace::archiver: Archiving already produced blocks 2018367..=2018560
2025-04-11T11:27:33.069740Z INFO Consensus: sc_sysinfo: :laptop: Operating system: linux
2025-04-11T11:27:33.069746Z INFO Consensus: sc_sysinfo: :laptop: CPU architecture: x86_64
2025-04-11T11:27:33.069750Z INFO Consensus: sc_sysinfo: :laptop: Target environment: gnu
2025-04-11T11:27:33.069753Z INFO Consensus: sc_sysinfo: :laptop: CPU: AMD Ryzen 9 7950X 16-Core Processor
2025-04-11T11:27:33.069756Z INFO Consensus: sc_sysinfo: :laptop: CPU cores: 16
2025-04-11T11:27:33.069759Z INFO Consensus: sc_sysinfo: :laptop: Memory: 63497MB
2025-04-11T11:27:33.069762Z INFO Consensus: sc_sysinfo: :laptop: Kernel: 6.8.0-57-generic
2025-04-11T11:27:33.069764Z INFO Consensus: sc_sysinfo: :laptop: Linux distribution: Ubuntu 22.04.5 LTS
2025-04-11T11:27:33.069767Z INFO Consensus: sc_sysinfo: :laptop: Virtual machine: no
2025-04-11T11:27:33.069791Z INFO Consensus: subspace_service::task_spawner: :package: Highest known block at #2018660
2025-04-11T11:27:33.069937Z INFO Consensus: sc_rpc_server: Running JSON-RPC server: addr=127.0.0.1:9944,
2025-04-11T11:27:33.070232Z INFO Consensus: message::relayer: Starting Channel updates for chain: Consensus
2025-04-11T11:27:33.070243Z INFO Consensus: domain_message_listener: Starting transaction listener for Chain: Consensus
2025-04-11T11:27:33.641122Z INFO Domain: sub-libp2p: :label: Local node identity is: 12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:33.641134Z INFO Domain: sub-libp2p: Running libp2p network backend
2025-04-11T11:27:33.641351Z INFO Domain: libp2p_swarm: local_peer_id=12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:33.859026Z INFO Domain: sc_sysinfo: :laptop: Operating system: linux
2025-04-11T11:27:33.859035Z INFO Domain: sc_sysinfo: :laptop: CPU architecture: x86_64
2025-04-11T11:27:33.859037Z INFO Domain: sc_sysinfo: :laptop: Target environment: gnu
2025-04-11T11:27:33.859039Z INFO Domain: sc_sysinfo: :laptop: CPU: AMD Ryzen 9 7950X 16-Core Processor
2025-04-11T11:27:33.859040Z INFO Domain: sc_sysinfo: :laptop: CPU cores: 16
2025-04-11T11:27:33.859042Z INFO Domain: sc_sysinfo: :laptop: Memory: 63497MB
2025-04-11T11:27:33.859044Z INFO Domain: sc_sysinfo: :laptop: Kernel: 6.8.0-57-generic
2025-04-11T11:27:33.859046Z INFO Domain: sc_sysinfo: :laptop: Linux distribution: Ubuntu 22.04.5 LTS
2025-04-11T11:27:33.859049Z INFO Domain: sc_sysinfo: :laptop: Virtual machine: no
2025-04-11T11:27:33.859067Z INFO Domain: sc_service::builder: :package: Highest known block at #1243498
2025-04-11T11:27:33.859207Z INFO Domain: sc_rpc_server: Running JSON-RPC server: addr=127.0.0.1:42367,
2025-04-11T11:27:33.859446Z INFO Domain: domain_client_operator::domain_worker: :construction_worker: Running as Operator[75]…
2025-04-11T11:27:33.859456Z INFO Domain: message::relayer: Starting relayer for domain: DomainId(0) and the consensus chain
2025-04-11T11:27:33.859471Z INFO Domain: message::relayer: Starting Channel updates for chain: Domain(DomainId(0))
2025-04-11T11:27:33.859508Z INFO Domain: domain_message_listener: Starting transaction listener for Chain: Domain(DomainId(0))
2025-04-11T11:27:36.068166Z INFO Consensus: subspace_service::sync_from_dsn: Received notification to sync from DSN reason=WentOnlineSubstrate
2025-04-11T11:27:38.073165Z INFO Consensus: substrate: :zzz: Idle (1 peers), best: #2018660 (0x1356…f067), finalized #2007181 (0xa543…2e66), :down_arrow: 38.4kiB/s :up_arrow: 1.0kiB/s
2025-04-11T11:27:38.859631Z INFO Domain: substrate: :zzz: Idle (0 peers), best: #1243498 (0x8405…dc22), finalized #1229028 (0xaf02…fbcf), :down_arrow: 6.7kiB/s :up_arrow: 0.3kiB/s
2025-04-11T11:27:41.905549Z INFO Domain: sub-libp2p: :magnifying_glass_tilted_left: Discovered new external address for our node: /ip4/139.226.122.20/tcp/5435/p2p/12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:43.073459Z INFO Consensus: substrate: :zzz: Idle (1 peers), best: #2018660 (0x1356…f067), finalized #2007181 (0xa543…2e66), :down_arrow: 1.8kiB/s :up_arrow: 55 B/s
2025-04-11T11:27:43.859870Z INFO Domain: substrate: :zzz: Idle (3 peers), best: #1243498 (0x8405…dc22), finalized #1229028 (0xaf02…fbcf), :down_arrow: 16.1kiB/s :up_arrow: 2.1kiB/s
2025-04-11T11:27:45.665884Z WARN Consensus: sc_proof_of_time::source: Proof of time chain was extended from block import from_next_slot=12058429 to_next_slot=12058452
2025-04-11T11:27:45.665925Z INFO Consensus: substrate: :trophy: Imported #2018661 (0x1356…f067 → 0x3200…11da)
2025-04-11T11:27:45.671603Z INFO Domain: substrate: :new_button: Imported #1243499 (0x8405…dc22 → 0x3034…25a9)
2025-04-11T11:27:45.800813Z INFO Domain: sub-libp2p: :magnifying_glass_tilted_left: Discovered new external address for our node: /ip4/120.204.216.186/tcp/12377/p2p/12D3KooWLMhrc5KAxSQQLa3fcADXf31L2vYnaP4DXyvWNFTsQCmr
2025-04-11T11:27:45.966791Z INFO Domain: domain_client_operator::bundle_processor: :locked: Finalized block: (1229029, 0x8cb1494fe8fa46b0b6e04622f6f43815a57204ffc38e362ecc1065624a8c5264)
2025-04-11T11:27:46.027636Z INFO Consensus: substrate: :trophy: Imported #2018662 (0x3200…11da → 0x7059…a246)
2025-04-11T11:27:46.032698Z INFO Domain: substrate: :new_button: Imported #1243500 (0x3034…25a9 → 0x9541…3f14)
2025-04-11T11:27:46.033132Z WARN Domain: telemetry: :cross_mark: Error while dialing /dns/telemetry.subspace.foundation/tcp/443/x-parity-wss/%2Fsubmit%2F: Custom { kind: Other, error: Other(Left(Tls(Io(Os { code: 104, kind: ConnectionReset, message: “Connection reset by peer” })))) }
2025-04-11T11:27:48.073668Z INFO Consensus: substrate: :zzz: Idle (1 peers), best: #2018662 (0x7059…a246), finalized #2007181 (0xa543…2e66), :down_arrow: 1.8kiB/s :up_arrow: 0.3kiB/s
2025-04-11T11:27:48.639070Z WARN Consensus: telemetry: :cross_mark: Error while dialing /dns/telemetry.subspace.foundation/tcp/443/x-parity-wss/%2Fsubmit%2F: Custom { kind: Other, error: Other(Left(Tls(Io(Os { code: 104, kind: ConnectionReset, message: “Connection reset by peer” })))) }
2025-04-11T11:27:48.860329Z INFO Domain: substrate: :zzz: Idle (6 peers), best: #1243500 (0x9541…3f14), finalized #1229029 (0x8cb1…5264), :down_arrow: 24.0kiB/s :up_arrow: 2.5kiB/s
2025-04-11T11:27:53.074057Z INFO Consensus: substrate: :zzz: Idle (1 peers), best: #2018662 (0x7059…a246), finalized #2007181 (0xa543…2e66), :down_arrow: 25.6kiB/s :up_arrow: 3.2kiB/s
2025-04-11T11:27:53.860555Z INFO Domain: substrate: :zzz: Idle (8 peers), best: #1243500 (0x9541…3f14), finalized #1229029 (0x8cb1…5264), :down_arrow: 7.7kiB/s :up_arrow: 1.0kiB/s
2025-04-11T11:27:56.082204Z WARN Consensus: sc_proof_of_time::source: Proof of time chain was extended from block import from_next_slot=12058452 to_next_slot=12058473
2025-04-11T11:27:56.082428Z INFO Consensus: substrate: :trophy: Imported #2018663 (0x7059…a246 → 0x851e…f602)
2025-04-11T11:27:56.447485Z INFO Domain: substrate: :new_button: Imported #1243501 (0x9541…3f14 → 0x7be3…41d6)
2025-04-11T11:27:56.447755Z WARN Domain: domain_client_operator::bundle_processor: Slow domain block execution, took 363ms consensus_block_info=(0x851ebe31bb40d0c4b97d56f4741d0d74f899d7f4590c0225d7ad994cd366f602, 2018663) built_block_info=(0x7be36edbd18880201fe5f053f258c4e330c1fadedba828176e6fdbdec42741d6, 1243501) reference_block_execution_duration_ms=2
2025-04-11T11:27:56.619705Z INFO Consensus: substrate: :trophy: Imported #2018664 (0x851e…f602 → 0x954d…1b91)
2025-04-11T11:27:56.730204Z INFO Domain: domain_client_operator::bundle_processor: :locked: Finalized block: (1229030, 0xb04a98db44d4bcae76a0913d33ad479d742f23695fc344ff61c543f5cf308ed3)
2025-04-11T11:27:57.611819Z INFO Domain: substrate: :new_button: Imported #1243502 (0x7be3…41d6 → 0xadaf…f291)
2025-04-11T11:27:57.612122Z WARN Domain: domain_client_operator::bundle_processor: Slow domain block execution, took 871ms consensus_block_info=(0x954dbd77eed7c6227c1aaa6b615b09fb858d8769632341dc352975a2cc8e1b91, 2018664) built_block_info=(0xadaf4632ccb04174233c78de532e9cb77c7b8d0f806e9a68b3a8b7f1611ff291, 1243502) reference_block_execution_duration_ms=4
2025-04-11T11:27:58.074230Z INFO Consensus: substrate: :zzz: Idle (1 peers), best: #2018664 (0x954d…1b91), finalized #2007181 (0xa543…2e66), :down_arrow: 34.3kiB/s :up_arrow: 65 B/s
2025-04-11T11:27:58.860868Z INFO Domain: substrate: :zzz: Idle (8 peers), best: #1243502 (0xadaf…f291), finalized #1229030 (0xb04a…8ed3), :down_arrow: 55.4kiB/s :up_arrow: 24.3kiB/s
2025-04-11T11:28:00.231651Z WARN Consensus: sc_proof_of_time::source: Proof of time chain was extended from block import from_next_slot=12058473 to_next_slot=12058478
2025-04-11T11:28:00.231670Z INFO Consensus: substrate: :trophy: Imported #2018665 (0x954d…1b91 → 0xd17f…7b37)
2025-04-11T11:28:00.235755Z INFO Domain: substrate: :new_button: Imported #1243503 (0xadaf…f291 → 0xa56d…81fb)
2025-04-11T11:28:03.045449Z INFO Consensus: substrate: :new_button: Imported #2018665 (0x954d…1b91 → 0xd2c0…fdd8)
2025-04-11T11:28:03.046244Z INFO Domain: domain_client_operator::domain_bundle_producer: :package: Claimed slot 12058482
2025-04-11T11:28:03.046617Z INFO Domain: domain_client_operator::domain_bundle_producer: :bookmark: Producing bundle at slot Slot(12058482)
2025-04-11T11:28:03.048208Z INFO Domain: runtime::domains: Submitted bundle from slot 12058482, extrinsics: 0
2025-04-11T11:28:03.074419Z INFO Consensus: substrate: :zzz: Idle (1 peers), best: #2018665 (0xd17f…7b37), finalized #2007181 (0xa543…2e66), :down_arrow: 28.2kiB/s :up_arrow: 0.5kiB/s
2025-04-11T11:28:03.861031Z INFO Domain: substrate: :zzz: Idle (8 peers), best: #1243503 (0xa56d…81fb), finalized #1229030 (0xb04a…8ed3), :down_arrow: 1.8kiB/s :up_arrow: 1.0kiB/s
2025-04-11T11:28:06.723405Z WARN Consensus: telemetry: :cross_mark: Error while dialing /dns/telemetry.subspace.foundation/tcp/443/x-parity-wss/%2Fsubmit%2F: Custom { kind: Other, error: Other(Left(Tls(Io(Os { code: 104, kind: ConnectionReset, message: “Connection reset by peer” })))) }
2025-04-11T11:28:08.074798Z INFO Consensus: substrate: :zzz: Idle (1 peers), best: #2018665 (0xd17f…7b37), finalized #2007181 (0xa543…2e66), :down_arrow: 20.1kiB/s :up_arrow: 93 B/s
2025-04-11T11:28:08.861353Z INFO Domain: substrate: :zzz: Idle (8 peers), best: #1243503 (0xa56d…81fb), finalized #1229030 (0xb04a…8ed3), :down_arrow: 1.3kiB/s :up_arrow: 0.7kiB/s
2025-04-11T11:28:13.075158Z INFO Consensus: substrate: :zzz: Idle (1 peers), best: #2018665 (0xd17f…7b37), finalized #2007181 (0xa543…2e66), :down_arrow: 5.4kiB/s :up_arrow: 0.1kiB/s
2025-04-11T11:28:13.861568Z INFO Domain: substrate: :zzz: Idle (8 peers), best: #1243503 (0xa56d…81fb), finalized #1229030 (0xb04a…8ed3), :down_arrow: 6.5kiB/s :up_arrow: 1.3kiB/s
2025-04-11T11:28:14.129190Z INFO Consensus: substrate: :trophy: Imported #2018666 (0xd17f…7b37 → 0x02c0…b4b0)
2025-04-11T11:28:15.251526Z INFO Consensus: substrate: :trophy: Imported #2018667 (0x02c0…b4b0 → 0xbe1d…2a78)
2025-04-11T11:28:15.387794Z INFO Domain: substrate: :new_button: Imported #1243504 (0xa56d…81fb → 0x9149…5265)
2025-04-11T11:28:15.387794Z WARN Domain: domain_client_operator::bundle_processor: Slow domain block execution, took 1241ms consensus_block_info=(0x02c0c64071dd2743f83c40afb99db4bead1da9a01e4f5fb90f8680d741f4b4b0, 2018666) built_block_info=(0x914907f7b35f21b34e13360fb60e66b0d5e3b3b644cdd48979c899bee0a15265, 1243504) reference_block_execution_duration_ms=5
2025-04-11T11:28:15.671137Z INFO Domain: domain_client_operator::bundle_processor: :locked: Finalized block: (1229031, 0x4f916c776a0bd2144799b462ceb7386773d3d25af5d40b597020060aef7781f2)
2025-04-11T11:28:15.755474Z INFO Domain: domain_client_operator::domain_bundle_producer: :package: Claimed slot 12058493
2025-04-11T11:28:15.756176Z INFO Domain: domain_client_operator::domain_bundle_producer: :bookmark: Producing bundle at slot Slot(12058493)
2025-04-11T11:28:15.757717Z INFO Domain: runtime::domains: Submitted bundle from slot 12058493, extrinsics: 1
2025-04-11T11:28:16.554153Z INFO Consensus: substrate: :new_button: Imported #2018667 (0x02c0…b4b0 → 0xa23d…856e)
2025-04-11T11:28:16.914342Z INFO Domain: domain_client_operator::domain_bundle_producer: :package: Claimed slot 12058494
2025-04-11T11:28:16.914708Z INFO Domain: domain_client_operator::domain_bundle_producer: :bookmark: Producing bundle at slot Slot(12058494)
2025-04-11T11:28:16.916189Z INFO Domain: runtime::domains: Submitted bundle from slot 12058494, extrinsics: 0
2025-04-11T11:28:18.075364Z INFO Consensus: substrate: :zzz: Idle (1 peers), best: #2018667 (0xbe1d…2a78), finalized #2007181 (0xa543…2e66), :down_arrow: 22.9kiB/s :up_arrow: 1.3kiB/s
2025-04-11T11:28:18.861688Z INFO Domain: substrate: :zzz: Idle (8 peers), best: #1243504 (0x9149…5265), finalized #1229031 (0x4f91…81f2), :down_arrow: 68.3kiB/s :up_arrow: 20.0kiB/s
2025-04-11T11:28:22.204764Z INFO Consensus: substrate: :trophy: Imported #2018668 (0xbe1d…2a78 → 0x3f23…7593)
2025-04-11T11:28:23.028172Z INFO Domain: substrate: :new_button: Imported #1243505 (0x9149…5265 → 0xdaff…5162)
2025-04-11T11:28:23.028535Z WARN Domain: domain_client_operator::bundle_processor: Slow domain block execution, took 816ms consensus_block_info=(0x3f23e099b57e7bd5db37b64b578974079b6ee82f21c41a18fdad403ac46f7593, 2018668) built_block_info=(0xdaff33002545b58b71fec53d6927a222ce6a4aa4dd9535cf7838dcf3754d5162, 1243505) reference_block_execution_duration_ms=4
2025-04-11T11:28:23.075511Z INFO Consensus: substrate: :zzz: Idle (1 peers), best: #2018668 (0x3f23…7593), finalized #2007181 (0xa543…2e66), :down_arrow: 28.1kiB/s :up_arrow: 0.4kiB/s
2025-04-11T11:28:23.317987Z INFO Domain: domain_client_operator::bundle_processor: :locked: Finalized block: (1229032, 0xb49644b8743101cef9fc26dff3deb3d3c85165fe17b7f55dec2b8c67ba1adaa8)
2025-04-11T11:28:23.620093Z INFO Consensus: substrate: :new_button: Imported #2018668 (0xbe1d…2a78 → 0x5372…7cac)
2025-04-11T11:28:23.861809Z INFO Domain: substrate: :zzz: Idle (8 peers), best: #1243505 (0xdaff…5162), finalized #1229032 (0xb496…daa8), :down_arrow: 66.6kiB/s :up_arrow: 41.3kiB/s
2025-04-11T11:28:24.996746Z INFO Domain: domain_client_operator::domain_bundle_producer: :package: Claimed slot 12058501
2025-04-11T11:28:25.005798Z INFO Domain: domain_client_operator::domain_bundle_producer: :bookmark: Producing bundle at slot Slot(12058501)
2025-04-11T11:28:25.008147Z INFO Domain: runtime::domains: Submitted bundle from slot 12058501, extrinsics: 22
2025-04-11T11:28:26.160594Z INFO Domain: domain_client_operator::domain_bundle_producer: :package: Claimed slot 12058502
2025-04-11T11:28:26.161854Z INFO Domain: domain_client_operator::domain_bundle_producer: :bookmark: Producing bundle at slot Slot(12058502)
2025-04-11T11:28:26.163460Z INFO Domain: runtime::domains: Submitted bundle from slot 12058502, extrinsics: 0
2025-04-11T11:28:27.792461Z WARN Consensus: telemetry: :cross_mark: Error while dialing /dns/telemetry.subspace.foundation/tcp/443/x-parity-wss/%2Fsubmit%2F: Custom { kind: Other, error: Other(Left(Tls(Io(Os { code: 104, kind: ConnectionReset, message: “Connection reset by peer” })))) }
2025-04-11T11:28:28.075869Z INFO Consensus: substrate: :zzz: Idle (2 peers), best: #2018668 (0x3f23…7593), finalized #2007181 (0xa543…2e66), :down_arrow: 29.2kiB/s :up_arrow: 16.0kiB/s
2025-04-11T11:28:28.510317Z INFO Domain: domain_client_operator::domain_bundle_producer: :package: Claimed slot 12058504
2025-04-11T11:28:28.511608Z INFO Domain: domain_client_operator::domain_bundle_producer: :bookmark: Producing bundle at slot Slot(12058504)
2025-04-11T11:28:28.513272Z INFO Domain: runtime::domains: Submitted bundle from slot 12058504, extrinsics: 0
2025-04-11T11:28:28.862123Z INFO Domain: substrate: :zzz: Idle (8 peers), best: #1243505 (0xdaff…5162), finalized #1229032 (0xb496…daa8), :down_arrow: 17.4kiB/s :up_arrow: 18.2kiB/s
2025-04-11T11:28:29.967322Z INFO Consensus: substrate: :trophy: Imported #2018669 (0x3f23…7593 → 0xf7c5…32f0)
2025-04-11T11:28:30.616936Z INFO Consensus: substrate: :new_button: Imported #2018669 (0x3f23…7593 → 0x68ad…7a82)

2

We have been looking at your problem.

Rewards are subject to a challenge period of 14,400 domain blocks. Are you seeing the delay in old blocks coming out of the challenge period and new blocks (earned since the resync) still awaiting being unlocked?

By the way, it was pointed out that your original crash was due to running an old release. Make sure you’re always running the latest build to avoid any problems.

3

Look at his log. This should be the latest version

4

14400 domain blocks delay explained everything. Thanks Jim and team.
My node was struggled to sync. And I always try different release caused crash. New release works well for now.

5

The original crash - that led to requiring a resync. Not the start logs from the synced node.

6

I’m glad we got to the bottom of it.