Taurus node shutting down domain_client_operator Failed to process

Issue Report

Environment

  • Operating System: Ubuntu 22.04
  • Space Acres/Advanced CLI/Docker: Advanced CLI

Problem

Synch from genesis went well, almost. Node crashes every time (3 or 4 tries) after a few minutes.

patrick@clack:~/taurus_op$ RUST_LOG=info,subspace_service=trace,sc_consensus_subspace=trace
patrick@clack:~/taurus_op$ ./subspace-node-ubuntu-x86_64-skylake-mainnet-2025-jan-14 run       --chain taurus       --name clackop       --base-path ./nodedata       --blocks-pruning archive-canonical       --state-pruning archive-canonical       --sync full       --       --domain-id 0       --blocks-pruning archive-canonical       --state-pruning 16000       --listen-on "/ip4/0.0.0.0/tcp/30639"
2025-02-06T14:50:28.954189Z  INFO subspace_node::commands::run: Subspace
2025-02-06T14:50:28.954201Z  INFO subspace_node::commands::run: ✌️  version 0.1.0-77cad052a5e24c538b665d6c287871913b6a1d5c
2025-02-06T14:50:28.954204Z  INFO subspace_node::commands::run: ❤️  by Subspace Labs <https://subspace.network>
2025-02-06T14:50:28.954208Z  INFO subspace_node::commands::run: 📋 Chain specification: Autonomys Taurus Testnet
2025-02-06T14:50:28.954211Z  INFO subspace_node::commands::run: 🏷  Node name: clackop
2025-02-06T14:50:28.954214Z  INFO subspace_node::commands::run: 💾 Node path: ./nodedata
2025-02-06T14:50:30.321340Z  INFO Consensus: subspace_networking::constructor: DSN instance configured. allow_non_global_addresses_in_dht=false peer_id=12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T protocol_version=/subspace/2/295aeafca762a304d92ee1505548695091f6082d3f0aa4d092ac3cd6397a6c5e
2025-02-06T14:50:30.321628Z  INFO Consensus: libp2p_swarm: local_peer_id=12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.321731Z  INFO Consensus: subspace_service: Subspace networking initialized: Node ID is 12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.321898Z  INFO Consensus: block_relay: relay::consensus block server: starting
2025-02-06T14:50:30.321986Z  INFO Consensus: subspace_service: DSN listening on /ip4/127.0.0.1/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.322120Z  INFO Consensus: sub-libp2p: 🏷  Local node identity is: 12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T    
2025-02-06T14:50:30.322125Z  INFO Consensus: sub-libp2p: Running libp2p network backend    
2025-02-06T14:50:30.322440Z  INFO Consensus: subspace_service: DSN listening on /ip6/::1/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.322624Z  INFO Consensus: sc_consensus_subspace::archiver: Not creating object mappings
2025-02-06T14:50:30.322918Z  INFO Consensus: subspace: 🧑‍🌾 Starting Subspace Authorship worker
2025-02-06T14:50:30.323292Z  INFO Consensus: subspace_service: DSN listening on /ip4/192.168.7.230/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323304Z  INFO Consensus: subspace_service: DSN listening on /ip6/fd19:c8e6:5882:1:bd9c:1ba2:bd1e:879d/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323311Z  INFO Consensus: subspace_service: DSN listening on /ip4/172.17.0.1/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323319Z  INFO Consensus: subspace_service: DSN listening on /ip6/fd19:c8e6:5882:1:98fb:5931:a7bc:2199/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323330Z  INFO Consensus: subspace_service: DSN listening on /ip6/fd19:c8e6:5882:1:86cc:bbbb:56ec:10fd/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323339Z  INFO Consensus: subspace_service: DSN listening on /ip6/fd19:c8e6:5882:1:5686:19b3:5cd2:440f/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323345Z  INFO Consensus: subspace_service: DSN listening on /ip6/fd19:c8e6:5882:1:2ba3:f02c:70c0:dcd0/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323352Z  INFO Consensus: subspace_service: DSN listening on /ip6/fd19:c8e6:5882:1:bcf5:a1d6:296d:d71e/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323359Z  INFO Consensus: subspace_service: DSN listening on /ip6/fd19:c8e6:5882:1:b128:43ff:19aa:88c/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323366Z  INFO Consensus: subspace_service: DSN listening on /ip6/fd19:c8e6:5882:1:3f99:4659:a7b7:575/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323373Z  INFO Consensus: subspace_service: DSN listening on /ip6/fe80::1f2f:f9d8:ffe2:f6e4/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323380Z  INFO Consensus: subspace_service: DSN listening on /ip6/fe80::42:aff:feca:46e/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.323388Z  INFO Consensus: subspace_service: DSN listening on /ip6/fe80::acb2:35ff:feed:df5e/tcp/30433/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T
2025-02-06T14:50:30.325735Z  INFO Consensus: sc_consensus_subspace::archiver: Resuming archiver from last archived block last_archived_block_number=1145603
2025-02-06T14:50:30.326549Z  INFO Consensus: sc_consensus_subspace::archiver: Archiving already produced blocks 1145604..=1149349
2025-02-06T14:50:30.328032Z  INFO Consensus: sc_sysinfo: 💻 Operating system: linux    
2025-02-06T14:50:30.328037Z  INFO Consensus: sc_sysinfo: 💻 CPU architecture: x86_64    
2025-02-06T14:50:30.328041Z  INFO Consensus: sc_sysinfo: 💻 Target environment: gnu    
2025-02-06T14:50:30.328044Z  INFO Consensus: sc_sysinfo: 💻 CPU: AMD Ryzen 9 7950X3D 16-Core Processor    
2025-02-06T14:50:30.328046Z  INFO Consensus: sc_sysinfo: 💻 CPU cores: 16    
2025-02-06T14:50:30.328049Z  INFO Consensus: sc_sysinfo: 💻 Memory: 127950MB    
2025-02-06T14:50:30.328051Z  INFO Consensus: sc_sysinfo: 💻 Kernel: 6.8.0-50-generic    
2025-02-06T14:50:30.328054Z  INFO Consensus: sc_sysinfo: 💻 Linux distribution: Ubuntu 22.04.5 LTS    
2025-02-06T14:50:30.328056Z  INFO Consensus: sc_sysinfo: 💻 Virtual machine: no    
2025-02-06T14:50:30.328079Z  INFO Consensus: subspace_service::task_spawner: 📦 Highest known block at #1149449
2025-02-06T14:50:30.328330Z  INFO Consensus: sc_rpc_server: Running JSON-RPC server: addr=127.0.0.1:42613,    
2025-02-06T14:50:30.328485Z  INFO Consensus: domain_message_listener: Starting transaction listener for Chain: Consensus
2025-02-06T14:50:30.328543Z  INFO Consensus: message::relayer: Starting Channel updates for chain: Consensus
2025-02-06T14:50:30.557888Z  INFO Domain: sub-libp2p: 🏷  Local node identity is: 12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T    
2025-02-06T14:50:30.557903Z  INFO Domain: sub-libp2p: Running libp2p network backend    
2025-02-06T14:50:30.575788Z  INFO Domain: sc_sysinfo: 💻 Operating system: linux    
2025-02-06T14:50:30.575797Z  INFO Domain: sc_sysinfo: 💻 CPU architecture: x86_64    
2025-02-06T14:50:30.575799Z  INFO Domain: sc_sysinfo: 💻 Target environment: gnu    
2025-02-06T14:50:30.575803Z  INFO Domain: sc_sysinfo: 💻 CPU: AMD Ryzen 9 7950X3D 16-Core Processor    
2025-02-06T14:50:30.575805Z  INFO Domain: sc_sysinfo: 💻 CPU cores: 16    
2025-02-06T14:50:30.575806Z  INFO Domain: sc_sysinfo: 💻 Memory: 127950MB    
2025-02-06T14:50:30.575808Z  INFO Domain: sc_sysinfo: 💻 Kernel: 6.8.0-50-generic    
2025-02-06T14:50:30.575811Z  INFO Domain: sc_sysinfo: 💻 Linux distribution: Ubuntu 22.04.5 LTS    
2025-02-06T14:50:30.575814Z  INFO Domain: sc_sysinfo: 💻 Virtual machine: no    
2025-02-06T14:50:30.575832Z  INFO Domain: sc_service::builder: 📦 Highest known block at #570849    
2025-02-06T14:50:30.575951Z  INFO Domain: sc_rpc_server: Running JSON-RPC server: addr=127.0.0.1:36463,    
2025-02-06T14:50:30.576166Z  INFO Domain: domain_client_operator::domain_worker: 🧑‍ Running as Full node...
2025-02-06T14:50:30.576162Z  INFO Domain: domain_message_listener: Starting transaction listener for Chain: Domain(DomainId(0))
2025-02-06T14:50:30.718732Z  INFO Domain: sub-libp2p: 🔍 Discovered new external address for our node: /ip4/75.100.41.233/tcp/30639/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T    
2025-02-06T14:50:30.811257Z  INFO Consensus: sub-libp2p: 🔍 Discovered new external address for our node: /ip4/75.100.41.233/tcp/30333/p2p/12D3KooWF6EhXwED9huFBx5focDKtsuHHAfTypESTQ2M9rve2R1T    
2025-02-06T14:50:31.324143Z  INFO Consensus: subspace_service::sync_from_dsn: Received notification to sync from DSN reason=WentOnlineSubstrate
2025-02-06T14:50:35.328517Z  INFO Consensus: substrate: ⚙️  Syncing, target=#1162431 (4 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 15.1kiB/s ⬆ 8.2kiB/s    
2025-02-06T14:50:35.576134Z  INFO Domain: substrate: ⚙️  Syncing, target=#582072 (8 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 4.9kiB/s ⬆ 4.6kiB/s    
2025-02-06T14:50:40.328691Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162431 (8 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 21.1kiB/s ⬆ 4.6kiB/s    
2025-02-06T14:50:40.576272Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582072 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 3.3kiB/s ⬆ 3.9kiB/s    
2025-02-06T14:50:45.328839Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162432 (12 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 27.6kiB/s ⬆ 6.0kiB/s    
2025-02-06T14:50:45.576428Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582073 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.6kiB/s ⬆ 1.5kiB/s    
2025-02-06T14:50:50.328971Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162432 (13 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 5.7kiB/s ⬆ 0.9kiB/s    
2025-02-06T14:50:50.329988Z  WARN Consensus: telemetry: ❌ Error while dialing /dns/telemetry.subspace.foundation/tcp/443/x-parity-wss/%2Fsubmit%2F: Custom { kind: Other, error: Timeout }    
2025-02-06T14:50:50.576511Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582074 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 0.7kiB/s ⬆ 0.6kiB/s    
2025-02-06T14:50:50.577514Z  WARN Domain: telemetry: ❌ Error while dialing /dns/telemetry.subspace.foundation/tcp/443/x-parity-wss/%2Fsubmit%2F: Custom { kind: Other, error: Timeout }    
2025-02-06T14:50:55.329108Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162433 (13 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 7.5kiB/s ⬆ 1.1kiB/s    
2025-02-06T14:50:55.576662Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582074 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 0.5kiB/s ⬆ 0.9kiB/s    
2025-02-06T14:51:00.329218Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162435 (13 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 9.5kiB/s ⬆ 0.6kiB/s    
2025-02-06T14:51:00.576806Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582076 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.1kiB/s ⬆ 0.9kiB/s    
2025-02-06T14:51:05.329344Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162435 (14 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 5.3kiB/s ⬆ 1.0kiB/s    
2025-02-06T14:51:05.576955Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582076 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.1kiB/s ⬆ 1.9kiB/s    
2025-02-06T14:51:10.329478Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162436 (13 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 6.9kiB/s ⬆ 0.9kiB/s    
2025-02-06T14:51:10.577098Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582077 (8 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.5kiB/s ⬆ 3.0kiB/s    
2025-02-06T14:51:15.329621Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162437 (14 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 8.6kiB/s ⬆ 1.0kiB/s    
2025-02-06T14:51:15.577235Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582078 (8 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.0kiB/s ⬆ 2.5kiB/s    
2025-02-06T14:51:20.329767Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162439 (14 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 7.2kiB/s ⬆ 0.6kiB/s    
2025-02-06T14:51:20.577359Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582079 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.6kiB/s ⬆ 2.4kiB/s    
2025-02-06T14:51:25.329878Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162441 (14 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 9.3kiB/s ⬆ 0.7kiB/s    
2025-02-06T14:51:25.577500Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582080 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.1kiB/s ⬆ 1.9kiB/s    
2025-02-06T14:51:30.330007Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162442 (13 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 6.8kiB/s ⬆ 0.6kiB/s    
2025-02-06T14:51:30.577627Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582081 (8 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 0.9kiB/s ⬆ 1.0kiB/s    
2025-02-06T14:51:35.330124Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162443 (13 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 7.4kiB/s ⬆ 0.7kiB/s    
2025-02-06T14:51:35.577759Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582081 (8 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 0.4kiB/s ⬆ 0.8kiB/s    
2025-02-06T14:51:40.330240Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162443 (14 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 6.5kiB/s ⬆ 1.4kiB/s    
2025-02-06T14:51:40.577901Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582081 (8 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.2kiB/s ⬆ 3.1kiB/s    
2025-02-06T14:51:45.330431Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162445 (14 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 8.9kiB/s ⬆ 0.9kiB/s    
2025-02-06T14:51:45.578037Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582082 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.3kiB/s ⬆ 2.2kiB/s    
2025-02-06T14:51:50.330515Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162446 (14 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 6.6kiB/s ⬆ 0.7kiB/s    
2025-02-06T14:51:50.578166Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582082 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 0.4kiB/s ⬆ 1.9kiB/s    
2025-02-06T14:51:55.330638Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162447 (14 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 7.1kiB/s ⬆ 0.8kiB/s    
2025-02-06T14:51:55.578326Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582084 (8 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.2kiB/s ⬆ 1.8kiB/s    
2025-02-06T14:52:00.330775Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162448 (14 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 5.4kiB/s ⬆ 0.6kiB/s    
2025-02-06T14:52:00.578468Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582084 (8 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 0.8kiB/s ⬆ 1.8kiB/s    
2025-02-06T14:52:05.330897Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162450 (13 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 7.6kiB/s ⬆ 0.9kiB/s    
2025-02-06T14:52:05.578589Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582086 (8 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.0kiB/s ⬆ 0.7kiB/s    
2025-02-06T14:52:10.330991Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162450 (13 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 5.5kiB/s ⬆ 0.9kiB/s    
2025-02-06T14:52:10.578737Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582086 (9 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 0.6kiB/s ⬆ 1.8kiB/s    
2025-02-06T14:52:15.331137Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#1162451 (14 peers), best: #1149449 (0x24cd…10ed), finalized #0 (0x295a…6c5e), ⬇ 7.4kiB/s ⬆ 2.1kiB/s    
2025-02-06T14:52:15.578890Z  INFO Domain: substrate: ⚙️  Syncing  0.0 bps, target=#582087 (10 peers), best: #570849 (0xd1a4…842e), finalized #0 (0x5a36…0ce6), ⬇ 1.3kiB/s ⬆ 2.1kiB/s    
2025-02-06T14:52:18.324365Z ERROR Domain: domain_client_operator::domain_worker: Failed to process consensus block error=RuntimeApiError(Application(Execution(Other("Exported method DomainCoreApi_intermediate_roots is not found"))))
2025-02-06T14:52:18.324403Z ERROR Domain: sc_service::task_manager: Essential task `domain-operator-worker` failed. Shutting down service.    
2025-02-06T14:52:18.324513Z ERROR Domain: subspace_node::commands::run: Domain starter exited with an error error=Other: Essential task failed.
2025-02-06T14:52:18.324536Z ERROR sc_service::task_manager: Essential task `domain` failed. Shutting down service.    
2025-02-06T14:52:18.336580Z ERROR Consensus: sc_service::client::client: Unable to send AnnouncePin worker message for import: sending into a closed channel    
Error: SubstrateService(Other("Essential task failed."))

I see you are using subspace-node-ubuntu-x86_64-skylake-mainnet-2025-jan-14. Could you try this release please? Release taurus-2025-jan-28 · autonomys/subspace · GitHub

Looking good so far, thanks! I did notice the ‘mainnet’ in the node executable, but felt ok with ‘taurus’ chain flag…did I miss some instructions? No worries either way, just want to help and/or be on the right track.

1 Like

Great! In general, it should be possible to use a mainnet build on Taurus but there have been some changes on Taurus recently as we gear up for the next Stake Wars instalment. For now it’s best to use the latest build for the target network.

Thanks for providing helpful logs - it helped me work the issue out pretty quickly and means others can find the solution easily.