Node stops unexpectedly

Issue Report

Environment

  • Operating System: Ubuntu 22.04.3 LTS
  • Pulsar/Advanced CLI/Docker: CLI

Problem

When I sync node from genesis, I can sync first 2000 block, then error occurs and stop the node

2024-06-24T14:56:50.001496Z  INFO subspace_node::commands::run: Subspace
2024-06-24T14:56:50.001514Z  INFO subspace_node::commands::run: ✌️  version 0.1.0-870bc43614d
2024-06-24T14:56:50.001516Z  INFO subspace_node::commands::run: ❤️  by Subspace Labs <https://subspace.network>
2024-06-24T14:56:50.001519Z  INFO subspace_node::commands::run: 📋 Chain specification: Subspace Gemini 3h
2024-06-24T14:56:50.001521Z  INFO subspace_node::commands::run: 🏷  Node name: Kogo
2024-06-24T14:56:50.001523Z  INFO subspace_node::commands::run: 💾 Node path: /media/hungnv/WDSN6401/Subspace/subspace_gemini_3h_operator_domain_10
2024-06-24T14:56:50.187318Z  INFO Consensus: sc_service::client::client: 🔨 Initializing Genesis block/state (state: 0x4b08…e8c9, header-hash: 0x0c12…1c34)    
2024-06-24T14:56:50.573746Z  INFO Consensus: subspace_networking::constructor: DSN instance configured. allow_non_global_addresses_in_dht=false peer_id=12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU protocol_version=/subspace/2/0c121c75f4ef450f40619e1fca9d1e8e7fbabc42c895bc4790801e85d5a91c34
2024-06-24T14:56:50.573969Z  INFO Consensus: libp2p_swarm: local_peer_id=12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU
2024-06-24T14:56:50.574057Z  INFO Consensus: subspace_service: Subspace networking initialized: Node ID is 12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU
2024-06-24T14:56:50.574434Z  INFO Consensus: subspace_service: DSN listening on /ip4/127.0.0.1/tcp/30433/p2p/12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU
2024-06-24T14:56:50.574456Z  INFO Consensus: block_relay: relay::consensus block server: starting
2024-06-24T14:56:50.574608Z  INFO Consensus: subspace_service: DSN listening on /ip6/::1/tcp/30433/p2p/12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU
2024-06-24T14:56:50.574616Z  INFO Consensus: sub-libp2p: 🏷  Local node identity is: 12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU    
2024-06-24T14:56:50.574618Z  INFO Consensus: subspace_service: DSN listening on /ip4/192.168.1.10/tcp/30433/p2p/12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU
2024-06-24T14:56:50.574641Z  INFO Consensus: subspace_service: DSN listening on /ip6/2405:4803:b2aa:b600:4eb5:f98b:54ec:31d5/tcp/30433/p2p/12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU
2024-06-24T14:56:50.574649Z  INFO Consensus: subspace_service: DSN listening on /ip4/192.168.1.9/tcp/30433/p2p/12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU
2024-06-24T14:56:50.574656Z  INFO Consensus: subspace_service: DSN listening on /ip6/2405:4803:b2aa:b600:9e79:abbf:d558:3436/tcp/30433/p2p/12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU
2024-06-24T14:56:50.574665Z  INFO Consensus: subspace_service: DSN listening on /ip6/fe80::e55b:2a01:982b:4f1f/tcp/30433/p2p/12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU
2024-06-24T14:56:50.575211Z  INFO Consensus: sc_consensus_subspace::archiver: Starting archiving from genesis
2024-06-24T14:56:50.575234Z  INFO Consensus: sc_consensus_subspace::archiver: Archiving already produced blocks 0..=0
2024-06-24T14:56:55.342499Z  INFO Consensus: subspace: 🧑‍🌾 Starting Subspace Authorship worker
2024-06-24T14:56:55.348604Z  INFO Consensus: sc_sysinfo: 💻 Operating system: linux    
2024-06-24T14:56:55.348613Z  INFO Consensus: sc_sysinfo: 💻 CPU architecture: x86_64    
2024-06-24T14:56:55.348616Z  INFO Consensus: sc_sysinfo: 💻 Target environment: gnu    
2024-06-24T14:56:55.348620Z  INFO Consensus: sc_sysinfo: 💻 CPU: AMD Ryzen 9 5950X 16-Core Processor    
2024-06-24T14:56:55.348624Z  INFO Consensus: sc_sysinfo: 💻 CPU cores: 16    
2024-06-24T14:56:55.348626Z  INFO Consensus: sc_sysinfo: 💻 Memory: 31993MB    
2024-06-24T14:56:55.348629Z  INFO Consensus: sc_sysinfo: 💻 Kernel: 6.5.0-15-generic    
2024-06-24T14:56:55.348632Z  INFO Consensus: sc_sysinfo: 💻 Linux distribution: Ubuntu 22.04.3 LTS    
2024-06-24T14:56:55.348635Z  INFO Consensus: sc_sysinfo: 💻 Virtual machine: no    
2024-06-24T14:56:55.348664Z  INFO Consensus: sc_service::builder: 📦 Highest known block at #0    
2024-06-24T14:56:55.348844Z  INFO Consensus: sc_rpc_server: Running JSON-RPC server: addr=127.0.0.1:9944, allowed origins=["http://localhost:*", "http://127.0.0.1:*", "https://localhost:*", "https://127.0.0.1:*", "https://polkadot.js.org"]    
2024-06-24T14:56:55.349096Z  INFO Consensus: message::relayer: Starting relayer for chain: Consensus
2024-06-24T14:56:55.349166Z  INFO Consensus: domain_message_listener: Starting transaction listener for Chain: Consensus
2024-06-24T14:56:56.816112Z  INFO Consensus: sub-libp2p: 🔍 Discovered new external address for our node: /ip4/118.71.83.242/tcp/30333/p2p/12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU    
2024-06-24T14:56:57.320617Z  INFO Consensus: subspace_service::sync_from_dsn: Received notification to sync from DSN reason=WentOnlineSubstrate
2024-06-24T14:57:00.349463Z  INFO Consensus: substrate: ⚙️  Syncing, target=#2100662 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 6.7kiB/s ⬆ 1.8kiB/s    
2024-06-24T14:57:05.350158Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100663 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 1.9kiB/s ⬆ 0.1kiB/s    
2024-06-24T14:57:10.350356Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100663 (4 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.7kiB/s ⬆ 2.1kiB/s    
2024-06-24T14:57:14.972218Z  INFO Consensus: sub-libp2p: 🔍 Discovered new external address for our node: /ip6/2405:4803:b2aa:b600:4eb5:f98b:54ec:31d5/tcp/30333/p2p/12D3KooWAeYHLJt8Y1LkDtPjHgVW2btBdgwMkKowQXFzsMzQzcVU    
2024-06-24T14:57:15.350532Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100663 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 6.1kiB/s ⬆ 1.1kiB/s    
2024-06-24T14:57:15.350633Z  WARN Consensus: telemetry: ❌ Error while dialing /dns/telemetry.subspace.network/tcp/443/x-parity-wss/%2Fsubmit%2F: Custom { kind: Other, error: Timeout }    
2024-06-24T14:57:20.351046Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100664 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.5kiB/s ⬆ 1.2kiB/s    
2024-06-24T14:57:25.351264Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100665 (6 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 10.1kiB/s ⬆ 2.7kiB/s    
2024-06-24T14:57:30.351443Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100666 (9 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 20.4kiB/s ⬆ 7.5kiB/s    
2024-06-24T14:57:35.351770Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100668 (9 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 15.5kiB/s ⬆ 4.6kiB/s 
...
2024-06-24T15:23:10.428255Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100920 (18 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 15.9kiB/s ⬆ 1.6kiB/s    
2024-06-24T15:23:15.428829Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100920 (18 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 14.6kiB/s ⬆ 1.3kiB/s    
2024-06-24T15:23:20.428960Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100920 (18 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 13.4kiB/s ⬆ 0.8kiB/s    
2024-06-24T15:23:25.429068Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100920 (17 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 13.8kiB/s ⬆ 1.3kiB/s    
2024-06-24T15:23:30.429193Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2100921 (17 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 16.5kiB/s ⬆ 0.7kiB/s    
2024-06-24T15:23:35.429561Z  INFO Consensus: substrate: ⚙️  Syncing  2.0 bps, target=#2100922 (18 peers), best: #2032 (0x98fc…9604), finalized #1922 (0xb57b…dd1c), ⬇ 11.2kiB/s ⬆ 0.5kiB/s    
2024-06-24T15:23:40.429736Z  INFO Consensus: substrate: ⚙️  Syncing  7.4 bps, target=#2100924 (18 peers), best: #2069 (0xae42…9152), finalized #1922 (0xb57b…dd1c), ⬇ 15.5kiB/s ⬆ 2.3kiB/s    
thread 'tokio-runtime-worker' panicked at /home/ubuntu/actions-runner/_work/subspace/subspace/crates/sc-consensus-subspace/src/archiver.rs:948:10:
Older block by number must always exist
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
2024-06-24T15:23:41.427394Z ERROR Consensus: sc_service::task_manager: Essential task `subspace-archiver` failed. Shutting down service.    
2024-06-24T15:23:41.434413Z ERROR Consensus: sc_service::client::client: Unable to send AnnouncePin worker message for import: sending into a closed channel    
Error: SubstrateService(Other("Essential task failed."))

Are you using snap sync? Please provide full command you use to start hte node, there is no information on what release and how you are starting right now.

I’ll also try to reproduce it myself of course.

I don’t think it was Snap sync in your case and I wasn’t able to reproduce the crash on a simple start and sync from genesis, successfully synced past above point at very least:

2024-06-24T21:07:46.700082Z INFO Consensus: substrate: :gear: Syncing 0.0 bps, target=#2104259 (40 peers), best: #2586 (0x627b…f6f1), finalized #2023 (0x050d…5fa1), :arrow_down: 29.8kiB/s :arrow_up: 2.3kiB/s

Full logs rather that truncated would be helpful. Also if it is repeatable then running node with RUST_LOG=info,subspace_service=trace,sc_consensus_subspace=trace will result in many more logs that will help understanding why it is happening.

My start command

./subspace-node-ubuntu-x86_64-skylake-gemini-3h-2024-jun-18 run \
 --chain gemini-3h \
 --name Kogo \
 --base-path /media/st/Subspace/subspace_gemini_3h_operator_domain_001 \
 --blocks-pruning archive \
 --state-pruning archive \
 -- \
 --domain-id 0

The error is repeatable, and the block that error occur is various, from 2000 to 4000

Full log (part 1)

Logs
2024-06-25T01:47:12.370877Z  INFO subspace_node::commands::run: Subspace
2024-06-25T01:47:12.370891Z  INFO subspace_node::commands::run: ✌️  version 0.1.0-870bc43614d
2024-06-25T01:47:12.370895Z  INFO subspace_node::commands::run: ❤️  by Subspace Labs <https://subspace.network>
2024-06-25T01:47:12.370898Z  INFO subspace_node::commands::run: 📋 Chain specification: Subspace Gemini 3h
2024-06-25T01:47:12.370900Z  INFO subspace_node::commands::run: 🏷  Node name: Kogo
2024-06-25T01:47:12.370902Z  INFO subspace_node::commands::run: 💾 Node path: /media/hungnv/WDSN6401/Subspace/subspace_gemini_3h_operator_domain_001
2024-06-25T01:47:12.551549Z  INFO Consensus: sc_service::client::client: 🔨 Initializing Genesis block/state (state: 0x4b08…e8c9, header-hash: 0x0c12…1c34)    
2024-06-25T01:47:12.943261Z  INFO Consensus: subspace_networking::constructor: DSN instance configured. allow_non_global_addresses_in_dht=false peer_id=12D3KooWFku2PYBNymUVZzKZDjYvBz7UGYj7feCq3B8BdkpYUFjX protocol_version=/subspace/2/0c121c75f4ef450f40619e1fca9d1e8e7fbabc42c895bc4790801e85d5a91c34
2024-06-25T01:47:12.943444Z  INFO Consensus: libp2p_swarm: local_peer_id=12D3KooWFku2PYBNymUVZzKZDjYvBz7UGYj7feCq3B8BdkpYUFjX
2024-06-25T01:47:12.943544Z  INFO Consensus: subspace_service: Subspace networking initialized: Node ID is 12D3KooWFku2PYBNymUVZzKZDjYvBz7UGYj7feCq3B8BdkpYUFjX
2024-06-25T01:47:12.943960Z  INFO Consensus: block_relay: relay::consensus block server: starting
2024-06-25T01:47:12.944062Z  INFO Consensus: subspace_service: DSN listening on /ip4/127.0.0.1/tcp/30433/p2p/12D3KooWFku2PYBNymUVZzKZDjYvBz7UGYj7feCq3B8BdkpYUFjX
2024-06-25T01:47:12.944126Z  INFO Consensus: sub-libp2p: 🏷  Local node identity is: 12D3KooWFku2PYBNymUVZzKZDjYvBz7UGYj7feCq3B8BdkpYUFjX    
2024-06-25T01:47:12.944279Z  INFO Consensus: subspace_service: DSN listening on /ip6/::1/tcp/30433/p2p/12D3KooWFku2PYBNymUVZzKZDjYvBz7UGYj7feCq3B8BdkpYUFjX
2024-06-25T01:47:12.944293Z  INFO Consensus: subspace_service: DSN listening on /ip4/192.168.1.10/tcp/30433/p2p/12D3KooWFku2PYBNymUVZzKZDjYvBz7UGYj7feCq3B8BdkpYUFjX
2024-06-25T01:47:12.944690Z  INFO Consensus: sc_consensus_subspace::archiver: Starting archiving from genesis
2024-06-25T01:47:12.944709Z  INFO Consensus: sc_consensus_subspace::archiver: Archiving already produced blocks 0..=0
2024-06-25T01:47:17.679006Z  INFO Consensus: subspace: 🧑‍🌾 Starting Subspace Authorship worker
2024-06-25T01:47:17.709490Z  INFO Consensus: sc_sysinfo: 💻 Operating system: linux    
2024-06-25T01:47:17.709501Z  INFO Consensus: sc_sysinfo: 💻 CPU architecture: x86_64    
2024-06-25T01:47:17.709504Z  INFO Consensus: sc_sysinfo: 💻 Target environment: gnu    
2024-06-25T01:47:17.709507Z  INFO Consensus: sc_sysinfo: 💻 CPU: AMD Ryzen 9 5950X 16-Core Processor    
2024-06-25T01:47:17.709511Z  INFO Consensus: sc_sysinfo: 💻 CPU cores: 16    
2024-06-25T01:47:17.709514Z  INFO Consensus: sc_sysinfo: 💻 Memory: 31993MB    
2024-06-25T01:47:17.709517Z  INFO Consensus: sc_sysinfo: 💻 Kernel: 6.5.0-15-generic    
2024-06-25T01:47:17.709520Z  INFO Consensus: sc_sysinfo: 💻 Linux distribution: Ubuntu 22.04.3 LTS    
2024-06-25T01:47:17.709523Z  INFO Consensus: sc_sysinfo: 💻 Virtual machine: no    
2024-06-25T01:47:17.709556Z  INFO Consensus: sc_service::builder: 📦 Highest known block at #0    
2024-06-25T01:47:17.709745Z  INFO Consensus: sc_rpc_server: Running JSON-RPC server: addr=127.0.0.1:9944, allowed origins=["http://localhost:*", "http://127.0.0.1:*", "https://localhost:*", "https://127.0.0.1:*", "https://polkadot.js.org"]    
2024-06-25T01:47:17.710031Z  INFO Consensus: message::relayer: Starting relayer for chain: Consensus
2024-06-25T01:47:17.710059Z  INFO Consensus: domain_message_listener: Starting transaction listener for Chain: Consensus
2024-06-25T01:47:19.190697Z  INFO Consensus: sub-libp2p: 🔍 Discovered new external address for our node: /ip4/118.71.83.242/tcp/30333/p2p/12D3KooWFku2PYBNymUVZzKZDjYvBz7UGYj7feCq3B8BdkpYUFjX    
2024-06-25T01:47:19.678504Z  INFO Consensus: subspace_service::sync_from_dsn: Received notification to sync from DSN reason=WentOnlineSubstrate
2024-06-25T01:47:22.710060Z  INFO Consensus: substrate: ⚙️  Syncing, target=#2106978 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.2kiB/s ⬆ 1.7kiB/s    
2024-06-25T01:47:27.710310Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106978 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.8kiB/s ⬆ 0.1kiB/s    
2024-06-25T01:47:32.710692Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106980 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.2kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:47:37.710935Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106981 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 7.3kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:47:37.711240Z  WARN Consensus: telemetry: ❌ Error while dialing /dns/telemetry.subspace.network/tcp/443/x-parity-wss/%2Fsubmit%2F: Custom { kind: Other, error: Timeout }    
2024-06-25T01:47:42.711180Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106981 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 2.4kiB/s ⬆ 0.2kiB/s    
2024-06-25T01:47:47.711664Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106982 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.3kiB/s ⬆ 0.2kiB/s    
2024-06-25T01:47:52.711895Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106983 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 6.1kiB/s ⬆ 1.5kiB/s    
2024-06-25T01:47:57.712185Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106984 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.9kiB/s ⬆ 0.9kiB/s    
2024-06-25T01:48:02.712593Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106984 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.5kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:48:07.713258Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106985 (2 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.4kiB/s ⬆ 0.3kiB/s    
2024-06-25T01:48:12.713553Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106986 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 10.2kiB/s ⬆ 2.4kiB/s    
2024-06-25T01:48:17.713883Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106986 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.2kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:48:22.714143Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106986 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.1kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:48:27.714659Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106986 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.6kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:48:32.715318Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106986 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.1kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:48:37.715876Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106987 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.9kiB/s ⬆ 0.3kiB/s    
2024-06-25T01:48:42.716077Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106989 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.4kiB/s ⬆ 0.9kiB/s    
2024-06-25T01:48:47.716368Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106990 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.8kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:48:52.716588Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106991 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.4kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:48:57.717048Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106993 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 2.8kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:49:02.717353Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106994 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.2kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:49:07.717852Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106994 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.3kiB/s ⬆ 1.4kiB/s    
2024-06-25T01:49:12.718543Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106994 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.0kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:49:17.719053Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106997 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 1.8kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:49:22.719288Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106998 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.6kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:49:27.719530Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106998 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.7kiB/s ⬆ 1.4kiB/s    
2024-06-25T01:49:32.720058Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2106998 (3 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 2.4kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:49:37.720506Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107000 (4 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.7kiB/s ⬆ 1.3kiB/s    
2024-06-25T01:49:42.720724Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107003 (4 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.2kiB/s ⬆ 1.2kiB/s    
2024-06-25T01:49:47.721124Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107005 (4 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.4kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:49:52.721723Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107006 (4 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.6kiB/s ⬆ 1.0kiB/s    
2024-06-25T01:49:57.721963Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107007 (4 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.9kiB/s ⬆ 1.5kiB/s    
2024-06-25T01:50:02.722186Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107008 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 6.0kiB/s ⬆ 1.7kiB/s    
2024-06-25T01:50:07.722634Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107008 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 6.7kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:50:12.722828Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107008 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.9kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:50:17.723245Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107009 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.8kiB/s ⬆ 1.1kiB/s    
2024-06-25T01:50:22.723867Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107009 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.2kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:50:27.724389Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107010 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.2kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:50:32.724642Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107010 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.4kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:50:37.724893Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107011 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.6kiB/s ⬆ 0.9kiB/s    
2024-06-25T01:50:42.725652Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107011 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 6.0kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:50:47.726130Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107013 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.7kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:50:52.726555Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107013 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.9kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:50:57.726738Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107015 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.8kiB/s ⬆ 1.0kiB/s    
2024-06-25T01:51:02.726960Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107015 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.7kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:51:07.727504Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107016 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.2kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:51:12.728074Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107017 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.4kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:51:17.728245Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107019 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 8.0kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:51:22.728430Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107020 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.6kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:51:27.728680Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107021 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 6.1kiB/s ⬆ 1.1kiB/s    
2024-06-25T01:51:32.729068Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107021 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.0kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:51:37.729694Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107021 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 2.8kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:51:42.729884Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107022 (5 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.5kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:51:47.730129Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107022 (6 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 6.1kiB/s ⬆ 1.3kiB/s    
2024-06-25T01:51:52.730342Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107024 (6 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.3kiB/s ⬆ 1.1kiB/s    
2024-06-25T01:51:57.730772Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107024 (6 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.8kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:52:02.731082Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107024 (6 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 3.0kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:52:07.731495Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107024 (6 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.6kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:52:12.731664Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107026 (6 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 6.7kiB/s ⬆ 1.1kiB/s    
2024-06-25T01:52:17.731841Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107026 (6 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.7kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:52:22.732003Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107027 (6 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 7.7kiB/s ⬆ 2.1kiB/s    
2024-06-25T01:52:27.732173Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107029 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.3kiB/s ⬆ 1.1kiB/s    
2024-06-25T01:52:32.732311Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107029 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 4.4kiB/s ⬆ 0.9kiB/s    
2024-06-25T01:52:37.732448Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107029 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 7.5kiB/s ⬆ 0.9kiB/s    
2024-06-25T01:52:42.732593Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107030 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 6.1kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:52:47.732758Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107030 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 7.9kiB/s ⬆ 1.1kiB/s    
2024-06-25T01:52:52.732941Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107030 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.0kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:52:57.733110Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107031 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 8.5kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:53:02.733312Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107033 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 7.4kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:53:07.733518Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107034 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.9kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:53:12.733934Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107036 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 8.7kiB/s ⬆ 1.2kiB/s    
2024-06-25T01:53:17.734746Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107037 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 7.0kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:53:22.735361Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107037 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 7.3kiB/s ⬆ 0.3kiB/s    
2024-06-25T01:53:27.736027Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107038 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 10.3kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:53:32.736364Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107039 (7 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 5.5kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:53:37.736550Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107041 (8 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 9.2kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:53:42.736826Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107041 (8 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 8.9kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:53:47.736959Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107042 (8 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 8.1kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:53:52.737094Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107042 (8 peers), best: #0 (0x0c12…1c34), finalized #0 (0x0c12…1c34), ⬇ 7.8kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:53:57.737221Z  INFO Consensus: substrate: ⚙️  Syncing 59.2 bps, target=#2107042 (8 peers), best: #296 (0x2073…4429), finalized #0 (0x0c12…1c34), ⬇ 6.2kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:54:02.737318Z  INFO Consensus: substrate: ⚙️  Syncing 71.0 bps, target=#2107042 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 7.9kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:54:07.737467Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107043 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 10.1kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:54:12.737553Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107043 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 8.2kiB/s ⬆ 1.0kiB/s    
2024-06-25T01:54:17.737687Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107043 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 7.4kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:54:22.737808Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107044 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 7.4kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:54:27.737968Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107045 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 9.1kiB/s ⬆ 1.2kiB/s    
2024-06-25T01:54:32.738114Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107046 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 10.3kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:54:37.738342Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107047 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 7.5kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:54:42.738536Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107047 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 7.2kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:54:47.739209Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107048 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 8.4kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:54:52.739843Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107048 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 5.4kiB/s ⬆ 0.2kiB/s    
2024-06-25T01:54:57.740303Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107048 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 9.9kiB/s ⬆ 0.9kiB/s    
2024-06-25T01:55:02.740675Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107050 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 11.3kiB/s ⬆ 1.0kiB/s    
2024-06-25T01:55:07.741288Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107051 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 7.0kiB/s ⬆ 1.0kiB/s    
2024-06-25T01:55:12.741487Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107052 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 4.5kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:55:17.741738Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107052 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 10.2kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:55:22.742138Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107054 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 9.8kiB/s ⬆ 1.5kiB/s    
2024-06-25T01:55:27.742813Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107054 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 7.1kiB/s ⬆ 0.3kiB/s    
2024-06-25T01:55:32.743027Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107054 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 15.4kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:55:37.743672Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107054 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 5.2kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:55:42.744155Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107055 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 7.3kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:55:47.744379Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107055 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 9.0kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:55:52.744512Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107056 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 7.9kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:55:57.744625Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107057 (8 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 7.6kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:56:02.744702Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107057 (9 peers), best: #651 (0x6a2c…9c1f), finalized #0 (0x0c12…1c34), ⬇ 6.5kiB/s ⬆ 1.7kiB/s   

Full log (part 2)

Logs
2024-06-25T01:56:07.744804Z  INFO Consensus: substrate: ⚙️  Syncing 20.0 bps, target=#2107058 (9 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 8.4kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:56:12.744964Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107058 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 6.5kiB/s ⬆ 0.9kiB/s    
2024-06-25T01:56:17.745129Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107060 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 8.8kiB/s ⬆ 1.2kiB/s    
2024-06-25T01:56:22.745291Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107060 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 13.3kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:56:27.745461Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107061 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 8.6kiB/s ⬆ 0.9kiB/s    
2024-06-25T01:56:32.745680Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107062 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 7.9kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:56:37.745839Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107062 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 7.8kiB/s ⬆ 0.3kiB/s    
2024-06-25T01:56:42.745996Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107062 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 7.6kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:56:47.746612Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107063 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 6.7kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:56:52.747108Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107064 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 8.1kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:56:57.747371Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107066 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 6.7kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:57:02.747660Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107068 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 10.8kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:57:07.748188Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107068 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 9.0kiB/s ⬆ 1.4kiB/s    
2024-06-25T01:57:12.748358Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107070 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 7.8kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:57:17.748779Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107070 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 9.4kiB/s ⬆ 0.9kiB/s    
2024-06-25T01:57:22.749109Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107071 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 10.4kiB/s ⬆ 1.2kiB/s    
2024-06-25T01:57:27.749654Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107072 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 9.0kiB/s ⬆ 1.0kiB/s    
2024-06-25T01:57:32.750340Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107073 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 8.5kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:57:37.750476Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107075 (8 peers), best: #751 (0x9c55…6275), finalized #0 (0x0c12…1c34), ⬇ 8.4kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:57:41.325852Z  INFO Consensus: mmr: Loading MMR from pallet genesis on what appears to be the first startup: 0.    
2024-06-25T01:57:41.325867Z  INFO Consensus: mmr: write aux schema version 1    
2024-06-25T01:57:42.750606Z  INFO Consensus: substrate: ⚙️  Syncing  9.0 bps, target=#2107075 (8 peers), best: #796 (0xf784…78a4), finalized #652 (0xc029…3620), ⬇ 8.5kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:57:47.750779Z  INFO Consensus: substrate: ⚙️  Syncing  1.8 bps, target=#2107077 (8 peers), best: #805 (0x3ccc…505f), finalized #652 (0xc029…3620), ⬇ 5.7kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:57:52.750943Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107077 (8 peers), best: #805 (0x3ccc…505f), finalized #652 (0xc029…3620), ⬇ 8.6kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:57:57.751119Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107078 (8 peers), best: #805 (0x3ccc…505f), finalized #652 (0xc029…3620), ⬇ 7.1kiB/s ⬆ 1.0kiB/s    
2024-06-25T01:58:02.751297Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107078 (8 peers), best: #805 (0x3ccc…505f), finalized #652 (0xc029…3620), ⬇ 9.3kiB/s ⬆ 1.0kiB/s    
2024-06-25T01:58:07.751521Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107078 (8 peers), best: #805 (0x3ccc…505f), finalized #652 (0xc029…3620), ⬇ 5.9kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:58:12.751730Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107080 (8 peers), best: #805 (0x3ccc…505f), finalized #652 (0xc029…3620), ⬇ 8.2kiB/s ⬆ 1.3kiB/s    
2024-06-25T01:58:17.752413Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107082 (8 peers), best: #805 (0x3ccc…505f), finalized #652 (0xc029…3620), ⬇ 8.9kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:58:22.752617Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107083 (8 peers), best: #805 (0x3ccc…505f), finalized #652 (0xc029…3620), ⬇ 5.8kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:58:27.752839Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107083 (8 peers), best: #805 (0x3ccc…505f), finalized #652 (0xc029…3620), ⬇ 5.3kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:58:32.752937Z  INFO Consensus: substrate: ⚙️  Syncing  9.2 bps, target=#2107084 (8 peers), best: #851 (0xb1a7…ed28), finalized #652 (0xc029…3620), ⬇ 10.3kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:58:37.753159Z  INFO Consensus: substrate: ⚙️  Syncing 10.8 bps, target=#2107086 (8 peers), best: #905 (0x8b0b…2bb4), finalized #752 (0x249c…3c4d), ⬇ 10.1kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:58:42.753323Z  INFO Consensus: substrate: ⚙️  Syncing 34.0 bps, target=#2107086 (9 peers), best: #1075 (0xc2fc…a248), finalized #806 (0x2fe2…3bc4), ⬇ 6.3kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:58:47.753441Z  INFO Consensus: substrate: ⚙️  Syncing 144.0 bps, target=#2107086 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 4.1kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:58:52.753615Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107087 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 9.2kiB/s ⬆ 1.2kiB/s    
2024-06-25T01:58:57.753724Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107088 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 5.9kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:59:02.753910Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107090 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 6.5kiB/s ⬆ 0.4kiB/s    
2024-06-25T01:59:07.754105Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107092 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 9.6kiB/s ⬆ 0.3kiB/s    
2024-06-25T01:59:12.754319Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107093 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 5.7kiB/s ⬆ 0.9kiB/s    
2024-06-25T01:59:17.754487Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107095 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 11.6kiB/s ⬆ 0.3kiB/s    
2024-06-25T01:59:22.754697Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107095 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 7.4kiB/s ⬆ 0.6kiB/s    
2024-06-25T01:59:27.754873Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107097 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 8.6kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:59:32.755042Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107098 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 7.9kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:59:37.755564Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107098 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 6.7kiB/s ⬆ 0.7kiB/s    
2024-06-25T01:59:42.755723Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107100 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 7.0kiB/s ⬆ 1.0kiB/s    
2024-06-25T01:59:47.756141Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107101 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 9.4kiB/s ⬆ 0.8kiB/s    
2024-06-25T01:59:52.756315Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107101 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 8.1kiB/s ⬆ 0.5kiB/s    
2024-06-25T01:59:57.756669Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107102 (9 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 9.0kiB/s ⬆ 0.6kiB/s    
2024-06-25T02:00:02.756848Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107105 (10 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 9.4kiB/s ⬆ 1.4kiB/s    
2024-06-25T02:00:07.757166Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107106 (10 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 5.9kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:00:12.757377Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107107 (10 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 9.4kiB/s ⬆ 0.5kiB/s    
2024-06-25T02:00:17.757765Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107109 (10 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 11.9kiB/s ⬆ 0.4kiB/s    
2024-06-25T02:00:22.758101Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107109 (10 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 8.9kiB/s ⬆ 0.2kiB/s    
2024-06-25T02:00:27.758216Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107110 (10 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 8.9kiB/s ⬆ 0.6kiB/s    
2024-06-25T02:00:32.758344Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107110 (10 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 9.9kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:00:37.758471Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107111 (10 peers), best: #1795 (0xc459…1e1a), finalized #806 (0x2fe2…3bc4), ⬇ 11.6kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:00:42.758594Z  INFO Consensus: substrate: ⚙️  Syncing 13.8 bps, target=#2107112 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 8.6kiB/s ⬆ 0.8kiB/s    
2024-06-25T02:00:47.758737Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107112 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 10.8kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:00:52.758862Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107113 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 10.8kiB/s ⬆ 0.3kiB/s    
2024-06-25T02:00:57.759020Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107113 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 13.1kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:01:02.759194Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107115 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 9.2kiB/s ⬆ 0.3kiB/s    
2024-06-25T02:01:07.759344Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107116 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 6.2kiB/s ⬆ 0.4kiB/s    
2024-06-25T02:01:12.759488Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107116 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 8.2kiB/s ⬆ 0.4kiB/s    
2024-06-25T02:01:17.759637Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107117 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 6.0kiB/s ⬆ 0.3kiB/s    
2024-06-25T02:01:22.759879Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107118 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 9.6kiB/s ⬆ 0.5kiB/s    
2024-06-25T02:01:27.760101Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107119 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 8.9kiB/s ⬆ 0.5kiB/s    
2024-06-25T02:01:32.760211Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107120 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 10.4kiB/s ⬆ 1.3kiB/s    
2024-06-25T02:01:37.760331Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107121 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 8.3kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:01:42.760455Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107121 (10 peers), best: #1864 (0xc5ff…9e0c), finalized #806 (0x2fe2…3bc4), ⬇ 9.3kiB/s ⬆ 0.6kiB/s    
2024-06-25T02:01:47.760689Z  INFO Consensus: substrate: ⚙️  Syncing  3.2 bps, target=#2107122 (10 peers), best: #1880 (0xbb7b…87a7), finalized #806 (0x2fe2…3bc4), ⬇ 11.5kiB/s ⬆ 0.4kiB/s    
2024-06-25T02:01:52.760865Z  INFO Consensus: substrate: ⚙️  Syncing  3.0 bps, target=#2107122 (10 peers), best: #1895 (0x1f84…38d8), finalized #806 (0x2fe2…3bc4), ⬇ 7.9kiB/s ⬆ 0.9kiB/s    
2024-06-25T02:01:57.761014Z  INFO Consensus: substrate: ⚙️  Syncing  5.2 bps, target=#2107123 (10 peers), best: #1921 (0xc111…a7a3), finalized #1796 (0x9c5f…393f), ⬇ 10.6kiB/s ⬆ 0.4kiB/s    
2024-06-25T02:02:02.761148Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107123 (10 peers), best: #1921 (0xc111…a7a3), finalized #1796 (0x9c5f…393f), ⬇ 6.6kiB/s ⬆ 0.2kiB/s    
2024-06-25T02:02:07.761280Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107124 (10 peers), best: #1921 (0xc111…a7a3), finalized #1796 (0x9c5f…393f), ⬇ 6.5kiB/s ⬆ 0.4kiB/s    
2024-06-25T02:02:12.761440Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107125 (10 peers), best: #1921 (0xc111…a7a3), finalized #1796 (0x9c5f…393f), ⬇ 8.6kiB/s ⬆ 0.4kiB/s    
2024-06-25T02:02:17.761607Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107126 (10 peers), best: #1921 (0xc111…a7a3), finalized #1796 (0x9c5f…393f), ⬇ 12.9kiB/s ⬆ 0.5kiB/s    
2024-06-25T02:02:22.761758Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107127 (10 peers), best: #1921 (0xc111…a7a3), finalized #1796 (0x9c5f…393f), ⬇ 12.2kiB/s ⬆ 1.7kiB/s    
2024-06-25T02:02:27.761958Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107127 (13 peers), best: #1921 (0xc111…a7a3), finalized #1796 (0x9c5f…393f), ⬇ 14.5kiB/s ⬆ 2.9kiB/s    
2024-06-25T02:02:32.762420Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107129 (14 peers), best: #1921 (0xc111…a7a3), finalized #1796 (0x9c5f…393f), ⬇ 12.0kiB/s ⬆ 1.2kiB/s    
2024-06-25T02:02:37.762629Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107129 (14 peers), best: #1921 (0xc111…a7a3), finalized #1796 (0x9c5f…393f), ⬇ 19.2kiB/s ⬆ 1.3kiB/s    
2024-06-25T02:02:42.762830Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107131 (14 peers), best: #1921 (0xc111…a7a3), finalized #1796 (0x9c5f…393f), ⬇ 16.9kiB/s ⬆ 1.7kiB/s    
2024-06-25T02:02:47.762939Z  INFO Consensus: substrate: ⚙️  Syncing  8.6 bps, target=#2107131 (15 peers), best: #1964 (0xc9e6…bd40), finalized #1796 (0x9c5f…393f), ⬇ 11.7kiB/s ⬆ 0.5kiB/s    
2024-06-25T02:02:52.763072Z  INFO Consensus: substrate: ⚙️  Syncing  1.0 bps, target=#2107132 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 13.3kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:02:57.763251Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107132 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 12.9kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:03:02.763364Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107133 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 14.0kiB/s ⬆ 0.6kiB/s    
2024-06-25T02:03:07.763943Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107133 (16 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 13.0kiB/s ⬆ 3.7kiB/s    
2024-06-25T02:03:12.764110Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107133 (16 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 10.8kiB/s ⬆ 0.9kiB/s    
2024-06-25T02:03:17.764299Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107134 (16 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 10.6kiB/s ⬆ 1.1kiB/s    
2024-06-25T02:03:22.764789Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107135 (16 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 13.4kiB/s ⬆ 1.8kiB/s    
2024-06-25T02:03:27.765142Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107135 (16 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 12.3kiB/s ⬆ 1.2kiB/s    
2024-06-25T02:03:32.765277Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107136 (16 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 14.3kiB/s ⬆ 1.4kiB/s    
2024-06-25T02:03:37.765456Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107136 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 17.2kiB/s ⬆ 2.3kiB/s    
2024-06-25T02:03:42.765663Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107138 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 12.0kiB/s ⬆ 0.8kiB/s    
2024-06-25T02:03:47.765795Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107140 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 12.3kiB/s ⬆ 1.1kiB/s    
2024-06-25T02:03:52.765990Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107141 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 14.1kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:03:57.766463Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107142 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 12.9kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:04:02.766594Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107143 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 13.0kiB/s ⬆ 1.1kiB/s    
2024-06-25T02:04:07.766757Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107143 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 14.0kiB/s ⬆ 1.2kiB/s    
2024-06-25T02:04:12.766951Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107145 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 16.3kiB/s ⬆ 1.3kiB/s    
2024-06-25T02:04:17.767091Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107146 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 15.4kiB/s ⬆ 1.5kiB/s    
2024-06-25T02:04:22.767183Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107146 (15 peers), best: #1969 (0x4a18…a79d), finalized #1865 (0x12d3…6145), ⬇ 11.3kiB/s ⬆ 1.1kiB/s    
2024-06-25T02:04:27.767331Z  INFO Consensus: substrate: ⚙️  Syncing  9.0 bps, target=#2107147 (15 peers), best: #2014 (0xafe4…2bd1), finalized #1865 (0x12d3…6145), ⬇ 15.9kiB/s ⬆ 2.2kiB/s    
2024-06-25T02:04:32.767549Z  INFO Consensus: substrate: ⚙️  Syncing  1.4 bps, target=#2107148 (15 peers), best: #2021 (0x79da…5df1), finalized #1865 (0x12d3…6145), ⬇ 17.6kiB/s ⬆ 1.4kiB/s    
2024-06-25T02:04:37.767907Z  INFO Consensus: substrate: ⚙️  Syncing  0.2 bps, target=#2107149 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 13.2kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:04:42.768052Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107150 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 10.7kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:04:47.768189Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107151 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 11.3kiB/s ⬆ 0.6kiB/s    
2024-06-25T02:04:52.768370Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107153 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 10.4kiB/s ⬆ 0.9kiB/s    
2024-06-25T02:04:57.768560Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107153 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 11.0kiB/s ⬆ 0.6kiB/s    
2024-06-25T02:05:02.768771Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107153 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 15.3kiB/s ⬆ 2.3kiB/s    
2024-06-25T02:05:07.769172Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107154 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 10.5kiB/s ⬆ 0.9kiB/s    
2024-06-25T02:05:12.769376Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107154 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 12.6kiB/s ⬆ 2.0kiB/s    
2024-06-25T02:05:17.769514Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107155 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 18.5kiB/s ⬆ 1.0kiB/s    
2024-06-25T02:05:22.769634Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107157 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 15.8kiB/s ⬆ 1.8kiB/s    
2024-06-25T02:05:27.769748Z  INFO Consensus: substrate: ⚙️  Syncing  0.0 bps, target=#2107157 (15 peers), best: #2022 (0xd29b…8124), finalized #1922 (0xb57b…dd1c), ⬇ 11.0kiB/s ⬆ 0.9kiB/s    
2024-06-25T02:05:32.769893Z  INFO Consensus: substrate: ⚙️  Syncing  2.0 bps, target=#2107157 (15 peers), best: #2032 (0x98fc…9604), finalized #1922 (0xb57b…dd1c), ⬇ 8.1kiB/s ⬆ 0.7kiB/s    
2024-06-25T02:05:37.770118Z  INFO Consensus: substrate: ⚙️  Syncing  7.4 bps, target=#2107157 (15 peers), best: #2069 (0xae42…9152), finalized #1922 (0xb57b…dd1c), ⬇ 16.0kiB/s ⬆ 1.7kiB/s    
thread 'tokio-runtime-worker' panicked at /home/ubuntu/actions-runner/_work/subspace/subspace/crates/sc-consensus-subspace/src/archiver.rs:948:10:
Older block by number must always exist
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
2024-06-25T02:05:38.794057Z ERROR Consensus: sc_service::task_manager: Essential task `subspace-archiver` failed. Shutting down service.    
2024-06-25T02:05:38.798115Z ERROR Consensus: sc_service::client::client: Unable to send AnnouncePin worker message for import: sending into a closed channel    
Error: SubstrateService(Other("Essential task failed."))

Hm… please use environment variable I specified above and upload logs to something like pastebin.com, gist.github.com or similar (it will be large with that log level). Something interesting is happening here.

Also thanks for providing full node command, I see you’re also trying to sync a domain, that is a very important detail!

Tried jun-18 release software with your command:

2024-06-25T12:07:20.987100Z INFO Consensus: substrate: :gear: Syncing 0.0 bps, target=#2113340 (7 peers), best: #11317 (0x03b1…78c2), finalized #11186 (0x6f93…f66c), :arrow_down: 5.1kiB/s :arrow_up: 0.9kiB/s

Then tried code of upcoming release with newer Substrate release:

2024-06-25T11:46:42.476516Z INFO Consensus: substrate: :gear: Syncing 0.0 bps, target=#2113155 (40 peers), best: #11249 (0xc77e…faa8), finalized #11126 (0xa40a…a0e7), :arrow_down: 70.0kiB/s :arrow_up: 1.1kiB/s

Can’t reproduce, will need your help with detailed logs.

It seems something wrong with my Ubuntu install.
I install Windows 11 to same PC and try to sync with same command, the error is gone.

Very interesting. I’m running on Ubuntu 24.04, but 20.04 and 22.04 should work exactly the same too :thinking: