Farmer hangs at "Finished piece cache synchronization" for very long time

Support
1

Issue Report

Farmer hangs there for more than 12 hours for 300GB farming.
What is it doing and when will it start next step.

Environment

  • Operating System: Ubuntu 18.04 ARM64
  • Pulsar/Advanced CLI/Docker: CLI

Problem

[Paste any errors or relevant logs here]
2024-03-29T07:35:27.932097Z  INFO subspace_farmer::commands::farm: Connecting to node RPC url=ws://192.168.0.11:9944
2024-03-29T07:35:27.945439Z  INFO subspace_networking::constructor: DSN instance configured. allow_non_global_addresses_in_dht=true peer_id=12D3KooWRSeKhhrWJBogDvjD65oQakbBwPhCX5x7N2PrRKjMPTJ7 protocol_version=/subspace/2/0c121c75f4ef450f40619e1fca9d1e8e7fbabc42c895bc4790801e85d5a91c34
2024-03-29T07:35:27.950715Z  INFO libp2p_swarm: local_peer_id=12D3KooWRSeKhhrWJBogDvjD65oQakbBwPhCX5x7N2PrRKjMPTJ7
2024-03-29T07:35:28.406037Z  INFO subspace_farmer::single_disk_farm::plot_cache: Checking plot cache contents, this can take a while
2024-03-29T07:35:28.406481Z  INFO subspace_farmer::single_disk_farm::plot_cache: Finished checking plot cache contents
2024-03-29T07:35:28.407461Z  INFO {farm_index=0}: subspace_farmer::single_disk_farm: Benchmarking faster proving method
2024-03-29T07:35:30.699244Z  INFO {farm_index=0}: subspace_farmer::single_disk_farm: Faster proving method found fastest_mode=ConcurrentChunks
2024-03-29T07:35:30.699663Z  INFO {farm_index=0}: subspace_farmer::commands::farm: Farm 0:
2024-03-29T07:35:30.699687Z  INFO {farm_index=0}: subspace_farmer::commands::farm:   ID: 01HSSQQAA2FPGNH56A4A242WBT
2024-03-29T07:35:30.699694Z  INFO {farm_index=0}: subspace_farmer::commands::farm:   Genesis hash: 0x0c121c75f4ef450f40619e1fca9d1e8e7fbabc42c895bc4790801e85d5a91c34
2024-03-29T07:35:30.699701Z  INFO {farm_index=0}: subspace_farmer::commands::farm:   Public key: 0x40206e2ea11cf4ba2a505e8112c88e83f1ab2c57dfabeb1edb5647d177fa021b
2024-03-29T07:35:30.699855Z  INFO {farm_index=0}: subspace_farmer::commands::farm:   Allocated space: 300.0 GiB (322.1 GB)
2024-03-29T07:35:30.699863Z  INFO {farm_index=0}: subspace_farmer::commands::farm:   Directory: /home/fact/subspace/farm/
2024-03-29T07:35:30.699962Z  INFO subspace_farmer::farmer_cache: Initializing piece cache
2024-03-29T07:35:30.700000Z  INFO subspace_farmer::commands::farm: Collecting already plotted pieces (this will take some time)...
2024-03-29T07:35:30.752675Z  INFO subspace_farmer::commands::farm: Finished collecting already plotted pieces successfully
2024-03-29T07:35:30.753286Z  INFO {farm_index=0}: subspace_farmer::single_disk_farm::farming: Subscribing to slot info notifications
2024-03-29T07:35:30.753315Z  INFO {farm_index=0}: subspace_farmer::reward_signing: Subscribing to reward signing notifications
2024-03-29T07:35:30.753447Z  INFO {farm_index=0}: subspace_farmer::single_disk_farm::plotting: Subscribing to archived segments
2024-03-29T07:35:30.754138Z  INFO subspace_farmer::commands::farm::dsn: DSN listening on /ip4/127.0.0.1/udp/30533/quic-v1/p2p/12D3KooWRSeKhhrWJBogDvjD65oQakbBwPhCX5x7N2PrRKjMPTJ7
2024-03-29T07:35:30.754630Z  INFO subspace_farmer::commands::farm::dsn: DSN listening on /ip6/::1/udp/30533/quic-v1/p2p/12D3KooWRSeKhhrWJBogDvjD65oQakbBwPhCX5x7N2PrRKjMPTJ7
2024-03-29T07:35:30.754641Z  INFO subspace_farmer::commands::farm::dsn: DSN listening on /ip4/192.168.0.16/udp/30533/quic-v1/p2p/12D3KooWRSeKhhrWJBogDvjD65oQakbBwPhCX5x7N2PrRKjMPTJ7
2024-03-29T07:35:30.754653Z  INFO subspace_farmer::commands::farm::dsn: DSN listening on /ip6/fe80::8675:948f:4712:f366/udp/30533/quic-v1/p2p/12D3KooWRSeKhhrWJBogDvjD65oQakbBwPhCX5x7N2PrRKjMPTJ7
2024-03-29T07:35:30.754684Z  INFO subspace_farmer::commands::farm::dsn: DSN listening on /ip4/127.0.0.1/tcp/30533/p2p/12D3KooWRSeKhhrWJBogDvjD65oQakbBwPhCX5x7N2PrRKjMPTJ7
2024-03-29T07:35:30.754701Z  INFO subspace_farmer::commands::farm::dsn: DSN listening on /ip6/::1/tcp/30533/p2p/12D3KooWRSeKhhrWJBogDvjD65oQakbBwPhCX5x7N2PrRKjMPTJ7
2024-03-29T07:35:30.754707Z  INFO subspace_farmer::commands::farm::dsn: DSN listening on /ip4/192.168.0.16/tcp/30533/p2p/12D3KooWRSeKhhrWJBogDvjD65oQakbBwPhCX5x7N2PrRKjMPTJ7
2024-03-29T07:35:30.754714Z  INFO subspace_farmer::commands::farm::dsn: DSN listening on /ip6/fe80::8675:948f:4712:f366/tcp/30533/p2p/12D3KooWRSeKhhrWJBogDvjD65oQakbBwPhCX5x7N2PrRKjMPTJ7
2024-03-29T07:35:33.767056Z  INFO subspace_farmer::farmer_cache: Synchronizing piece cache
2024-03-29T07:35:33.777311Z  INFO subspace_farmer::farmer_cache: Finished piece cache synchronization
2

That is exactly what logs should look like if you have completed plotting. It will print a message when reward is signed, but it will not be too frequent with such plot size.