Snapshot build: #355
Run time: Panics at start
Observations
Not able to start farmers. Was able to replicate by trying to start up all farmers a second time.
Immediately presented with the following in logs:
2024-06-19T07:30:41.590143Z INFO async_nats: event: connected
2024-06-19T07:30:41.590355Z INFO subspace_farmer::node_client::caching_proxy_node_client: Downloading all segment headers from node...
2024-06-19T07:30:41.594393Z INFO subspace_farmer::node_client::caching_proxy_node_client: Downloaded all segment headers from node successfully
2024-06-19T07:30:41.595067Z WARN subspace_farmer::cluster::nats_client: Response decoding failed subject=subspace.controller.farmer-app-info error=Could not decode `FarmerAppInfo::dsn_bootstrap_nodes`:
Not enough data to decode vector
response_type=subspace_rpc_primitives::FarmerAppInfo response=000c121c75f4ef450f40619e1fca9d1e8e7fbabc42c895bc4790801e85d5a91c340851013526626f6f7473747261702d302e67656d696e692d33682e73756273706163652e6e6574776f7
26b067745a503260024080112208a14e2e34ca54655d434e8be77ff9c0be790ba18f2a8b80ab3022b05b8852f4851013526626f6f7473747261702d312e67656d696e692d33682e73756273706163652e6e6574776f726b067745a50326002408011220d75bd75b67119
4ae5845c617f79fad042633af4e333ccd58cc01d43d7998750a000400000000000000000000003501000000000000e803050000000000000001000000000000000a000000000000000400000000000000
Error: Failed to create caching proxy node client: Failed to get farmer app info: request failed
System Specs
Role: NATS (nats.log)
Dual Socket 2680v3 24 cores (48 threads)
Link: 20Gbit
Role: Cache, Controller, Plotter, Farmer (cache.log controller.log plotter.log farmer1.log)
Dual Socket 7742 128 cores (256 threads)
Cache: 100GiB
Plots: 109T
Link: 100Gbit
Role: Node (node.log)
EPYC 7F72 24 Cores (48 Threads)
Plots: 0
Link: 100Gbit
Role: Farmer (farmer3.log)
Dual Socket 2687v4 24 cores (48 threads)
Plots:189T
Link: 20Gbit
Role: Farmer (farmer4.log)
Dual Socket 2697A 32 Cores (64 Threads)
Plots:189T
Link: 20Gbit
Role: Farmer (farmer6.log)
Dual Socket 6136 24 Cores (48 Threads)
Plots 91TB
Link: 20Gbit
Logs
Cluster