Farmers are unable to plot with the Advanced CLI

Support
, ,
1

Issue Report

Farmers are unable to cultivate

Environment

ubuntu-22.04.1

  • Operating System:
    Farmers are unable to cultivate
  • CPU Architecture:
    5950X
  • RAM:
    128G
  • Storage:
    2TB
  • Plot Size:
    100G
  • Subspace Deployment Method:
    Advanced CLI

Problem

Steps to reproduce

Expected result

What happens instead

[Paste error here]
=3
2023-07-04T10:56:15.239391Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=219
2023-07-04T10:56:15.250345Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=25 current_attempt=3 max_retries=3
2023-07-04T10:56:15.250378Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=219
2023-07-04T10:56:15.250392Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=25
2023-07-04T10:56:15.261086Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=25
2023-07-04T10:56:15.275407Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=245 current_attempt=3 max_retries=3
2023-07-04T10:56:15.275431Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=245
2023-07-04T10:56:15.286443Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=3 current_attempt=3 max_retries=3
2023-07-04T10:56:15.286468Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=245
2023-07-04T10:56:15.286475Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=3
2023-07-04T10:56:15.296931Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=3
2023-07-04T10:56:15.346251Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=10 current_attempt=3 max_retries=3
2023-07-04T10:56:15.346274Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=10
2023-07-04T10:56:15.357022Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=250 current_attempt=3 max_retries=3
2023-07-04T10:56:15.357054Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=10
2023-07-04T10:56:15.357068Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=250
2023-07-04T10:56:15.367937Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=250
2023-07-04T10:56:15.458920Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=187 current_attempt=3 max_retries=3
2023-07-04T10:56:15.458943Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=187
2023-07-04T10:56:15.469798Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=187
2023-07-04T10:56:15.496540Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=44 current_attempt=3 max_retries=3
2023-07-04T10:56:15.496563Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=44
2023-07-04T10:56:15.507450Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=44
2023-07-04T10:56:15.529756Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=102 current_attempt=3 max_retries=3
2023-07-04T10:56:15.529781Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=102
2023-07-04T10:56:15.540205Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=102
2023-07-04T10:56:15.540231Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=32 current_attempt=3 max_retries=3
2023-07-04T10:56:15.540242Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=32
2023-07-04T10:56:15.551190Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=32
2023-07-04T10:56:15.617826Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=198 current_attempt=3 max_retries=3
2023-07-04T10:56:15.617849Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=198
2023-07-04T10:56:15.628841Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=80 current_attempt=3 max_retries=3
2023-07-04T10:56:15.628868Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=96 current_attempt=3 max_retries=3
2023-07-04T10:56:15.628882Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=198
2023-07-04T10:56:15.628889Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=80
2023-07-04T10:56:15.639666Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=80
2023-07-04T10:56:15.639691Z  INFO single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece... missing_piece_index=96
2023-07-04T10:56:15.650507Z ERROR single_disk_plot{disk_farm_index=0}: subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=57 current_attempt=3 max_retries=3
2023-07-04T10:56:15.650536Z ERROR single_disk_plot{disk_farm_index=0}: subspace_farmer_components::segment_reconstruction: Recovering missing piece failed. missing_piece_index=96
2023-07-04T10:56:15.664677Z  WARN single_disk_plot{disk_farm_index=0}: subspace_farmer_components::plotting: Sector plotting attempt failed, will retry later sector_offset=0 sector_index=7251872623420517445 error=Failed to retrieve piece 96: Not enough pieces to reconstruct a segment
2023-07-04T10:56:17.435193Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=140 current_attempt=1 max_retries=1
2023-07-04T10:56:19.738516Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=141 current_attempt=1 max_retries=1
2023-07-04T10:56:22.340110Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=142 current_attempt=1 max_retries=1
2023-07-04T10:56:26.401279Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=143 current_attempt=1 max_retries=1
2023-07-04T10:56:29.733711Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=144 current_attempt=1 max_retries=1
2023-07-04T10:56:33.861660Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=145 current_attempt=1 max_retries=1
2023-07-04T10:56:37.040309Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=146 current_attempt=1 max_retries=1
2023-07-04T10:56:40.969254Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=147 current_attempt=1 max_retries=1
2023-07-04T10:56:45.277810Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=148 current_attempt=1 max_retries=1
2023-07-04T10:56:47.620505Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=149 current_attempt=1 max_retries=1
2023-07-04T10:56:51.534452Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=150 current_attempt=1 max_retries=1
2023-07-04T10:56:53.134224Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=151 current_attempt=1 max_retries=1
2023-07-04T10:56:56.717102Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=152 current_attempt=1 max_retries=1
2023-07-04T10:56:58.752367Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=153 current_attempt=1 max_retries=1
2023-07-04T10:57:01.411992Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=154 current_attempt=1 max_retries=1
2023-07-04T10:57:05.377798Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=155 current_attempt=1 max_retries=1
2023-07-04T10:57:07.374802Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=156 current_attempt=1 max_retries=1
2023-07-04T10:57:11.763510Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=157 current_attempt=1 max_retries=1
2023-07-04T10:57:14.593048Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=158 current_attempt=1 max_retries=1
2023-07-04T10:57:17.475635Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=159 current_attempt=1 max_retries=1
2023-07-04T10:57:21.391570Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=160 current_attempt=1 max_retries=1
2023-07-04T10:57:25.632943Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=161 current_attempt=1 max_retries=1
2023-07-04T10:57:27.138318Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=162 current_attempt=1 max_retries=1
2023-07-04T10:57:30.231952Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=163 current_attempt=1 max_retries=1
2023-07-04T10:57:33.354424Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=164 current_attempt=1 max_retries=1
2023-07-04T10:57:36.055185Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=165 current_attempt=1 max_retries=1
2023-07-04T10:57:39.772457Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=166 current_attempt=1 max_retries=1
2023-07-04T10:57:43.913387Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=167 current_attempt=1 max_retries=1
2023-07-04T10:57:46.082884Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=168 current_attempt=1 max_retries=1
2023-07-04T10:57:49.581047Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=169 current_attempt=1 max_retries=1
2023-07-04T10:57:51.381901Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=170 current_attempt=1 max_retries=1
2023-07-04T10:57:55.442973Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=171 current_attempt=1 max_retries=1
2023-07-04T10:57:58.989459Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=172 current_attempt=1 max_retries=1
2023-07-04T10:58:02.963106Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=173 current_attempt=1 max_retries=1
2023-07-04T10:58:07.158623Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=174 current_attempt=1 max_retries=1
2023-07-04T10:58:08.681199Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=175 current_attempt=1 max_retries=1
2023-07-04T10:58:12.035441Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=176 current_attempt=1 max_retries=1
2023-07-04T10:58:15.332006Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=177 current_attempt=1 max_retries=1
2023-07-04T10:58:17.665133Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=178 current_attempt=1 max_retries=1
2023-07-04T10:58:22.087016Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=179 current_attempt=1 max_retries=1
2023-07-04T10:58:24.931622Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=180 current_attempt=1 max_retries=1
2023-07-04T10:58:29.242371Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=181 current_attempt=1 max_retries=1
2023-07-04T10:58:31.367094Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=182 current_attempt=1 max_retries=1
2023-07-04T10:58:33.578927Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=183 current_attempt=1 max_retries=1
2023-07-04T10:58:36.489757Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=184 current_attempt=1 max_retries=1
2023-07-04T10:58:39.619142Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=185 current_attempt=1 max_retries=1
2023-07-04T10:58:42.370785Z ERROR subspace_networking::utils::piece_provider: Couldn't get a piece from DSN. No retries left. piece_index=186 current_attempt=1 max_retries=1
2

I also join the issue.

CPU Architecture:
Intel 11700
RAM:
32G
Storage:
250GB
Plot Size:
100G
Subspace Deployment Method:
Advanced CLI
Steps to reproduce

  1. Waiting
  2. Restart

Expected result
No

1
11328Γ—1132 137 KB

2
21304Γ—1092 125 KB

3
31300Γ—888 104 KB

4
41305Γ—1169 141 KB

3

I am also seeing this problem with the Advanced CLI. Tried with jun-30 and jul-03 with the same result. Logs can be found here node & farmer.

4

Same issue here. No rewards on 3e, advanced CLI. Seems to be a known issue with both Docker and Advanced CLI: Discord

image
image1920Γ—222 90.7 KB

o

5

Those errors can be ignored, its a networking error and while annoying the program will continue to retry and eventually succeed, you can try restarting your farmer/node to help but its usually best to wait it out

6

Thanks @ImmaZoni. I’m a bit confused though since on Discord you mentioned an issue with the reference implementation used in Docker and Advanced CLI, and advised temporarily switching over to the Simple CLI.
Also I still see no rewards

7

@ImmaZoni

Blockquote
Those errors can be ignored, its a networking error and while annoying the program will continue to retry and eventually succeed, you can try restarting your farmer/node to help but its usually best to wait it out

Π‘Π½ΠΈΠΌΠΎΠΊ экрана 2023-07-12 Π² 19.17.57
Π‘Π½ΠΈΠΌΠΎΠΊ экрана 2023-07-12 Π² 19.17.571724Γ—1240 312 KB

Unfortunately, I had this error going on for 8 hours. What I did:
wipe plott
wipe summary
wipe node
format disk for plott
aaaaand…
N O T H I N G
The error is still present

8

Also in a same boat

CPU Architecture:
AMD EPYC 7282
RAM:
8G
Storage:
800GB
Plot Size:
800G
Subspace Deployment Method:
Advanced CLI

image
image1637Γ—955 223 KB

1 Like
9

Welcome to our club!) :smile:

10

Sorry for any confusion @edbaff1ed its been an evolving situation :sweat_smile:

We are looking into an issue with our plotting which is effecting rewards. We have a master forum post where we are gathers some details, but the development team is aware and currently exploring and testing some fixes. I hope to have a more productive update for you soon :slightly_smiling_face:

1 Like