As suspected and commented on Discord this seems to be related to the fact that there are fewer threads available now.
Looking at these lines:
2023-10-03T19:20:20.021291Z DEBUG single_disk_farm{disk_farm_index=0}: subspace_farmer::single_disk_farm: New slot slot_info=SlotInfo { slot_number: 1696360820, global_challenge: [103, 80, 43, 172, 189, 80, 91, 45, 9, 17, 91, 178, 115, 44, 222, 215, 226, 36, 218, 23, 149, 216, 117, 40, 127, 159, 149, 8, 230, 232, 232, 114], solution_range: 476796041, voting_solution_range: 4767960410 }
2023-10-03T19:20:20.021338Z DEBUG single_disk_farm{disk_farm_index=5}: subspace_farmer::single_disk_farm: New slot slot_info=SlotInfo { slot_number: 1696360820, global_challenge: [103, 80, 43, 172, 189, 80, 91, 45, 9, 17, 91, 178, 115, 44, 222, 215, 226, 36, 218, 23, 149, 216, 117, 40, 127, 159, 149, 8, 230, 232, 232, 114], solution_range: 476796041, voting_solution_range: 4767960410 }
2023-10-03T19:20:20.021348Z DEBUG single_disk_farm{disk_farm_index=1}: subspace_farmer::single_disk_farm: New slot slot_info=SlotInfo { slot_number: 1696360820, global_challenge: [103, 80, 43, 172, 189, 80, 91, 45, 9, 17, 91, 178, 115, 44, 222, 215, 226, 36, 218, 23, 149, 216, 117, 40, 127, 159, 149, 8, 230, 232, 232, 114], solution_range: 476796041, voting_solution_range: 4767960410 }
2023-10-03T19:20:20.021358Z DEBUG single_disk_farm{disk_farm_index=3}: subspace_farmer::single_disk_farm: New slot slot_info=SlotInfo { slot_number: 1696360820, global_challenge: [103, 80, 43, 172, 189, 80, 91, 45, 9, 17, 91, 178, 115, 44, 222, 215, 226, 36, 218, 23, 149, 216, 117, 40, 127, 159, 149, 8, 230, 232, 232, 114], solution_range: 476796041, voting_solution_range: 4767960410 }
2023-10-03T19:20:20.021366Z DEBUG single_disk_farm{disk_farm_index=2}: subspace_farmer::single_disk_farm: New slot slot_info=SlotInfo { slot_number: 1696360820, global_challenge: [103, 80, 43, 172, 189, 80, 91, 45, 9, 17, 91, 178, 115, 44, 222, 215, 226, 36, 218, 23, 149, 216, 117, 40, 127, 159, 149, 8, 230, 232, 232, 114], solution_range: 476796041, voting_solution_range: 4767960410 }
2023-10-03T19:20:20.021375Z DEBUG single_disk_farm{disk_farm_index=4}: subspace_farmer::single_disk_farm: New slot slot_info=SlotInfo { slot_number: 1696360820, global_challenge: [103, 80, 43, 172, 189, 80, 91, 45, 9, 17, 91, 178, 115, 44, 222, 215, 226, 36, 218, 23, 149, 216, 117, 40, 127, 159, 149, 8, 230, 232, 232, 114], solution_range: 476796041, voting_solution_range: 4767960410 }
2023-10-03T19:20:20.021549Z DEBUG subspace_farmer::single_disk_farm::farming: Reading sectors slot=1696360820 sector_count=1404
2023-10-03T19:20:20.237522Z DEBUG subspace_farmer::single_disk_farm::farming: Reading sectors slot=1696360820 sector_count=210
2023-10-03T19:20:20.315463Z DEBUG subspace_farmer::single_disk_farm::farming: Reading sectors slot=1696360820 sector_count=889
2023-10-03T19:20:20.461547Z DEBUG subspace_farmer::single_disk_farm::farming: Reading sectors slot=1696360820 sector_count=702
2023-10-03T19:20:20.591070Z DEBUG subspace_farmer::single_disk_farm::farming: Reading sectors slot=1696360820 sector_count=702
2023-10-03T19:20:20.720081Z DEBUG subspace_farmer::single_disk_farm::farming: Reading sectors slot=1696360820 sector_count=702
We can see that there is at least 700ms gap between farmer receiving the notification that it is time to farm and even starting to audit some sectors.
Given that you have 5 farms and 13700K processor, older releases would have created 5*24=120 threads for auditing purposes. Can you try to start farmer with --farming-thread-pool-size=120
and see if it makes a difference? If not proving similar logs with debug information would help.