Extremely slow in instantiating FL runner about federatedscope

[rayrayraykk]

This happens due to the GIL when the main process takes up too many timeslices and subthreads hardly obtain timeslices causing the Dataloader built slowly:

FederatedScope/federatedscope/autotune/algos.py

Line 118 in b0c0bc9

while not flags[available_worker].is_set():

We can add a time.sleep(1) to avoid this in

  for i, config in enumerate(configs):
      available_worker = 0
      while not flags[available_worker].is_set():
          available_worker = (available_worker + 1) % len(threads)
          # Add this line
          time.sleep(1)

Due to the workaround has been merged, we could fix this in the future.

[joneswong]

This pr is just a workaround. We need to locate what causes this issue in the future.