how can i reasonable used my memory about slm-lab

[kengz]

pasted from #385

If i have 20 CPUS, 10 envs, 5 sessions, then it will starup 50 process with 20 CPUS, i consider it is not reasonable, am i right ? how can i fullly and reasonable use my CPU resource?

[kengz]

resource allocation with the search module works like so:

1. ray detects how many CPUs you have, say 20 in total. This is the compute budget.
2. resource setting u saw in search.py is per trial. If a trial has 3 sessions, it assigns 3 CPUs. So, it can assign 6 trials to utilize 18 CPUs within its budget.

All these assume that environments are very light on CPUs and RAM (memory). If your environment is requires more resources, you can limit the number of trials ran in parallel by changing the line with a multiplier to allocate more per trial:

# either scale by ur num envs if it dominates the resources
multiplier = ps.get(spec, 'env.0.num_envs') * 0.2
# or simply set a convenient number for your use case
multiplier = 4
num_cpus = min(util.NUM_CPUS, meta_spec['max_session'] * multiplier)

Then, a trial with 3 sessions will use 12 CPUs, and so only 1 trial gets ran at a time. This will allocate the budget more reasonably for your use case

[lidongke]

I advise u to expose "multiplier" to out , so that we can more reasonably use more envs that not light.

[kengz]

good suggestion. will do so hopefully sometime this weekend