Increasing worker count on existing clusters

[MKoesters]

Hi,

I used bibigrid to deploy a cluster with a number of workers.
It turned out, that I underestimated the number of workers I actually need.
Is there a way to increase the number of workers using the bibigrid CLI?

I would prefer to just increase the number of workers in the config and then rerun the deployment.
It should result in adding and configuring the additional workers without touching the existing ones.

Is something like this already possible?
If not is this planned?

If you have any ideas on that, I'd be willing to look into it given I have some spare time to work on that.

Best
Manuel

[XaverStiensmeier]

I apologize for the late reply!

In general this should be integrated in the update function at some point. At the moment I do not have the time to implement it, but it is planned.

The update function fell a bit behind in development #733 but what it does is update the playbook and the configuration files - it had its limitations and again fell a bit behind in development. By updating all configuration files and starting the necessary workers (if on demand false) and then rolling out the playbook again, updating the deployment is possible.

Once it has been implemented in the update function, I would expect a BiBiGrid cluster updated using a configuration to look as if it had been created using that configuration.

Potential issues could be updating the Slurm version while jobs are running, but usually in the Slurm changelog it states that you can update from close enough versions without issue.

Again, I apologize for missing this and if you intend to work on it, I am more than happy to review it.