I am currently using the JupyterLab that you provide, and I was wondering how many nodes we are each allowed to use when running code in parallel using modules like multiprocess or pathos in python?
The Lab service isn't meant for such large computations in general. The limit is 1 CPU (on 1 node). If you want to run very expensive calculations, it may be better to think about using the Lab to extract the relevant data, then running the analysis on your local cluster.
That is good to know. Thank you!