Hi Deco! I did not end up using LLMSwarm. As far as I understand, it's particularly useful when you have multiple GPUs and you can parallelize the computations (for eg. when creating the datasets). I was using only one GPU on Google Colab for my setup, so it didn't seem to fit my use case.
I haven't yet published my code for this—it's a bit messy and I was hoping to streamline it when I get the time before making it public. However, I'd be happy to give you (or anyone) access in the meantime, if they are in a hurry and want to take a look.
Hi Deco! I did not end up using LLMSwarm. As far as I understand, it's particularly useful when you have multiple GPUs and you can parallelize the computations (for eg. when creating the datasets). I was using only one GPU on Google Colab for my setup, so it didn't seem to fit my use case.
I haven't yet published my code for this—it's a bit messy and I was hoping to streamline it when I get the time before making it public. However, I'd be happy to give you (or anyone) access in the meantime, if they are in a hurry and want to take a look.