Don't know a ton about this but here are a few thoughts:
- Overall, I think distributed compute is probably not good for training or inference, but might be useful for data engineering or other support functions.
- Folding@home crowdsources compute for expanding markov state models of possible protein folding paths. Afaik, this doesn't require backpropagation or any similar latency-sensitive updating method. The crowdsourced computers just play out a bunch of scenarios, which are then aggregated and pruned off-line. Interesting paths are used to genera... (read more)
Don't know a ton about this but here are a few thoughts:
- Overall, I think distributed compute is probably not good for training or inference, but might be useful for data engineering or other support functions.
- Folding@home crowdsources compute for expanding markov state models of possible protein folding paths. Afaik, this doesn't require backpropagation or any similar latency-sensitive updating method. The crowdsourced computers just play out a bunch of scenarios, which are then aggregated and pruned off-line. Interesting paths are used to genera... (read more)