Is it possible to implement distributed CPUs inference?

[hyperbolic-c]

Just as implement distributed training and inference on multiple nodes with multiple GPUs, is it possible to implement inference on multiple device nodes with multiple CPUs?
For distributed CPU training, for example, mindspore distributed cpu train, any solution about LLM inference ? thanks！！