📄️ 部署 Ray 集群
如果我们需要使用分布式推理能力，按照以下步骤安装 Ray：
📄️ 使用 Ray 的分布式推理
使用 Ray 集群进行分布式推理e
📄️ Run Inference using Ray Serve
We'll introduce how to use Ray cluster to serve LLM with multiple instances and provide high-availability inference service. Here are two methods to run the distributed inference introduced here, here is the methond one.