📄️ Arcadia Configuration File
We have some system level configuration for Arcadia, and we can update it based on our requirements.
📄️ GPU and Node Affinity
Use specified GPUs
🗃️ Distributed Inference
3 items
📄️ SSE Support
When chat with LLM application, we support blocking and streaming mode. Streaming mode is using SSE (SSE is the abbreviation for Server-Sent Events, and KubeAGI support SSE for message streaming response.)
📄️ Run Streamlit Application
Enable streamlit for your namespace
📄️ Setup Whisper Service
We need to setup a whisper service to transcribe audio to text, so we can use the context in the audio file as the context in the latter conversation.