Easy, fast, and cheap LLM serving for everyone | Documentation | Blog | Paper | Discord |---Ray Summit CPF is Open (June 4th to June 20th)!There will be a track for vLLM at the Ray Summit (09/30-10/02, SF) this year! If you have cool projects related to vLLM or LLM inference, we would love to see your proposals. This will…
Source code on GitHub.
Repository Info
README
Easy, fast, and cheap LLM serving for everyone
| Documentation | Blog | Paper | Discord |
---
Ray Summit CPF is Open (June 4th to June 20th)!
There will be a track for vLLM at the Ray Summit (09/30-10/02, SF) this year! If you have cool projects related to vLLM or LLM inference, we would love to see your proposals. This will be a great chance for everyone in the community to get together and learn. Please submit your proposal here
---
Latest News 🔥