Is there any way to use vllm embeddings endpoints, currently i am serving vllm for embed task and i wanted to see if there is a way to use it as i have other components now migrated to vllm and need to make sure if there is any plan for this feature.
Hi @white07S, thanks for reaching out and supporting Agno. I’ve shared this with the team, we’re working through all requests one by one and will get back to you soon.
If it’s urgent, please let us know. We appreciate your patience!
Hi @white07S we currently dont have the support for vllm emebdder. We’ll work on it soon and probably will be released with the major version change of 2.0
Thanks for reaching out and using Agno!