-
Notifications
You must be signed in to change notification settings - Fork 5.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Would it be possible for Ollama to support re-rank models? #4510
Comments
@lyfuci Ollama only support OpenSource models. Before adding a model to Ollama, it is often available on Hunging Face. |
@igorschlum sorry, just set a typo, reranker->rerank. reranker model means a model input some sentences and a query, output a list of similarity. |
just to bump this, i agree, I had to switch from ollama to transformers library when doing rag to use a reranker. Also maybe a wider range of embedding models in general or some whay to search for or filter them. I found that bge embeddings like m3 or large outperformed the largest embedding model currently on ollama: mxbai-embed-large. |
+1 |
2 similar comments
+1 |
+1 |
I am using Ollama for my projects and it's been great. However, when using some AI app platform, like dify, build RAG app, rerank is nessesary. It's possible for Ollama to support rerank models.
The text was updated successfully, but these errors were encountered: