Embedder not provided, using OpenAIEmbedder

General
1

When I attempt to access a URL (web link), my terminal outputs the message:

Embedder not provided, using OpenAIEmbedder

This results in a failed access to the URL content.

However, when I switch to accessing a PDF file via its URL/path, the system reads the PDF correctly, answers questions as expected, and no such terminal prompt appears.

Below are my code and the corresponding terminal output:

image
image783×747 33.2 KB

(.venv) D:\Work\Code\Python\Demo>d:/Work/Code/Python/Demo/.venv/Scripts/python.exe d:/Work/Code/Python/Demo/agno/with_knowledge_and_storage.py
INFO Adding content from URL https://docs.agno.com/introduction
INFO Embedder not provided, using OpenAIEmbedder as default.
d:\Work\Code\Python\Demo\.venv\Lib\site-packages\chonkie\embeddings\auto.py:87: UserWarning: Failed to load text-embedding-3-small with OpenAIEmbeddings: The api_key client option must be 
set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable
Falling back to loading default provider model.
  warnings.warn(
d:\Work\Code\Python\Demo\.venv\Lib\site-packages\chonkie\embeddings\auto.py:95: UserWarning: Failed to load the default model for OpenAIEmbeddings: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable
Falling back to SentenceTransformerEmbeddings.
  warnings.warn(
No sentence-transformers model found with name sentence-transformers/text-embedding-3-small. Creating a new one with mean pooling.
d:\Work\Code\Python\Demo\.venv\Lib\site-packages\chonkie\embeddings\auto.py:87: UserWarning: Failed to load text-embedding-3-small with OpenAIEmbeddings: The api_key client option must be 
set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable
Falling back to loading default provider model.
  warnings.warn(
d:\Work\Code\Python\Demo\.venv\Lib\site-packages\chonkie\embeddings\auto.py:95: UserWarning: Failed to load the default model for OpenAIEmbeddings: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable
Falling back to SentenceTransformerEmbeddings.
  warnings.warn(
No sentence-transformers model found with name sentence-transformers/text-embedding-3-small. Creating a new one with mean pooling.
ERROR    Error reading URL: https://docs.agno.com/introduction - Failed to load embeddings via SentenceTransformerEmbeddings after registry/fallback failure:
         sentence-transformers/text-embedding-3-small is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models'
         If this is a private repository, make sure to pass a token having permission to this repo either by logging in with `hf auth login` or by passing `token=<your_token>`
WARNING  Contents DB not found for knowledge base
2

Hi @tike, thank you for reaching out and supporting Agno. I’ve shared this with the team, we’re working through all queries one by one and will get back to you soon. If it’s urgent, please let us know. We appreciate your patience!