Embedder not provided, using OpenAIEmbedder

General
1

When I attempt to access a URL (web link), my terminal outputs the message:

Embedder not provided, using OpenAIEmbedder

This results in a failed access to the URL content.

However, when I switch to accessing a PDF file via its URL/path, the system reads the PDF correctly, answers questions as expected, and no such terminal prompt appears.

Below are my code and the corresponding terminal output:

image
image783×747 33.2 KB

(.venv) D:\Work\Code\Python\Demo>d:/Work/Code/Python/Demo/.venv/Scripts/python.exe d:/Work/Code/Python/Demo/agno/with_knowledge_and_storage.py
INFO Adding content from URL https://docs.agno.com/introduction
INFO Embedder not provided, using OpenAIEmbedder as default.
d:\Work\Code\Python\Demo\.venv\Lib\site-packages\chonkie\embeddings\auto.py:87: UserWarning: Failed to load text-embedding-3-small with OpenAIEmbeddings: The api_key client option must be 
set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable
Falling back to loading default provider model.
  warnings.warn(
d:\Work\Code\Python\Demo\.venv\Lib\site-packages\chonkie\embeddings\auto.py:95: UserWarning: Failed to load the default model for OpenAIEmbeddings: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable
Falling back to SentenceTransformerEmbeddings.
  warnings.warn(
No sentence-transformers model found with name sentence-transformers/text-embedding-3-small. Creating a new one with mean pooling.
d:\Work\Code\Python\Demo\.venv\Lib\site-packages\chonkie\embeddings\auto.py:87: UserWarning: Failed to load text-embedding-3-small with OpenAIEmbeddings: The api_key client option must be 
set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable
Falling back to loading default provider model.
  warnings.warn(
d:\Work\Code\Python\Demo\.venv\Lib\site-packages\chonkie\embeddings\auto.py:95: UserWarning: Failed to load the default model for OpenAIEmbeddings: The api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable
Falling back to SentenceTransformerEmbeddings.
  warnings.warn(
No sentence-transformers model found with name sentence-transformers/text-embedding-3-small. Creating a new one with mean pooling.
ERROR    Error reading URL: https://docs.agno.com/introduction - Failed to load embeddings via SentenceTransformerEmbeddings after registry/fallback failure:
         sentence-transformers/text-embedding-3-small is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models'
         If this is a private repository, make sure to pass a token having permission to this repo either by logging in with `hf auth login` or by passing `token=<your_token>`
WARNING  Contents DB not found for knowledge base