WebsiteKnowledgeBase does not loading website content into DB

General
1

I have created a knowledge base using agno (previously known as phidata) framework - Website Knowledge Base - Phidata

I tried running it but in console it shows below messages

(.venv) SYSTEM-MAC TestApp % python knowledge_base.py
INFO     Loading knowledge base                                                                                                 
INFO     Loaded 0 documents to knowledge base
(.venv) SYSTEM-MAC TestApp %

Python code

from agno.knowledge.website import WebsiteKnowledgeBase
from agno.vectordb.pgvector import PgVector

airtel_knowledge_base = WebsiteKnowledgeBase(
    urls=["https://docs.agno.com/introduction"],
    max_depth=3,
    max_links=10,
    debug_mode=True,
    vector_db=PgVector(
        table_name="website_documents",
        db_url="postgresql+psycopg2://{user}:{password}@{host}:5432/{db}",
    ),
)

airtel_knowledge_base.load()

There is no issue in DB connection and that’s how I have created ‘website_documents’ table

CREATE TABLE website_documents(
 id BIGINT PRIMARY KEY GENERATED ALWAYS AS IDENTITY,
 content TEXT,
 author_id BIGINT,
 embedding VECTOR(1538)
);

Any idea, how can I make it work?

2

Hi @mohit26chauhan
I just tried this locally and it worked fine for me. Did you maybe already have it loaded in the DB? Try setting recreate=True.