Struct UrlIndexer 

pub struct UrlIndexer { /* private fields */ }

Fetches URLs, converts HTML to markdown, chunks by headings, and indexes into SQLite FTS5 for BM25-ranked section search.

Implementations

impl UrlIndexer

pub fn from_connection(conn: Connection, ttl: Duration) -> Result<Self>

Create a UrlIndexer from an existing connection (e.g. shared with SessionStore). Applies the URL-specific schema tables.

pub fn fetch_and_index( &self, url: &str, force: bool, fetcher: &dyn ContentFetcher, ) -> Result<IndexResult>

Fetch a URL via the provided fetcher, convert HTML to markdown, chunk by headings, and index into FTS5.

• If the URL was fetched within the TTL window and force is false, the cached version is used (no fetch).
• If force is true, the cache is bypassed and the URL is re-fetched.

pub fn search(&self, query: &str) -> Result<Vec<IndexedChunk>>

Search indexed URL content. Returns only matching sections (not full documents), ranked by BM25.