SeedMethod
Pluggable discovery strategies for web crawling. Defines how the CrawlerAgentTask identifies initial URLs using search engines, proxies, or direct input.
Category: Discovery
Side-Effect Safe
Multi-Provider
⚙️ CrawlerTaskExecutionConfigData
{
"seed_method": "SearchIO_Google_Search",
"query": "latest rust programming trends 2024",
"max_results": 5
}
→
🔍 Discovered SeedItems
Rust in 2024: What to Expect
https://blog.rust-lang.org/...
Score: 100.0
Top 10 Rust Frameworks
https://dev.to/rust-trends...
Score: 92.5
Available Seed Methods
The SeedMethod enum provides various providers for URL discovery:
| Method | Provider | Description |
|---|---|---|
GoogleSearch |
Native | Direct Google Search integration. |
SearchIO_Google_Search |
SearchAPI.io | Standard organic search results via SearchAPI. |
SearchIO_Google_Scholar |
SearchAPI.io | Academic papers and citations. |
SearchIO_Amazon |
SearchAPI.io | Product discovery on Amazon. |
DirectUrls |
Internal | Bypasses search; uses provided URLs directly. |
SeedItem Structure
| Field | Type | Description |
|---|---|---|
link |
String | The target URL to be crawled. |
title |
String | The title or anchor text of the discovery. |
relevance_score |
Double | Ranking score (1-100) for prioritization. |