m105 1c9fc5d423 Initial commit: Laravel scaffold + Common Crawl site indexing ...

Adds Site/SitePage models and the crawlindex:fetch command, which pulls
CDX index records from Common Crawl and optionally enriches them with
page title/description/keywords/body text extracted from the WARC
archive. CDX/WARC access and the site/page upsert logic live in
CommonCrawlIndexService and WarcRecordFetcher.

2026-07-20 00:04:45 +03:00

..

.gitignore

Initial commit: Laravel scaffold + Common Crawl site indexing

2026-07-20 00:04:45 +03:00