10 Commits (512632d04250682312ff54b42e549570ef2e7b13)

Author	SHA1	Message	Date
~erin	e5cc3e7a31	Core engine - setup, create search index	2023-07-25 21:34:03 -04:00
~erin	e42e87121e	Bump up crawler version	2023-07-25 20:54:26 -04:00
~erin	c141135847	Sanitize HTML?	2023-07-25 19:54:05 -04:00
~erin	561ef2dfb4	Test database	2023-07-25 19:28:17 -04:00
~erin	57684c037e	Fix recursive crawling	2023-07-25 18:16:45 -04:00
~erin	159164674e	Crawl through URLs via allowlist	2023-07-25 17:36:41 -04:00
~erin	892dc35f74	Crawl all at once, test cacache	2023-07-25 16:58:25 -04:00
~erin	86f6d1a631	Fetch pages in sitemap	2023-07-25 16:11:09 -04:00
~erin	bc062a39f3	Use basic configuration file	2023-07-25 15:24:14 -04:00
~erin	971b217a94	Basic project setup	2023-07-25 14:52:19 -04:00