8 Commits (ed53ec320ef2567056544bb60507d98f3cdcba92)

Author	SHA1	Message	Date
~erin	c141135847	Sanitize HTML?	2023-07-25 19:54:05 -04:00
~erin	561ef2dfb4	Test database	2023-07-25 19:28:17 -04:00
~erin	57684c037e	Fix recursive crawling	2023-07-25 18:16:45 -04:00
~erin	159164674e	Crawl through URLs via allowlist	2023-07-25 17:36:41 -04:00
~erin	892dc35f74	Crawl all at once, test cacache	2023-07-25 16:58:25 -04:00
~erin	86f6d1a631	Fetch pages in sitemap	2023-07-25 16:11:09 -04:00
~erin	bc062a39f3	Use basic configuration file	2023-07-25 15:24:14 -04:00
~erin	971b217a94	Basic project setup	2023-07-25 14:52:19 -04:00