~erin
|
e5cc3e7a31
|
Core engine - setup, create search index
|
2023-07-25 21:34:03 -04:00 |
~erin
|
e42e87121e
|
Bump up crawler version
|
2023-07-25 20:54:26 -04:00 |
~erin
|
c141135847
|
Sanitize HTML?
|
2023-07-25 19:54:05 -04:00 |
~erin
|
561ef2dfb4
|
Test database
|
2023-07-25 19:28:17 -04:00 |
~erin
|
57684c037e
|
Fix recursive crawling
|
2023-07-25 18:16:45 -04:00 |
~erin
|
159164674e
|
Crawl through URLs via allowlist
|
2023-07-25 17:36:41 -04:00 |
~erin
|
892dc35f74
|
Crawl all at once, test cacache
|
2023-07-25 16:58:25 -04:00 |
~erin
|
86f6d1a631
|
Fetch pages in sitemap
|
2023-07-25 16:11:09 -04:00 |
~erin
|
bc062a39f3
|
Use basic configuration file
|
2023-07-25 15:24:14 -04:00 |
~erin
|
971b217a94
|
Basic project setup
|
2023-07-25 14:52:19 -04:00 |