James Mills a07f747eb1 Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

..

pages

Tidied up the UX a bit more

2021-02-03 21:29:18 +10:00

session

Initial Codebase (untested)

2021-01-30 14:05:04 +10:00

static

Refactor out the use of rice in favor of embed (#2)

2022-10-05 00:19:23 +00:00

templates

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

base_task.go

Refactored crawler to use task dispatcher

2021-02-02 13:13:12 +10:00

bitcask_store.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

config.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

context.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

crawl_task.go

Add crawler_duration gauge and server_queries counter

2021-02-03 19:09:16 +10:00

crawler.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

dispatcher_test.go

Refactored crawler to use task dispatcher

2021-02-02 13:13:12 +10:00

dispatcher.go

Add a /tasks endpoing and extra metdata to crawl tasks

2021-02-02 14:58:52 +10:00

email.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

entry.go

Add working Crawler, Scraper and Indexer

2021-02-01 22:38:17 +10:00

errors.go

Initial Codebase (untested)

2021-01-30 14:05:04 +10:00

func_task.go

Refactored crawler to use task dispatcher

2021-02-02 13:13:12 +10:00

handlers.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

indexer.go

Add Indexer.Size() and index_size metric

2021-02-07 21:12:49 +10:00

init.go

Initial Codebase (untested)

2021-01-30 14:05:04 +10:00

jobs.go

More fixes

2021-01-30 15:26:24 +10:00

links.go

Always scrape the first page

2021-02-07 18:49:31 +10:00

models.go

Record and skip urls the crawler has seen before

2021-02-01 23:46:26 +10:00

opensearch_handler.go

Add opensearch endpoint and handler

2021-02-02 15:12:08 +10:00

options.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

page_handlers.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

paginator_adapters.go

Fixed pager

2021-02-03 01:56:56 +10:00

results.go

Add support for highlighting results

2021-02-07 21:15:34 +10:00

robots.go

Tidied up the UX a bit more

2021-02-03 21:29:18 +10:00

router.go

Add missing router module

2021-01-30 15:16:44 +10:00

scraper.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

server.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

stats.go

Initial Codebase (untested)

2021-01-30 14:05:04 +10:00

store.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

support_handlers.go

Tidied up the UX a bit more

2021-02-03 21:29:18 +10:00

task_handlers.go

Add a /tasks endpoing and extra metdata to crawl tasks

2021-02-02 14:58:52 +10:00

task.go

Refactored crawler to use task dispatcher

2021-02-02 13:13:12 +10:00

templates.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

ttlcache.go

Add missing TTLCache

2021-01-30 15:39:16 +10:00

utils.go

Remove a bunch of unused cruft

2022-10-05 11:11:40 +10:00

worker.go

Refactored crawler to use task dispatcher

2021-02-02 13:13:12 +10:00