3 Commits

Author	SHA1	Message	Date
James Mills	ccfbd18b29	Add crawler_duration gauge and server_queries counter	2021-02-03 19:09:16 +10:00
James Mills	3923ff91ba	Add a /tasks endpoing and extra metdata to crawl tasks	2021-02-02 14:58:52 +10:00
James Mills	26df009e8f	Refactored crawler to use task dispatcher	2021-02-02 13:13:12 +10:00