shinyoukai/spyda
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
1a9f85b449002844dab220ef3a0a74069d6b5edf
spyda/internal
History
James Mills d4ab395515 Refactor out the use of rice in favor of embed (#2) 
Co-authored-by: James Mills <prologic@shortcircuit.net.au>
Reviewed-on: https://git.mills.io/prologic/spyda/pulls/2
2022-10-05 00:19:23 +00:00
..
auth
Initial Codebase (untested)
2021-01-30 14:05:04 +10:00
pages
Tidied up the UX a bit more
2021-02-03 21:29:18 +10:00
passwords
Initial Codebase (untested)
2021-01-30 14:05:04 +10:00
session
Initial Codebase (untested)
2021-01-30 14:05:04 +10:00
static
Refactor out the use of rice in favor of embed (#2)
2022-10-05 00:19:23 +00:00
templates
Refactor out the use of rice in favor of embed (#2)
2022-10-05 00:19:23 +00:00
api.go
More fixes
2021-01-30 15:26:24 +10:00
auth_handlers.go
Add password hadnelrs
2021-01-30 15:38:26 +10:00
base_task.go
Refactored crawler to use task dispatcher
2021-02-02 13:13:12 +10:00
bitcask_store.go
Fix import paths
2021-07-13 08:33:43 +10:00
config.go
Replaced all other referenced to twt/twtxt
2021-01-30 15:06:58 +10:00
context.go
Tidied up the UX a bit more
2021-02-03 21:29:18 +10:00
crawl_task.go
Add crawler_duration gauge and server_queries counter
2021-02-03 19:09:16 +10:00
crawler.go
Refactored crawler to use task dispatcher
2021-02-02 13:13:12 +10:00
dispatcher_test.go
Refactored crawler to use task dispatcher
2021-02-02 13:13:12 +10:00
dispatcher.go
Add a /tasks endpoing and extra metdata to crawl tasks
2021-02-02 14:58:52 +10:00
email.go
Tidied up the UX a bit more
2021-02-03 21:29:18 +10:00
entry.go
Add working Crawler, Scraper and Indexer
2021-02-01 22:38:17 +10:00
errors.go
Initial Codebase (untested)
2021-01-30 14:05:04 +10:00
func_task.go
Refactored crawler to use task dispatcher
2021-02-02 13:13:12 +10:00
handlers.go
Refactor out the use of rice in favor of embed (#2)
2022-10-05 00:19:23 +00:00
indexer.go
Add Indexer.Size() and index_size metric
2021-02-07 21:12:49 +10:00
init.go
Initial Codebase (untested)
2021-01-30 14:05:04 +10:00
jobs.go
More fixes
2021-01-30 15:26:24 +10:00
links.go
Always scrape the first page
2021-02-07 18:49:31 +10:00
manage_handlers.go
It builds!
2021-01-30 15:56:03 +10:00
models.go
Record and skip urls the crawler has seen before
2021-02-01 23:46:26 +10:00
opensearch_handler.go
Add opensearch endpoint and handler
2021-02-02 15:12:08 +10:00
options.go
It builds!
2021-01-30 15:56:03 +10:00
page_handlers.go
Refactor out the use of rice in favor of embed (#2)
2022-10-05 00:19:23 +00:00
paginator_adapters.go
Fixed pager
2021-02-03 01:56:56 +10:00
passwd_handlers.go
Add mixxing Recovery field on User object
2021-01-30 15:42:27 +10:00
results.go
Add support for highlighting results
2021-02-07 21:15:34 +10:00
robots.go
Tidied up the UX a bit more
2021-02-03 21:29:18 +10:00
router.go
Add missing router module
2021-01-30 15:16:44 +10:00
scraper.go
Fix bug creating cache dir
2021-02-02 08:01:21 +10:00
server.go
Refactor out the use of rice in favor of embed (#2)
2022-10-05 00:19:23 +00:00
session_store.go
Initial Codebase (untested)
2021-01-30 14:05:04 +10:00
stats.go
Initial Codebase (untested)
2021-01-30 14:05:04 +10:00
store.go
Record and skip urls the crawler has seen before
2021-02-01 23:46:26 +10:00
support_handlers.go
Tidied up the UX a bit more
2021-02-03 21:29:18 +10:00
task_handlers.go
Add a /tasks endpoing and extra metdata to crawl tasks
2021-02-02 14:58:52 +10:00
task.go
Refactored crawler to use task dispatcher
2021-02-02 13:13:12 +10:00
templates.go
Refactor out the use of rice in favor of embed (#2)
2022-10-05 00:19:23 +00:00
ttlcache.go
Add missing TTLCache
2021-01-30 15:39:16 +10:00
utils.go
Refactored crawler to use task dispatcher
2021-02-02 13:13:12 +10:00
worker.go
Refactored crawler to use task dispatcher
2021-02-02 13:13:12 +10:00