James Mills
18d4e17033
Update vern instance location from Canada to US
...
```
[02:41:27] <Arya[verncc][m]> prologic: can you update ~vern instance location from canada to US for spyda? too lazy to send a patch for it :P
[06:59:39] <prologic> Sure
```
2022-11-27 07:00:33 +10:00
Arya Kiran
143cb45fb0
Add basic build/usage instructions and create an instance list
...
Signed-off-by: Arya Kiran <aryak@vern.cc >
2022-10-30 22:43:15 +10:00
Aoi Koizumi (古泉 あおい)
9beb392905
Import fixes from mirageCSS 1.1.6 ( #3 )
...
Signed-off-by: Aoi K <koizumi.aoi@kyoko-project.wer.ee >
Co-authored-by: Aoi K <koizumi.aoi@kyoko-project.wer.ee >
Reviewed-on: https://git.mills.io/prologic/spyda/pulls/3
Co-authored-by: Aoi Koizumi (古泉 あおい) <novaburst@noreply@mills.io >
Co-committed-by: Aoi Koizumi (古泉 あおい) <novaburst@noreply@mills.io >
2022-10-06 03:52:45 +00:00
James Mills
46463dd11f
Fix Dockerfile
2022-10-05 11:22:59 +10:00
James Mills
2ba2451108
Remove a bunch more cruft
2022-10-05 11:19:27 +10:00
James Mills
a07f747eb1
Remove a bunch of unused cruft
2022-10-05 11:11:40 +10:00
James Mills
06c8ce3410
Fix Dockerfile (missing static.go and templates.go)
2022-10-05 10:34:41 +10:00
James Mills
1a9f85b449
Fix Makefile minify install and Docker image
2022-10-05 10:31:59 +10:00
James Mills
d4ab395515
Refactor out the use of rice in favor of embed ( #2 )
...
Co-authored-by: James Mills <prologic@shortcircuit.net.au >
Reviewed-on: https://git.mills.io/prologic/spyda/pulls/2
2022-10-05 00:19:23 +00:00
Aoi Koizumi (古泉 あおい)
7001f3bf51
Move from pico.css to mirageCSS ( #1 )
...
UI/UX changes: PicoCSS -> mirageCSS, rice-box.go removed and placed on .gitignore (since it is generated anyway), update templates.
Signed-off-by: Aoi K <koizumi.aoi@kyoko-project.wer.ee >
Co-authored-by: Aoi K <koizumi.aoi@kyoko-project.wer.ee >
Reviewed-on: https://git.mills.io/prologic/spyda/pulls/1
Co-authored-by: Aoi Koizumi (古泉 あおい) <novaburst@noreply@mills.io >
Co-committed-by: Aoi Koizumi (古泉 あおい) <novaburst@noreply@mills.io >
2022-10-05 00:16:24 +00:00
Aoi Koizumi (古泉 あおい)
a6d10baaf3
Now compiles under Go 1.17+
...
Signed-off-by: Aoi Koizumi (古泉 あおい) <novaburst@kalli.st >
2022-08-30 11:13:47 +10:00
James Mills
1833d56686
Fix import paths
2021-07-13 08:33:43 +10:00
James Mills
737340572b
Revert "Fix Docker image and temp fix for upstream broken minify"
...
This reverts commit 3a44caa8ff
2021-02-08 07:53:35 +10:00
James Mills
3a44caa8ff
Fix Docker image and temp fix for upstream broken minify
2021-02-07 21:37:51 +10:00
James Mills
c33fb2a41f
Update deps
2021-02-07 21:22:28 +10:00
James Mills
d96293007b
Add support for highlighting results
2021-02-07 21:15:34 +10:00
James Mills
ce4b180576
Add Indexer.Size() and index_size metric
2021-02-07 21:12:49 +10:00
James Mills
c31fc9569f
Fix paging
2021-02-07 19:06:25 +10:00
James Mills
aee086ea34
Always scrape the first page
2021-02-07 18:49:31 +10:00
James Mills
b34ff5ade2
Remove useless log file
2021-02-06 08:13:38 +10:00
James Mills
36cdbd3fc5
Tidied up the UX a bit more
2021-02-03 21:29:18 +10:00
James Mills
ccfbd18b29
Add crawler_duration gauge and server_queries counter
2021-02-03 19:09:16 +10:00
James Mills
6dc7510e8f
Fixed pager
2021-02-03 01:56:56 +10:00
James Mills
382fd677c3
Remove superfluous notice on search results
2021-02-03 01:01:47 +10:00
James Mills
929c91af02
Improve cache view
2021-02-03 00:29:25 +10:00
James Mills
1708838316
Fixed cache template and handleer
2021-02-03 00:14:40 +10:00
James Mills
4e7b443feb
Code cleanup
2021-02-02 23:56:20 +10:00
James Mills
4c02ee5afc
Improve the search results view
2021-02-02 23:34:18 +10:00
James Mills
867b7b141d
Add quick bookmarklet
2021-02-02 17:26:12 +10:00
James Mills
e34e331101
Fix autofocus of input fields
2021-02-02 16:39:12 +10:00
James Mills
f47e9ba765
Fix crappy top notice that looks terrible on mobile
2021-02-02 15:44:00 +10:00
James Mills
383e6837ac
Add current search query to form and render search on index if q= is non-nil
2021-02-02 15:32:23 +10:00
James Mills
93cab4c1bc
Add opensearch endpoint and handler
2021-02-02 15:12:08 +10:00
James Mills
3923ff91ba
Add a /tasks endpoing and extra metdata to crawl tasks
2021-02-02 14:58:52 +10:00
James Mills
5cd5495622
Fix close links chan
2021-02-02 14:35:10 +10:00
James Mills
0e142fc233
Close links chan on crawl completion
2021-02-02 14:16:17 +10:00
James Mills
e1b0dd173f
Reduce dispatchers to 2 (by default)
2021-02-02 13:36:48 +10:00
James Mills
26df009e8f
Refactored crawler to use task dispatcher
2021-02-02 13:13:12 +10:00
James Mills
4970b16d61
Add better crawler metrics
2021-02-02 12:07:53 +10:00
James Mills
865e5b5750
Rejig Login to Partner Login and put banner at top
2021-02-02 11:24:49 +10:00
James Mills
0db2b08911
Minor UI tweak
2021-02-02 08:25:54 +10:00
James Mills
03236ffa1f
It works (but it sucks0
2021-02-02 08:23:42 +10:00
James Mills
beae6d03c1
Keep data dir in git
2021-02-02 08:02:34 +10:00
James Mills
82da9eee99
Fix bug creating cache dir
2021-02-02 08:01:21 +10:00
James Mills
4383b3125d
Add additional fields to search request
2021-02-02 00:18:45 +10:00
James Mills
8a1161cf77
Record and skip urls the crawler has seen before
2021-02-01 23:46:26 +10:00
James Mills
b398a3a709
Add working Crawler, Scraper and Indexer
2021-02-01 22:38:17 +10:00
James Mills
753aff61a1
Update deps
2021-02-01 21:26:02 +10:00
James Mills
b69b27eeed
Add crawler skeleton and add handler
2021-02-01 21:25:32 +10:00
James Mills
8c84ee8b3d
Add link crawler
2021-02-01 20:20:25 +10:00
