shinyoukai/spyda
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add working Crawler, Scraper and Indexer

Browse Source
This commit is contained in:
James Mills
2021-02-01 22:38:17 +10:00
parent 753aff61a1
commit b398a3a709
8 changed files with 328 additions and 21 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
go.mod
View File

@@ -12,12 +12,15 @@ require (
github.com/andreadipersio/securecookie v0.0.0-20131119095127-e3c3b33544ec
github.com/antchfx/htmlquery v1.2.3 // indirect
github.com/antchfx/xmlquery v1.3.3 // indirect
github.com/apex/log v1.9.0
github.com/blevesearch/bleve/v2 v2.0.1
github.com/creasty/defaults v1.5.1
github.com/dgrijalva/jwt-go v3.2.0+incompatible
github.com/dustin/go-humanize v1.0.0
github.com/elithrar/simple-scrypt v1.3.0
github.com/gabstv/merger v1.0.1
github.com/go-mail/mail v2.3.1+incompatible
github.com/go-shiori/go-readability v0.0.0-20201011032228-bdc871772408
github.com/gobwas/glob v0.2.3 // indirect
github.com/goccy/go-yaml v1.8.6
github.com/gocolly/colly/v2 v2.1.0