shinyoukai/spyda
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Always scrape the first page

Browse Source
This commit is contained in:
James Mills
2021-02-07 18:49:31 +10:00
parent b34ff5ade2
commit aee086ea34
3 changed files with 375 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
internal/links.go
View File

@@ -54,9 +54,9 @@ func FindLinks(url string) chan string {
} }
}) })
c.Visit(url)
go func() { go func() {
links <- url
c.Visit(url)
c.Wait() c.Wait()
close(links) close(links)
}() }()

372
internal/rice-box.go Normal file
View File

File diff suppressed because one or more lines are too long

2
internal/static/js/spyda.min.js vendored
View File

File diff suppressed because one or more lines are too long