Skip to content
This repository has been archived by the owner on Jan 26, 2024. It is now read-only.

corkine/huginn-task-client-go

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 

Repository files navigation

使用 go 语言实现的 HuginnServer —— 分布式爬虫框架 的客户端,附带了一个爬取考试成绩的简单例子。

Usage:

//go.mod
require "repo.mazhangjing.com/go-huginn-task-client" latest
package main

import (
	"fmt"
	"repo.mazhangjing.com/go-huginn-task-client/huginn"
)

func main() {
	huginn.HuginnLoginUrl = "http://xxxxxxxxx.com"
	job, err := huginn.FetchJob("CM101", "zk2021", 3, 100)
	if err != nil {
		return
	}
	fmt.Printf("%#v", job)
}

About

使用 go 实现的 Huginn Server Client —— 分布式爬虫服务客户端,其中客户端使用了 goroutine 加快爬取进度

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages