-
Notifications
You must be signed in to change notification settings - Fork 2
zy-sunshine/wordprocessor
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
This is a (clients) <-> ROUTER <--> DEALER <-> (workers) model with Zeromq framework and it derived from zguide/examples/Python/asyncrrhandlers.py and mtserver.py example I like to use multiprocess to be my worker's running environment( multithread running is suppoted either ) The main.py file is the server with workers initialize and wait client(t-04-client.py) to be connected I used it to be my word processor framework, to manage the worker which will process my html -- crawler crawl page from internet. The word processor can deal with many format html structure. TODO: 1. the worker processes pool is not nessessary 2. the worker's thread pool have some problem, but we can ignore it until we use this framework in large situation. 3. config file, should be defined to a proper structure.
About
a word processor for my web crawler and wordpress robot
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published