Skip to content

jsonkey/multiprocess

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Multiprocess

A very simple multi-process processing framework by python

Design

  • Single machine(node) execution
  • Help python make full use of multi cpu-cores (GIL= Global Interpreter Lock)
  • Keep Simple

Setup / Install

git clone https://github.com/jsonkey/multiprocess
cd mutiprocess

Man

  • Help

image

  • Example & Test

image

Worker Description

woker.py

def func(lines):
        '''input:
                lines = ['111111\n', '222222\n']
            output:
                lines = ['aaaaaa\n', 'bbbbbb\n']
        '''
        rerurn lines

About

A very simple multi-process processing framework by python

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages