Permalink
Browse files

change the project name to FTPflow

  • Loading branch information...
kasramvd committed Dec 18, 2017
1 parent 1a9e536 commit 4eb9d0e66345701b4e2e00f61d7f0a62ed61569f
Binary file not shown.
Binary file not shown.
File renamed without changes.
File renamed without changes.
File renamed without changes.
@@ -19,9 +19,9 @@ def initialize(executable, *args):
def start(executable, *args):
initialize(executable, *args)
instart(Daemon, 'FTPwalker', 'FTPwalker', stay_alive=False)
instart(Daemon, 'FTPflow', 'FTPflow', stay_alive=False)
def stop():
import os
os.system("sc delete FTPwalker")
os.system("sc delete FTPflow")
File renamed without changes.
File renamed without changes.
@@ -3,7 +3,7 @@
runwalker.py
=====
This module is contain the `ftpwalker` class which is responsible for
This module is contain the `FTPflow` class which is responsible for
running a new walker.
============================
@@ -17,19 +17,19 @@
import re
class ftpwalker:
class FTPflow:
"""
==============
``ftpwalker``
``FTPflow``
----------
You can pass following arguments to class's caller at instantiation's time.
server_name: The name of server
url: The corresponding url
root: The root path that you want to start the traversing from.
daemon: Daemonization flag, which should be a boolean value (True, False)
json_path: Corresponding path for saving the final json file.
.. py:class:: ftpwalker()
.. py:class:: FTPflow()
.. note::
@@ -74,7 +74,7 @@ def __init__(self, server_name, url, root='/', daemon=False):
self.daemon = daemon
try:
home = path.expanduser("~")
server_path = path.join(home, "FTPwalkerfile/", self.name)
server_path = path.join(home, "FTPflowfile/", self.name)
except Exception as exc:
raise Exception("Please enter a valid name. {}".format(exc))
else:
@@ -1,6 +1,6 @@
from runwalker import ftpwalker
from runwalker import FTPflow
# "Pasteur Insitute", "ftp.pasteur.fr"
walker = ftpwalker("Uniprot", "ftp.uniprot.org")
walker = FTPflow("Pasteur Insitute", "ftp.pasteur.fr")
# "O-GLYCBASE", "ftp.cbs.dtu.dk"
walker.check_state()
File renamed without changes.
@@ -12,14 +12,14 @@
from os import path as ospath
class ftp_walker(object):
class FTP_flow(object):
"""
==============
``ftp_walker``
``FTP_flow``
----------
.. py:class:: ftp_walker()
.. py:class:: FTP_flow()
This class is contain corresponding functions for traversing the FTP
servers using BFS algorithm.
Binary file not shown.
Binary file not shown.
@@ -2,14 +2,14 @@
README
setup.cfg
setup.py
FTPwalker/__init__.py
FTPwalker/checkplatform.py
FTPwalker/main_walker.py
FTPwalker/runwalker.py
FTPwalker/test.py
FTPwalker/traverse.py
FTPwalker/walker.py
FTPwalker/daemons/__init__.py
FTPwalker/daemons/unixdaemon.py
FTPwalker/daemons/windaemon.py
FTPwalker/daemons/winservice.py
FTPflow/__init__.py
FTPflow/checkplatform.py
FTPflow/main_walker.py
FTPflow/runwalker.py
FTPflow/test.py
FTPflow/traverse.py
FTPflow/walker.py
FTPflow/daemons/__init__.py
FTPflow/daemons/unixdaemon.py
FTPflow/daemons/windaemon.py
FTPflow/daemons/winservice.py
16 README
@@ -1,29 +1,29 @@
FTPwalker is a Python package for optimally traversing extremely large FTP directory trees.
FTPflow is a Python package for optimally traversing extremely large FTP directory trees.
Here is an example of FTPwalker traversing the Uniprot_ bioinformatics database:
Here is an example of FTPflow traversing the Uniprot_ bioinformatics database:
.. code-block:: python
from FTPwalker.runwalker import ftpwalker
from FTPflow.runwalker import FTPflow
walker = ftpwalker("Uniprot", "ftp.uniprot.org")
walker = FTPflow("Uniprot", "ftp.uniprot.org")
walker.check_state()
This will create a dictionary formatted as a JSON file in the user’s home directory containing all the full paths as keys and the respective filenames as values. FTPwalker is designed with speed in mind by utilizing state-of-the-art high performance parallelism and concurrency algorithms to traverse FTP directory trees. The resultant hash table (i.e., dictionary) supports fast lookup for any file in any biological database.
This will create a dictionary formatted as a JSON file in the user’s home directory containing all the full paths as keys and the respective filenames as values. FTPflow is designed with speed in mind by utilizing state-of-the-art high performance parallelism and concurrency algorithms to traverse FTP directory trees. The resultant hash table (i.e., dictionary) supports fast lookup for any file in any biological database.
Installation:
For running the FTPwalker you need to have python3.x+ installed. Then you can use `pip` or `pip3` for installation.
For running the FTPflow you need to have python3.x+ installed. Then you can use `pip` or `pip3` for installation.
.. code-block:: python
# Install
sudo pip3 install FTPwalker
sudo pip3 install FTPflow
# Upgrade
sudo pip3 install FTPwalker --upgrade
sudo pip3 install FTPflow --upgrade
.. _Uniprot: http://uniprot.org
@@ -1,15 +1,15 @@
[![Build Status](https://travis-ci.org/Bohdan-Khomtchouk/FTPwalker.svg?branch=master)](https://travis-ci.org/Bohdan-Khomtchouk/FTPwalker)
[![Build Status](https://travis-ci.org/Bohdan-Khomtchouk/FTPflow.svg?branch=master)](https://travis-ci.org/Bohdan-Khomtchouk/FTPflow)
[![Open Source Love](https://badges.frapsoft.com/os/gpl/gpl.svg?v=102)](https://github.com/ellerbrock/open-source-badge/)
[![PyPI version](https://badge.fury.io/py/FTPwalker.svg)](https://badge.fury.io/py/FTPwalker)
[![PyPI version](https://badge.fury.io/py/FTPflow.svg)](https://badge.fury.io/py/FTPflow)
# FTPwalker
# FTPflow
`FTPwalker` is a Python package for optimally traversing extremely large FTP directory trees. It constitutes the algorithmic heart of the [PubData](https://github.com/Bohdan-Khomtchouk/PubData) search engine. FTPwalker creates a dictionary formatted as a JSON file in the user’s home directory containing all the full paths as keys and the respective filenames as values. FTPwalker is designed with speed in mind by utilizing state-of-the-art high performance parallelism and concurrency algorithms to traverse FTP directory trees. The resultant hash table (i.e., dictionary) supports fast lookup for any file in any biological database.
`FTPflow` is a Python package for optimally traversing extremely large FTP directory trees. It constitutes the algorithmic heart of the [PubData](https://github.com/Bohdan-Khomtchouk/PubData) search engine. FTPflow creates a dictionary formatted as a JSON file in the user’s home directory containing all the full paths as keys and the respective filenames as values. FTPflow is designed with speed in mind by utilizing state-of-the-art high performance parallelism and concurrency algorithms to traverse FTP directory trees. The resultant hash table (i.e., dictionary) supports fast lookup for any file in any biological database.
## Funding
`FTPwalker` is financially supported by the United States Department of Defense (DoD) through the National Defense Science and Engineering Graduate Fellowship (NDSEG) Program. This research was conducted with Government support under and awarded by DoD, Army Research Office (ARO), National Defense Science and Engineering Graduate (NDSEG) Fellowship, 32 CFR 168a.
`FTPflow` is financially supported by the United States Department of Defense (DoD) through the National Defense Science and Engineering Graduate Fellowship (NDSEG) Program. This research was conducted with Government support under and awarded by DoD, Army Research Office (ARO), National Defense Science and Engineering Graduate (NDSEG) Fellowship, 32 CFR 168a.
## Screenshots
Binary file not shown.
@@ -7,14 +7,14 @@
def read(fname):
return open(os.path.join(os.path.dirname(__file__), fname)).read()
setup(name='FTPwalker',
packages=['FTPwalker', "FTPwalker/daemons"],
setup(name='FTPflow',
packages=['FTPflow', "FTPflow/daemons"],
version='0.4',
description='Optimally traversing extremely large FTP directory trees.',
author='Bohdan Khomtchouk and Kasra Vand',
author_email='khomtchoukmed@gmail.com, kasraavand@gmail.com',
url='https://github.com/Bohdan-Khomtchouk/FTPwalker',
download_url='https://github.com/Bohdan-Khomtchouk/FTPwalker/tarball/0.1',
url='https://github.com/Bohdan-Khomtchouk/FTPflow',
download_url='https://github.com/Bohdan-Khomtchouk/FTPflow/tarball/0.1',
keywords=['FTP', 'traverse', 'directory tree', 'optimized'],
classifiers=[],
long_description=read("README"))
@@ -1,4 +1,4 @@
from FTPwalker.runwalker import ftpwalker
from FTPflow.runwalker import ftpflow
walker = ftpwalker("test", "ftp.kh.edu.tw")

0 comments on commit 4eb9d0e

Please sign in to comment.