Permalink
Commits on Sep 28, 2017
  1. update travis config

    windreamer committed Sep 28, 2017
  2. update req.txt

    windreamer committed Sep 28, 2017
  3. fix bug

    windreamer committed Sep 13, 2017
  4. fix bug

    windreamer committed Sep 4, 2017
  5. fix missing

    windreamer committed Aug 28, 2017
  6. fix bug

    windreamer committed Aug 23, 2017
  7. py3k suuport for drum/mrum

    windreamer committed Aug 23, 2017
  8. fix bug

    windreamer committed Aug 22, 2017
  9. py3k for examples

    windreamer committed Aug 22, 2017
  10. py3k support

    windreamer committed Aug 17, 2017
  11. fix: fix the posix file too slow

    lianwenbo authored and windreamer committed Aug 21, 2017
  12. fix: neg version in beansdb.write_record

    yangxiufeng authored and windreamer committed Aug 19, 2017
  13. fix: remove file info in beansdb.py

    lianwenbo authored and windreamer committed Aug 18, 2017
  14. hotfix for openfile

    windreamer committed Aug 17, 2017
  15. fix: reduce the count of lstat

    lianwenbo authored and windreamer committed Aug 15, 2017
  16. fix: fix the bug for openfile

    lianwenbo authored and windreamer committed Aug 15, 2017
  17. fix: fix the bug in walk dir

    lianwenbo authored and windreamer committed Aug 11, 2017
  18. fix: fix the bug for walk about the symlink

    lianwenbo authored and windreamer committed Aug 9, 2017
    1)修改walk的实现,使其与os.walk的产生的结果一致
    2)如果followlinks为true的话,对于失效的link不作处理
    3)对于非失效的link,但是其target是指向本地的,则需要使用本地的walk操作
    4)对于一个path,如果其下面的文件,如果是link类型的话,需要判断是否是dir,如果不是,则全部放入file
    5)一个root进来的时候,需要先找到对应的真实路径,之后再进行遍历操作
  19. fix : deleted unused const

    lianwenbo authored and windreamer committed Jul 31, 2017
  20. fix: Adjust the impl for moosefs

    lianwenbo authored and windreamer committed Jul 25, 2017
    1)增加了关于MooseFS中的实现,这个实现主要是因为不想直接用fuse的walk
    速度太慢,使用proxyconn连接之后,速度与原先的操作相当,甚至更好一些
    2)依据moosefs的实现,修改了proxyconn中的getattr, readlink, readchunk, getdirplus
    等几个实现
    3)去掉所有的moosefs的调用
  21. feat: new implementation for fs of dpark

    lianwenbo authored and windreamer committed Jul 17, 2017
    1)修改dpark的文件系统接口
    2)所有的fs的api由一个FileManager来进行管理
    3)一个fs对应open一个ReadableFile对象,如果用户需要
    扩展一个新的文件系统,需要实现一个fs对象和对应的
    ReadableFile对象
    4)对于moose的file的实现,使用proxy connection向moosefs
    发请求
    5)复制之前moose的实现方法
    6)用一个file_manager负责管理所有的文件系统接口,通过register完成
    7)使用python-modernize处理python2, python3的兼容问题
    8)MooseFile的序列化问题,需要定义__getstate__, __setstate__
  22. fix dgrep (#235)

    windreamer committed Jun 7, 2017
  23. fix: import new api for lz comp&decomp (#232)

    lianwenbo authored and windreamer committed May 19, 2017
    将lz4中的压缩与解压缩的api替换成最新的
  24. feat: Add new support for scribe in DStream (#230)

    lianwenbo authored and windreamer committed May 12, 2017
    * feat: Add new support for scribe in DStream
    
    1)基于NetworkInputStream添加了一个scribeInputStream,重新实现了receive的操作
    2)一个scribestream启动时,需要启动一个thrift server,用于接收数据,这些数据被
    暂存到一个deque对象中。每次主线程调用receiv的操作时,从deque中pop对象出来,并
    yield出去
    3)thrift的server启动时,需要注册到一个zk下,用于上游发数据的程序将数据流定向
    到某个DStream的实例上
    
    * fix: Deal with the situation when scribe is not available
    
    * fix: let the scribeTextStream raise when no scribe support in env