Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Streaming]Online-learning : streaming source codes transporting #3

Merged
merged 2 commits into from
Jan 17, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
5 changes: 5 additions & 0 deletions .clang-format
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
BasedOnStyle: Google
ColumnLimit: 90
DerivePointerAlignment: false
IndentCaseLabels: false
PointerAlignment: Right
73 changes: 73 additions & 0 deletions .clang-tidy
Original file line number Diff line number Diff line change
@@ -0,0 +1,73 @@
# Disable the following checks with reasons in parenthesis:
#
# -bugprone-macro-parentheses (inconsistent style)
# -google-readability-todo (potentially too restrictive)
# -misc-non-private-member-variables-in-classes (potentially too restrictive)
# -misc-unused-parameters (can be cleaned up in batch and enabled)
# -modernize-avoid-c-arrays (too restrictive)
# -modernize-concat-nested-namespaces (inconsistent style)
# -modernize-pass-by-value (too restrictive)
# -modernize-return-braced-init-list (inconsistent style)
# -modernize-use-emplace (more subtle behavior)
# -modernize-use-nodiscard (too much noise)
# -modernize-use-trailing-return-type (inconsistent style)
# -modernize-use-override (TODO(mwtian): re-enable after fixing existing derived classes)
# -modernize-avoid-bind (incorrect conversion)
# -modernize-loop-convert (more subtle behavior)
# -modernize-replace-disallow-copy-and-assign-macro (inconsistent style)
# -modernize-make-unique (doesn't work with private constructor)
# -modernize-make-shared (doesn't work with private constructor)
# Other readability-* rules (potentially too noisy, inconsistent style)
# Other rules not mentioned here or below (not yet evaluated)
#
# TODO: enable google-* and readability-* families of checks.
Checks: >
abseil-*,
bugprone-*,
-bugprone-macro-parentheses,
google-*,
-google-readability-todo,
misc-*,
-misc-non-private-member-variables-in-classes,
-misc-unused-parameters,
modernize-*,
-modernize-avoid-c-arrays,
-modernize-concat-nested-namespaces,
-modernize-pass-by-value,
-modernize-return-braced-init-list,
-modernize-use-emplace,
-modernize-use-nodiscard,
-modernize-use-trailing-return-type,
-modernize-avoid-bind,
-modernize-loop-convert,
-modernize-replace-disallow-copy-and-assign-macro,
-modernize-make-unique,
-modernize-make-shared,
-modernize-use-override,
performance-*,
readability-avoid-const-params-in-decls,
readability-braces-around-statements,
readability-const-return-type,
readability-container-size-empty,
readability-delete-null-pointer,
readability-else-after-return,
readability-implicit-bool-conversion,
readability-make-member-function-const,
readability-misleading-indentation,
readability-misplaced-array-index,
readability-named-parameter,
readability-non-const-parameter,
readability-redundant-*,
readability-static-definition-in-anonymous-namespace,
readability-string-compare,
readability-suspicious-call-argument,

CheckOptions:
# Reduce noisiness of the bugprone-narrowing-conversions check.
- key: bugprone-narrowing-conversions.IgnoreConversionFromTypes
value: 'size_t;ptrdiff_t;size_type;difference_type'
- key: bugprone-narrowing-conversions.WarnOnEquivalentBitWidth
value: 'false'

# Turn all the warnings from the checks above into errors.
WarningsAsErrors: "*"
198 changes: 198 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,198 @@
# Bazel
bazel-bin/
bazel-out/
bazel-streaming/
bazel-test/

# Redis temporary files
*dump.rdb

# Python byte code files
*.pyc
python/.eggs

# Backup files
*.bak

# Emacs temporary files
*~
*#

# Compiled Object files
*.slo
*.lo
*.o
*.xo
*.obj

# Precompiled Headers
*.gch
*.pch

# Compiled Dynamic libraries
*.so
*.dylib
*.dll
python/ray/_raylet.pyd

# Incremental linking files
*.ilk

# Library export files
*.exp

# Debug symbols
*.pdb

# Fortran module files
*.mod
!deploy/ray-operator/go.mod

# Compiled Static libraries
*.lai
*.la
*.a
*.lib

# Executables
*.exe
*.out
*.app

# Visual Studio files
/packages
*.suo
*.user
*.VC.db
*.VC.opendb

# Protobuf-generated files
*_pb2.py
*.pb.h
*.pb.cc

# Ray cluster configuration
scripts/nodes.txt

# OS X folder attributes
.DS_Store

# Debug files
*.dSYM/
*.su

# Python setup files
*.egg-info

# Compressed files
*.gz

# Datasets from examples
**/MNIST_data/
**/cifar-10-batches-bin/

# Generated documentation files
/doc/_build
/doc/source/_static/thumbs
/doc/source/tune/generated_guides/

# User-specific stuff:
.idea/**/workspace.xml
.idea/**/tasks.xml
.idea/dictionaries
.llvm-local.bazelrc

# Sensitive or high-churn files:
.idea/**/dataSources/
.idea/**/dataSources.ids
.idea/**/dataSources.xml
.idea/**/dataSources.local.xml
.idea/**/sqlDataSources.xml
.idea/**/dynamic.xml
.idea/**/uiDesigner.xml

# Gradle:
.idea/**/gradle.xml
.idea/**/libraries
.idea

# Website
/site/Gemfile.lock
/site/.sass-cache
/site/_site

# Pytest Cache
**/.pytest_cache
**/.cache
.benchmarks
python-driver-*

# Vscode
.vscode/

*.iml

# Java
java/**/target
java/**/lib
java/**/.settings
java/**/.classpath
java/**/.project
java/runtime/native_dependencies/

dependency-reduced-pom.xml

# Cpp
cpp/example/thirdparty/

# streaming/python
streaming/python/generated/
streaming/java/streaming-runtime/src/main/java/io/ray/streaming/runtime/generated/
streaming/build/java
.clwb
streaming/**/.settings
streaming/java/**/target
streaming/java/**/.classpath
streaming/java/**/.project
streaming/java/**/*.log

# pom.xml files generated from pom_template.xml
java/**/pom.xml
streaming/java/**/pom.xml

# python virtual env
venv

# pyenv version file
.python-version

# Vim
.*.swp
*.swp
tags
tags.lock
tags.temp

# Emacs
.#*

# tools
tools/prometheus*

# ray project files
project-id
.mypy_cache/

# gitpod cache related
.pip-cache/
.bazel-cache/

# release test related
.anyscale.yaml
test_state.json

# workflow storage
workflow_data/

# vscode java extention generated
.factorypath
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# Mobius online learning.
# Mobius : online machine learning.

## Code Editor
Recommend Atom (https://atom.io/) as the code editor.
Recommended plugins: atom-beautify, python-indent, auto-indent, vim-mode-plus (for VIM-ers)
## Streaming

## Training
Loading