Set up CI with Azure Pipelines #7

azure-pipelines · 2018-11-19T20:21:21Z

No description provided.

msftclas · 2018-11-19T20:21:32Z

Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.

❌ azure-pipelines[bot] sign now
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

* Simple integration into CMake build system * Adds vcpkg as a submodule and updates build.py to install hosting dependencies * Don't create vcpkg executable if already created * Fixes how CMake finds toolchain file and quick changes to build.py * Removes setting the CMAKE_TOOLCHAIN_FILE in build.py * Adds Boost Beast echo server and Boost program_options * Fixes spacing problem with program_options * Adds Microsoft headers to all the beast server headers * Removes CXX 14 from CMake file * Adds TODO to create configuration class * Run clang-format on main * Better exception handling of program_options * Remove vckpg submodule via ssh * Add vcpkg as https * Adds onnxruntime namespace to call classes * Fixed places where namespaces were anonymous * Adds a TODO to use the logger * Moves all setting namespace shortnames outside of onnxruntime namespace * Add onnxruntime session options to force app to link with it * Set CMAKE_TOOLCHAIN_FILE in build.py * Remove whitespace * Adds initial ONNX Hosting tests (#5) * Add initial test which is failing linking with no main * Adds test_main to get hosting tests working * Deletes useless add_executable line * Merge changes from upstream * Enable CI build in Vienna environment * make hosting_run*.sh executable * Add boost path in unittest * Add boost to TEST_INC_DIR * Add component detection task in ci yaml * Get tests and hosting to compile with re2 (#7) * Add finding boost packages before using it in unit tests * Add predict.proto and build * Ignore unused parameters in generated code * Removes std::regex in favor of re2 (#8) * Removes std::regex in favor of re2 * Adds back find_package in unit tests and fixes regexes * Adds more negative test cases * Adding more protos * Fix google protobuf file path in the cmake file * Ignore unused parameters for pb generated code * Updates onnx submodule (#10) * Remove duplicated lib in link * Follow Google style guide (#11) * Google style names * Adds more * Adds an additional namespace * Fixes header guards to match filepaths * Consume protobuf * Unit Test setup * Json deserialization simple test cases * Split hosting app to lib and exe for testability * Add more cases * Clean up * Add more comments * Update namespace and format the cmake files * Update cmake/external/onnx to checkout 1ec81bc6d49ccae23cd7801515feaadd13082903 * Separate h and cc in http folder * Clean up hosting application cmake file * Enable logging and proper initialize the session * Update const position for GetSession() * Take latest onnx and onnx-tensorrt * Creates configuration header file for program_options (#15) * Sets up PredictRequest callback (#16) * Init version, porting from prototype, e2e works * More executor implementation * Adds function on application startup (#17) * Attempts to pass HostingEnvironment as a shared_ptr * Removes logging and environment from all http classes * Passes http details to OnStart function * Using full protobuf for hosting app build * MLValue2TensorProto * Revert back changes in inference_session.cc * Refactor logger access and predict handler * Create an error handling callback (#19) * Creates error callback * Logs error and returns back as JSON * Catches exceptions in user functions * Refactor executor and add some test cases * Fix build warning * Add onnx as a dependency and in includes to hosting app (#20) * Converter for specific types and more UTs * More unit tests * Update onnx submodule * Fix string data test * Clean up code * Cleanup code * Refactor logging to use unique id per request and take logging level from user (#21) * Removes capturing env by reference in main * Uses uuid for logging ids * Take logging_level as a program argument * Pass logging_level to default_logging_manager * Change name of logger to HostingApp * Log if request id is null * Update GetHttpStatusCode signature * Fix random result issue and camel-case names * Rollback accidentally changed pybin_state.cc * Rollback pybind_state.cc * Generate protobuf status from onnxruntime status * Fix function name in error message * Clean up comments * Support protobuf byte array as input * Refactor predict handler and add unit tests * Add one more test * update cmake/external/onnx * Accept more protobuf MIME types * Update onnx-tensorrt * Add build instruction and usage doc * Address PR comments * Install g++-7 in the Ubuntu 16.04 build image for vcpkg * Fix onnx-tensorrt version * Check return value during initialization * Fix infinite loop when http port is in use (#29) * Simplify Executor.cc by breaking up Run method (#27) * Move request id to Executor constructor * Refactor the logger to respect user verbosity level * Use Arena allocator instead of device * Creates initial executor tests * Merge upstream master (#31) * Remove all possible shared_ptrs (#30) * Changes GetLogger to unique_ptr * Reserve BFloat raw data vector size * Change HostingEnvironment to being passed by lvalue and rvalue references * Change routes to getting passed by const references * Enable full protobuf if building hosting (#32) * Building hosting application no longer needs use_full_protobuf flag * Improve hosting application docs * Move server core into separate folder (#34) * Turn hosting project off by default (#38) * Remove vcpkg as a submodule and download/install Boost from source (#39) * Remove vcpkg * Use CMake script to download and build Boost as part of the project * Remove std::move for const references * Remove error_code.proto * Change wording of executable help description * Better GenerateProtobufStatus description * Remove error_code protobuf from CMake files * Use all outputs if no filter is given * Pass MLValue by const reference in MLValueToTensorProto * Rename variables to argc and argv * Revert "Use all outputs if no filter is given" This reverts commit 7554190. * Remove all header guards in favor of #pragma once * Reserve size for output vector and optimize for-loop * Use static libs by default for Boost * Improves documentation for GenerateResponseInJson function * Start Result enum at 0 instead of 1 * Remove g++ from Ubuntu's install.sh * Update cmake files * Give explanation for Result enum type * Remove all program options shortcuts except for -h * Add comments for predict.proto * Fix JSON for error codes * Add notice on hosting application docs that it's in beta * Change HostingEnvironment back to a shared_ptr * Handle empty output_filter field * Fix build break * Refactor unit tests location and groups * First end-to-end test * Add missing log * Missing req id and client req id in error response * Add one test case to validate failed resp header * Add build flag for hosting app end to end tests * Update pipeline setup to run e2e test for CI build * Model Zoo data preparation and tests * Add protobuf tests * Remove mention of needing g++-7 in BUILD.md * Make GetAppLogger const * Make using_raw_data_ match the styling of other fields * Avoid copy of strings when initializing model * Escape JSON strings correctly for error messages (#44) * Escape JSON strings correctly * Add test examples with lots of carriage returns * Add result validation * Remove temporary path * Optimize model zoo test execution * Improve reliability of test cases * Generate _pb2.py during the build time * README for integration tests * Pass environment by pointer instead of shared_ptr to executor (#49) * More Integration tests * Remove generated files * Make session private and use a getter instead (#53) * logging_level to log_level for CLI * Single model prediction shortcut * Health endpoint * Integration tests * Rename to onnxruntime server * Build ONNX Server application on Windows (#57) * Gets Boost compiling on Windows * Fix integer conversion and comparison problems * Use size_t in converter_tests instead of int * Fix hosting integration tests on Windows * Removes checks for port because it's an unsigned short * Fixes comparison between signed and unsigned data types * Pip install protobuf and numpy * Missing test data from the rename change * Fix server app path (#58) * Pass shared_ptr by const reference to avoid ref count increase (#59) * Download test model during test setup * Make download into test_util * Rename ci pipeline for onnx runtime server * Support up to 10MiB http request (#61) * Changes minimum request size to 10MB to support all models in ONNX Model Zoo

### Description Release OrtEnv before main function returns. Before this change, OrtEnv is deleted when C/C++ runtime destructs all global variables in ONNX Runtime's core framework. The callstack is like this: ``` * frame #0: 0x00007fffee39f5a6 libonnxruntime.so.1.16.0`onnxruntime::Environment::~Environment(this=0x00007fffee39fbf2) at environment.h:20:7 frame #1: 0x00007fffee39f614 libonnxruntime.so.1.16.0`std::default_delete<onnxruntime::Environment>::operator()(this=0x00007ffff4c30e50, __ptr=0x0000000005404b00) const at unique_ptr.h:85:2 frame #2: 0x00007fffee39edca libonnxruntime.so.1.16.0`std::unique_ptr<onnxruntime::Environment, std::default_delete<onnxruntime::Environment>>::~unique_ptr(this=0x5404b00) at unique_ptr.h:361:17 frame #3: 0x00007fffee39e2ab libonnxruntime.so.1.16.0`OrtEnv::~OrtEnv(this=0x00007ffff4c30e50) at ort_env.cc:43:1 frame #4: 0x00007fffee39fa96 libonnxruntime.so.1.16.0`std::default_delete<OrtEnv>::operator()(this=0x00007fffefff8f78, __ptr=0x00007ffff4c30e50) const at unique_ptr.h:85:2 frame #5: 0x00007fffee39f394 libonnxruntime.so.1.16.0`std::unique_ptr<OrtEnv, std::default_delete<OrtEnv>>::~unique_ptr(this=0x7ffff4c30e50) at unique_ptr.h:361:17 frame #6: 0x00007ffff78574b5 libc.so.6`__run_exit_handlers + 261 frame #7: 0x00007ffff7857630 libc.so.6`exit + 32 frame #8: 0x00007ffff783feb7 libc.so.6`__libc_start_call_main + 135 frame #9: 0x00007ffff783ff60 libc.so.6`__libc_start_main@@GLIBC_2.34 + 128 frame #10: 0x0000000000abbdee node`_start + 46 ``` After this change, OrtEnv will be deleted before the main function returns and nodejs is still alive.

Co-authored-by: HailoRT-Automation <contact@hailo.ai>

Added Reshape/Concat/Softmax op support

### Description Release OrtEnv before main function returns. Before this change, OrtEnv is deleted when C/C++ runtime destructs all global variables in ONNX Runtime's core framework. The callstack is like this: ``` * frame #0: 0x00007fffee39f5a6 libonnxruntime.so.1.16.0`onnxruntime::Environment::~Environment(this=0x00007fffee39fbf2) at environment.h:20:7 frame microsoft#1: 0x00007fffee39f614 libonnxruntime.so.1.16.0`std::default_delete<onnxruntime::Environment>::operator()(this=0x00007ffff4c30e50, __ptr=0x0000000005404b00) const at unique_ptr.h:85:2 frame microsoft#2: 0x00007fffee39edca libonnxruntime.so.1.16.0`std::unique_ptr<onnxruntime::Environment, std::default_delete<onnxruntime::Environment>>::~unique_ptr(this=0x5404b00) at unique_ptr.h:361:17 frame microsoft#3: 0x00007fffee39e2ab libonnxruntime.so.1.16.0`OrtEnv::~OrtEnv(this=0x00007ffff4c30e50) at ort_env.cc:43:1 frame microsoft#4: 0x00007fffee39fa96 libonnxruntime.so.1.16.0`std::default_delete<OrtEnv>::operator()(this=0x00007fffefff8f78, __ptr=0x00007ffff4c30e50) const at unique_ptr.h:85:2 frame microsoft#5: 0x00007fffee39f394 libonnxruntime.so.1.16.0`std::unique_ptr<OrtEnv, std::default_delete<OrtEnv>>::~unique_ptr(this=0x7ffff4c30e50) at unique_ptr.h:361:17 frame microsoft#6: 0x00007ffff78574b5 libc.so.6`__run_exit_handlers + 261 frame microsoft#7: 0x00007ffff7857630 libc.so.6`exit + 32 frame microsoft#8: 0x00007ffff783feb7 libc.so.6`__libc_start_call_main + 135 frame microsoft#9: 0x00007ffff783ff60 libc.so.6`__libc_start_main@@GLIBC_2.34 + 128 frame microsoft#10: 0x0000000000abbdee node`_start + 46 ``` After this change, OrtEnv will be deleted before the main function returns and nodejs is still alive.

Set up CI with Azure Pipelines

ba0bff5

raymondxyang closed this Nov 19, 2018

raymondxyang deleted the azure-pipelines1 branch November 19, 2018 20:22

yufenglee mentioned this pull request May 7, 2019

MKLDNN-DO Subgraph Optimization #966

Closed

tmccrmck added a commit to tmccrmck/onnxruntime that referenced this pull request Aug 28, 2019

Get tests and hosting to compile with re2 (microsoft#7)

2c88022

yueyihua mentioned this pull request Jan 9, 2020

Runtime eror before my code return #2804

Closed

rashedkoutayni mentioned this pull request Apr 1, 2020

Segmentation Fault when running on Raspberry Pi 3B+ #3296

Closed

Liujingxiu23 mentioned this pull request Jun 12, 2020

How to get the current provider used in C++ inference stage? #4140

Closed

quantum-fusion mentioned this pull request Aug 11, 2020

ONNXRuntime JAVA JNI build failure #4755

Closed

jywu-msft mentioned this pull request Sep 2, 2020

TensorRT 7.1.3 / Cuda11 / CuDNN 8 - supported yet? #4841

Closed

EasonChow001 mentioned this pull request Mar 23, 2021

Plugin [id: 'com.diffplug.spotless', version: '5.9.0'] was not found #7086

Closed

matthill mentioned this pull request Apr 15, 2021

Memory leaks and valgrind errors when running with TensorRT #7286

Open

chilo-ms mentioned this pull request Apr 22, 2021

TRT EP memory leak fix #7415

Merged

hoozh mentioned this pull request May 18, 2021

android app crash when use nnapi #7744

Closed

pvavercak mentioned this pull request May 19, 2021

TensorRT execution provider SEGFAULT #7757

Open

anshoomehra mentioned this pull request May 21, 2021

ONNX Exported BART Model Performance is degraded than native pytorch on T4 #7796

Open

sunhmy mentioned this pull request Aug 2, 2021

Failed to use self created stream for a new cuda session #8578

Closed

jun-lv-17 mentioned this pull request Sep 2, 2021

Crash with bus error on Android (arm-v7a) when creating InferenceSession with SSD model #4103

Closed

fazeeljunejo mentioned this pull request Nov 29, 2021

Segmentation Fault when calling Provider Host CPU #9874

Closed

JonathanSum mentioned this pull request Mar 27, 2022

[Lot of people have this issue] The model can not "really" do inference; Loading issue is solved. #10990

Closed

msftlincoln mentioned this pull request Jul 19, 2022

cpplint & Eager mode: refactor and add comments to empty_* functions, general lint cleanup in ort_aten #12238

Merged

Amadeuy mentioned this pull request Aug 4, 2022

Superseded by #7. #12453

Closed

alexbarl mentioned this pull request Oct 12, 2022

InferenceSession init hangs for multiple models on Azure Kubernetes Service #13291

Open

adjhawar mentioned this pull request Nov 18, 2022

Help in running onnxruntime with SNPE as execution provider #13693

Open

Kangmo mentioned this pull request Jan 5, 2023

[Build] Dockerfile.arm64 - No module named 'packaging' error #14140

Open

ns-wxin mentioned this pull request Jan 31, 2023

How to release a session properly? #11529

Open

guschmue pushed a commit that referenced this pull request May 17, 2023

Update Emscription submodule to 3.1.37 (#7)

e856d62

lfch mentioned this pull request Oct 13, 2023

GPU Usage 100% #17942

Closed

justgo-now mentioned this pull request Dec 11, 2023

segmentation fault when do inference sometimes with onnxruntime-1.15.1 also can produce by onnxruntime-1.16.3 #18776

Closed

GerHobbelt pushed a commit to GerHobbelt/onnxruntime that referenced this pull request Jan 26, 2024

v4.15.0 (microsoft#7)

bf7c4e4

Co-authored-by: HailoRT-Automation <contact@hailo.ai>

horror-proton mentioned this pull request Feb 21, 2024

A bug occurs when the program terminates #15174

Open

chenfeiyue-cfy pushed a commit to chenfeiyue-cfy/onnxruntime that referenced this pull request Mar 7, 2024

Merge pull request microsoft#7 from chenfeiyue-cfy/vsinpu

afafc34

Added Reshape/Concat/Softmax op support

tianleiwu mentioned this pull request Mar 20, 2024

Recognize NaN operands in Min and Max ops #19984

Merged

sansrem mentioned this pull request Jun 11, 2024

ONNXRuntime 1.18 crashing with TensorRT EP when dealing with big inputs #21001

Closed

DxUr mentioned this pull request Jul 8, 2024

[Build] Heap overflow caused by the onnx runtime #21283

Open

yufenglee mentioned this pull request Aug 26, 2024

[Performance] Why does genai run 2x as fast as vanilla managed onnxruntime? #21847

Open

carsonswope added a commit to boris-fx/onnxruntime that referenced this pull request Aug 29, 2024

add win build to jenkins, microsoft#7 (fix vs2019 build errors)

49cdb5c

sai-fpp mentioned this pull request Sep 6, 2024

onnxruntime c++ logging crash #22013

Closed

frenetj mentioned this pull request Oct 15, 2024

Crash running inference on a specific ONNX model #22448

Closed

FaithyQi mentioned this pull request Oct 22, 2024

[Mobile] null pointer dereference #22538

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Set up CI with Azure Pipelines #7

Set up CI with Azure Pipelines #7

azure-pipelines bot commented Nov 19, 2018

msftclas commented Nov 19, 2018

Set up CI with Azure Pipelines #7

Set up CI with Azure Pipelines #7

Conversation

azure-pipelines bot commented Nov 19, 2018

msftclas commented Nov 19, 2018