Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Branch 158278922 #10495

Closed
wants to merge 58 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
58 commits
Select commit Hold shift + click to select a range
515b3ac
Add Clutz to TensorBoard build
jart Jun 5, 2017
bee2621
Speed up multinomial_op on CPU by using a vectorized Eigen expression…
tensorflower-gardener Jun 5, 2017
827874c
In the CUDA path of depthwise_conv2d, add a fast NCHW backward input …
tensorflower-gardener Jun 5, 2017
9e68997
[SE] Add cudnnTransformTensor to StreamExecutor.
Jun 5, 2017
93c57c6
Handle control flow logic properly:
benoitsteiner Jun 5, 2017
54ccc3e
[XLA] Add module-scoped HLO dataflow analysis.
meheffernan Jun 5, 2017
3d52e4c
Fix create_meta_graph to respect an empty collection_list.
tensorflower-gardener Jun 5, 2017
68fdb76
Add DNNLinearCombinedClassifier.
tensorflower-gardener Jun 5, 2017
7d76a90
Add question marks next to items in the graph legend.
tensorflower-gardener Jun 5, 2017
0cc851c
Call maxcut algorithm in the model_based_cost_estimator.
Jun 5, 2017
a58553e
Add function in shape inference to try to infer output tensor content…
tensorflower-gardener Jun 5, 2017
1341382
Corrected comment: import_scoped_metagraph does not return a Saver.
tensorflower-gardener Jun 6, 2017
9d12c62
Refactor the document and some polishment
tensorflower-gardener Jun 6, 2017
7d3fbba
Extracted dnn estimator testing utils to be reused by dnn-linear-comb…
ispirmustafa Jun 6, 2017
cc1a02d
Add fp16 support to convolutional layers that support it.
fchollet Jun 6, 2017
232e9d8
tf_workspace() claims that the tf_repo_name argument is unused.
tensorflower-gardener Jun 6, 2017
f0c4c6c
In the CUDA path of depthwise_conv2d, add a fast NCHW backward filter…
tensorflower-gardener Jun 6, 2017
0fe0bfc
Remove unused protobuf header inclusions
tensorflower-gardener Jun 6, 2017
b6a8848
Enabling python configuration to use a remotely generated configurati…
tensorflower-gardener Jun 6, 2017
f3f53e8
[tf.contrib.data] Add support for dicts and remove lists from nested …
mrry Jun 6, 2017
2a61c16
In cpu compiler's CompileAheadOfTime, pass ordering when compiling en…
tensorflower-gardener Jun 6, 2017
2e7e1d5
Small fix for how std::move is used in constructors
tensorflower-gardener Jun 6, 2017
9184726
Avoid unnecessary copying of map data during visitation
tensorflower-gardener Jun 6, 2017
e9a889c
Pass int parameter by value, not by const reference
tensorflower-gardener Jun 6, 2017
61c8a74
Minor cleanup: Add braces around if statement arms; remove redundant …
tensorflower-gardener Jun 6, 2017
7422061
Set device cores and frequency in op_level_cost_estimator_test,
tensorflower-gardener Jun 6, 2017
dc81a24
Updates to the WALSMatrixFactorization estimator:
tensorflower-gardener Jun 6, 2017
7125733
Create a set of sample data for the audio plugin
wchargin Jun 6, 2017
b01d4b9
[XLA] Remove outdated todo.
jpienaar Jun 6, 2017
e55f2e0
Propagates constants through switch nodes.
benoitsteiner Jun 6, 2017
2b3535c
Minor docstring fix for build_parsing_serving_input_receiver_fn
davidsoergel Jun 6, 2017
cabc5c3
[XLA] Add xla_disable_hlo_passes to DebugOptions
eliben Jun 6, 2017
81cf61f
Initialize tensor in graph_properties_test, to avoid msan complaint.
tensorflower-gardener Jun 6, 2017
b65eb3f
Speed up atrous_convolution_test by combining evaluations.
tensorflower-gardener Jun 6, 2017
96cb4d1
Add support of scale_l1 == 0. or scale_l2 == 0 to l1_l2_regularizer.
sguada Jun 6, 2017
df5906f
Mark saver/restore ops that depend on filesystem as stateful to disab…
tensorflower-gardener Jun 6, 2017
3ca6533
Update ops-related pbtxt files.
tensorflower-gardener Jun 6, 2017
a4e7b7a
Fixes a bug in setting default optimizers for DNNLinearCombinedClassi…
tensorflower-gardener Jun 6, 2017
51acad0
Add tests with different delta to huber_loss.
sguada Jun 6, 2017
b495155
Add only string constants to ASSET_FILEPATHS collection.
davidsoergel Jun 6, 2017
65ce8c7
Add arrowheads to dataflow edges.
tensorflower-gardener Jun 6, 2017
69c9365
Extracted linear estimator testing utils to be reused by dnn-linear-c…
ispirmustafa Jun 6, 2017
05412bd
[XLA] Simplify Shape traversal visitors.
meheffernan Jun 6, 2017
7f5384d
Making load() work for resource variables.
alextp Jun 6, 2017
0ea0bf5
Add a frontend for viewing the first ops that exhibit bad values (NaN…
tensorflower-gardener Jun 6, 2017
8f89b65
Profile memory usage in VirtualScheduler and report peak memory usage.
tensorflower-gardener Jun 6, 2017
8ad6a03
Java: Update Maven release to 1.2.0-rc2
asimshankar Jun 7, 2017
3cf88d3
When GPU is configured, do not require --config=cuda.
gunan Jun 7, 2017
85355f0
Add missing header inclusion
tensorflower-gardener Jun 7, 2017
4199775
Sort header inclusions; define EIGEN_USE_THREADS where headers depend…
tensorflower-gardener Jun 7, 2017
1d67379
Minor cleanup
tensorflower-gardener Jun 7, 2017
3b6fe94
Properly handle shape nodes that have a preexisting control dependency
benoitsteiner Jun 7, 2017
b9d5e14
[XLA] Start collecting flags for debug options in a single place.
eliben Jun 7, 2017
9f17c26
[XLA] Add HloLocation to dataflow analysis.
meheffernan Jun 7, 2017
cc6c91a
Remove a further unused proto header inclusion
tensorflower-gardener Jun 7, 2017
611c82b
Adds integration test for DNNLinearCombined((Classifier)|(Regressor)).
tensorflower-gardener Jun 7, 2017
7b5302a
Adds ability to set a "family" attribute in Tensorflow summaries, which
tensorflower-gardener Jun 7, 2017
213a777
Merge commit for internal changes
Jun 7, 2017
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
8 changes: 4 additions & 4 deletions WORKSPACE
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,11 @@ workspace(name = "org_tensorflow")

http_archive(
name = "io_bazel_rules_closure",
sha256 = "edc91f556b762fc5212d1050d00b12e40dd0b0b1c1d5d96886b59e9a30a6cae4",
strip_prefix = "rules_closure-3f07fb6a58870afbb36051bd5d54da4479561cc6",
sha256 = "bc41b80486413aaa551860fc37471dbc0666e1dbb5236fb6177cb83b0c105846",
strip_prefix = "rules_closure-dec425a4ff3faf09a56c85d082e4eed05d8ce38f",
urls = [
"http://mirror.bazel.build/github.com/bazelbuild/rules_closure/archive/3f07fb6a58870afbb36051bd5d54da4479561cc6.tar.gz", # 2017-05-31
"https://github.com/bazelbuild/rules_closure/archive/3f07fb6a58870afbb36051bd5d54da4479561cc6.tar.gz",
"http://mirror.bazel.build/github.com/bazelbuild/rules_closure/archive/dec425a4ff3faf09a56c85d082e4eed05d8ce38f.tar.gz", # 2017-06-02
"https://github.com/bazelbuild/rules_closure/archive/dec425a4ff3faf09a56c85d082e4eed05d8ce38f.tar.gz",
],
)

Expand Down
6 changes: 6 additions & 0 deletions configure
Original file line number Diff line number Diff line change
Expand Up @@ -687,6 +687,12 @@ if is_windows; then
write_action_env_to_bazelrc "CUDA_PATH" "$CUDA_PATH"
write_action_env_to_bazelrc "CUDA_COMPUTE_CAPABILITIES" "$CUDA_COMPUTE_CAPABILITIES"
write_action_env_to_bazelrc "NO_WHOLE_ARCHIVE_OPTION" "1"
write_to_bazelrc "build --config=win-cuda"
write_to_bazelrc "test --config=win-cuda"
else
# If CUDA is enabled, always use GPU during build and test.
write_to_bazelrc "build --config=cuda"
write_to_bazelrc "test --config=cuda"
fi

# end of if "$TF_NEED_CUDA" == "1"
Expand Down
3 changes: 3 additions & 0 deletions tensorflow/BUILD
Original file line number Diff line number Diff line change
Expand Up @@ -245,6 +245,7 @@ filegroup(
"//tensorflow/contrib/data/python/framework:all_files",
"//tensorflow/contrib/data/python/kernel_tests:all_files",
"//tensorflow/contrib/data/python/ops:all_files",
"//tensorflow/contrib/data/python/util:all_files",
"//tensorflow/contrib/distributions:all_files",
"//tensorflow/contrib/factorization:all_files",
"//tensorflow/contrib/factorization/kernels:all_files",
Expand Down Expand Up @@ -369,6 +370,8 @@ filegroup(
"//tensorflow/tensorboard/components/tf_graph_controls/demo:all_files",
"//tensorflow/tensorboard/components/tf_graph_dashboard:all_files",
"//tensorflow/tensorboard/components/tf_graph_dashboard/demo:all_files",
"//tensorflow/tensorboard/components/tf_graph_debugger_data_card:all_files",
"//tensorflow/tensorboard/components/tf_graph_debugger_data_card/demo:all_files",
"//tensorflow/tensorboard/components/tf_graph_info:all_files",
"//tensorflow/tensorboard/components/tf_graph_info/demo:all_files",
"//tensorflow/tensorboard/components/tf_graph_loader:all_files",
Expand Down
1 change: 1 addition & 0 deletions tensorflow/cc/saved_model/loader.cc
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@ limitations under the License.
#include "tensorflow/core/platform/env.h"
#include "tensorflow/core/platform/protobuf_internal.h"
#include "tensorflow/core/protobuf/saved_model.pb.h"
#include "tensorflow/core/protobuf/saver.pb.h"
#include "tensorflow/core/public/session.h"
#include "tensorflow/core/public/session_options.h"
#include "tensorflow/core/util/tensor_bundle/naming.h"
Expand Down
2 changes: 1 addition & 1 deletion tensorflow/compiler/aot/BUILD
Original file line number Diff line number Diff line change
Expand Up @@ -128,8 +128,8 @@ cc_library(
"//tensorflow/compiler/xla/legacy_flags:compiler_functor_flags",
"//tensorflow/compiler/xla/legacy_flags:cpu_compiler_flags",
"//tensorflow/compiler/xla/legacy_flags:cpu_runtime_flags",
"//tensorflow/compiler/xla/legacy_flags:debug_options_flags",
"//tensorflow/compiler/xla/legacy_flags:hlo_graph_dumper_flags",
"//tensorflow/compiler/xla/legacy_flags:hlo_pass_pipeline_flags",
"//tensorflow/compiler/xla/legacy_flags:llvm_util_flags",
"//tensorflow/compiler/xla/legacy_flags:service_flags",
"//tensorflow/compiler/xla/legacy_flags:util_flags",
Expand Down
4 changes: 2 additions & 2 deletions tensorflow/compiler/aot/tfcompile_main.cc
Original file line number Diff line number Diff line change
Expand Up @@ -28,8 +28,8 @@ limitations under the License.
#include "tensorflow/compiler/xla/legacy_flags/compiler_functor_flags.h"
#include "tensorflow/compiler/xla/legacy_flags/cpu_compiler_flags.h"
#include "tensorflow/compiler/xla/legacy_flags/cpu_runtime_flags.h"
#include "tensorflow/compiler/xla/legacy_flags/debug_options_flags.h"
#include "tensorflow/compiler/xla/legacy_flags/hlo_graph_dumper_flags.h"
#include "tensorflow/compiler/xla/legacy_flags/hlo_pass_pipeline_flags.h"
#include "tensorflow/compiler/xla/legacy_flags/llvm_util_flags.h"
#include "tensorflow/compiler/xla/legacy_flags/service_flags.h"
#include "tensorflow/compiler/xla/legacy_flags/util_flags.h"
Expand Down Expand Up @@ -142,7 +142,7 @@ int main(int argc, char** argv) {
xla::legacy_flags::AppendCpuCompilerFlags(&flag_list);
xla::legacy_flags::AppendCpuRuntimeFlags(&flag_list);
xla::legacy_flags::AppendHloGraphDumperFlags(&flag_list);
xla::legacy_flags::AppendHloPassPipelineFlags(&flag_list);
xla::legacy_flags::AppendDebugOptionsFlags(&flag_list);
xla::legacy_flags::AppendLlvmUtilFlags(&flag_list);
xla::legacy_flags::AppendServiceFlags(&flag_list);
xla::legacy_flags::AppendUtilFlags(&flag_list);
Expand Down
2 changes: 1 addition & 1 deletion tensorflow/compiler/tf2xla/xla_compiler.cc
Original file line number Diff line number Diff line change
Expand Up @@ -70,7 +70,7 @@ bool XlaCompiler::Argument::operator==(
}

XlaCompiler::XlaCompiler(XlaCompiler::Options options)
: options_(std::move(options)),
: options_(options),
initialization_status_(Status::OK()),
next_step_id_(1),
device_(
Expand Down
2 changes: 1 addition & 1 deletion tensorflow/compiler/xla/client/computation.cc
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ Computation::Computation(ServiceInterface* parent,
: handle_(handle), parent_(parent) {}

Computation::Computation(Computation&& computation)
: handle_(computation.handle_), parent_(computation.parent_) {
: handle_(std::move(computation.handle_)), parent_(computation.parent_) {
computation.ResetWithoutFreeing();
}

Expand Down
26 changes: 14 additions & 12 deletions tensorflow/compiler/xla/legacy_flags/BUILD
Original file line number Diff line number Diff line change
Expand Up @@ -65,6 +65,20 @@ cc_library(
],
)

cc_library(
name = "debug_options_flags",
srcs = ["debug_options_flags.cc"],
hdrs = ["debug_options_flags.h"],
deps =
[
":parse_flags_from_env",
"//tensorflow/compiler/xla:types",
"//tensorflow/compiler/xla:xla_proto",
"//tensorflow/core:framework_internal",
"//tensorflow/core:lib",
],
)

cc_library(
name = "cpu_compiler_flags",
srcs = ["cpu_compiler_flags.cc"],
Expand Down Expand Up @@ -160,18 +174,6 @@ cc_library(
],
)

cc_library(
name = "hlo_pass_pipeline_flags",
srcs = ["hlo_pass_pipeline_flags.cc"],
hdrs = ["hlo_pass_pipeline_flags.h"],
deps = [
":parse_flags_from_env",
"//tensorflow/compiler/xla:types",
"//tensorflow/core:framework_internal",
"//tensorflow/core:lib",
],
)

cc_library(
name = "alias_analysis_flags",
srcs = ["alias_analysis_flags.cc"],
Expand Down
84 changes: 84 additions & 0 deletions tensorflow/compiler/xla/legacy_flags/debug_options_flags.cc
Original file line number Diff line number Diff line change
@@ -0,0 +1,84 @@
/* Copyright 2017 The TensorFlow Authors. All Rights Reserved.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
==============================================================================*/

#include "tensorflow/compiler/xla/legacy_flags/debug_options_flags.h"

#include <mutex> // NOLINT(build/c++11): only using std::call_once, not mutex.
#include <vector>
#include "tensorflow/compiler/xla/legacy_flags/parse_flags_from_env.h"
#include "tensorflow/core/lib/strings/str_util.h"

namespace xla {
namespace legacy_flags {

struct DebugOptionsFlags {
string xla_generate_hlo_graph;

string xla_disable_hlo_passes;
};

namespace {

DebugOptionsFlags* flag_values;
std::vector<tensorflow::Flag>* flag_objects;
std::once_flag flags_init;

// Allocates flag_values and flag_objects; this function must not be called more
// than once - its call done via call_once.
void AllocateFlags() {
flag_values = new DebugOptionsFlags;
flag_values->xla_generate_hlo_graph = "";
flag_values->xla_disable_hlo_passes = "";

flag_objects = new std::vector<tensorflow::Flag>(
{tensorflow::Flag(
"xla_generate_hlo_graph", &flag_values->xla_generate_hlo_graph,
"HLO modules matching this regex will be dumped to a .dot file "
"throughout various stages in compilation."),

tensorflow::Flag(
"xla_disable_hlo_passes", &flag_values->xla_disable_hlo_passes,
"Comma-separated list of HLO passes to be disabled. These names "
"must "
"exactly match the passes' names; no whitespace around commas.")});
ParseFlagsFromEnv(*flag_objects);
}

} // namespace

void AppendDebugOptionsFlags(std::vector<tensorflow::Flag>* flag_list) {
std::call_once(flags_init, &AllocateFlags);
flag_list->insert(flag_list->end(), flag_objects->begin(),
flag_objects->end());
}

xla::DebugOptions GetDebugOptionsFromFlags() {
std::call_once(flags_init, &AllocateFlags);

DebugOptions options;

options.set_xla_generate_hlo_graph(flag_values->xla_generate_hlo_graph);

std::vector<string> disabled_passes =
tensorflow::str_util::Split(flag_values->xla_disable_hlo_passes, ',');
for (const auto& passname : disabled_passes) {
options.add_xla_disable_hlo_passes(passname);
}

return options;
}

} // namespace legacy_flags
} // namespace xla
38 changes: 38 additions & 0 deletions tensorflow/compiler/xla/legacy_flags/debug_options_flags.h
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
/* Copyright 2017 The TensorFlow Authors. All Rights Reserved.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
==============================================================================*/

#ifndef THIRD_PARTY_TENSORFLOW_COMPILER_XLA_LEGACY_FLAGS_DEBUG_OPTIONS_FLAGS_H_
#define THIRD_PARTY_TENSORFLOW_COMPILER_XLA_LEGACY_FLAGS_DEBUG_OPTIONS_FLAGS_H_

#include <vector>

#include "tensorflow/compiler/xla/xla.pb.h"
#include "tensorflow/core/util/command_line_flags.h"

namespace xla {
namespace legacy_flags {

// Appends flag definitions for debug options to flag_list.
void AppendDebugOptionsFlags(std::vector<tensorflow::Flag>* flag_list);

// Fetches a DebugOptions proto message from flags provided to the program.
// Flags must be registered with the flags parser using AppendDebugOptionsFlags
// first.
xla::DebugOptions GetDebugOptionsFromFlags();

} // namespace legacy_flags
} // namespace xla

#endif // THIRD_PARTY_TENSORFLOW_COMPILER_XLA_LEGACY_FLAGS_DEBUG_OPTIONS_FLAGS_H_
62 changes: 0 additions & 62 deletions tensorflow/compiler/xla/legacy_flags/hlo_pass_pipeline_flags.cc

This file was deleted.

48 changes: 0 additions & 48 deletions tensorflow/compiler/xla/legacy_flags/hlo_pass_pipeline_flags.h

This file was deleted.