Broken pipe in S3Client

[skrat]

What platform/OS are you using?

Amazon Linux 2018.03 / AWS Lambda CPP runtime

Which version of the SDK?

b458ac1

What compiler are you using? what version?

gcc 7.2.1

What are your CMake arguments?

        -DCMAKE_BUILD_TYPE=Release \
        -DCMAKE_CXX_FLAGS_RELEASE=-Wno-error=unused-parameter \
        -DBUILD_ONLY="s3;sqs"

Can you provide a TRACE level log? (sanitize any sensitive information)

[lambda] uploading results 94 kB + 1498 kB...
Error: signal 13:
/var/task/bin/lightmapper-lambda[0x421a45]
/var/task/lib/libc.so.6(+0x362f0)[0x7fd35d2592f0]
/var/task/lib/libpthread.so.0(write+0x2d)[0x7fd35e2b06ad]
/var/task/lib/libcrypto.so.10(+0x11aba6)[0x7fd35cc6dba6]
/var/task/lib/libcrypto.so.10(BIO_write+0x6b)[0x7fd35cc6bcab]
/var/task/lib/libssl.so.10(ssl3_write_pending+0x72)[0x7fd35cfdc4d2]
/var/task/lib/libssl.so.10(ssl3_dispatch_alert+0x33)[0x7fd35cfde743]
/var/task/lib/libssl.so.10(ssl3_shutdown+0xb2)[0x7fd35cfda292]
/var/task/lib/libcurl.so.4(+0x63085)[0x7fd3612fc085]
/var/task/lib/libcurl.so.4(+0x630f1)[0x7fd3612fc0f1]

Some snippets from my code:

    Aws::Client::ClientConfiguration conf;
    conf.scheme = Aws::Http::Scheme::HTTPS;
    conf.region = Aws::Environment::GetEnv("AWS_REGION");
    if (conf.region.empty())
        conf.region = Aws::Region::US_EAST_2;
    conf.caFile = "/etc/pki/tls/certs/ca-bundle.crt";
    conf.connectTimeoutMs = 30000;
    conf.requestTimeoutMs = 600000;

    auto credentialsProvider = Aws::MakeShared<
      Aws::Auth::EnvironmentAWSCredentialsProvider>(AWS_TAG);
    Aws::S3::S3Client client(credentialsProvider, conf);

// elsewhere

void put_s3(const Aws::S3::S3Client& client, const string& url, const string& data) {
  Uri uri;
  if (!parse_uri(uri, url)) {
    throw invalid_argument(string("can't parse URL: ") + url);
  }
  const Aws::String bucket(uri.host.c_str(), uri.host.size());
  const Aws::String key(uri.path.c_str(), uri.path.size());
  Aws::S3::Model::PutObjectRequest request;
  request.SetBucket(bucket);
  request.SetKey(key);
  auto in = Aws::MakeShared<std::stringstream>(AWS_TAG);
  in->write(data.data(), data.size());
  request.SetBody(in);
  auto outcome = client.PutObject(request);
  if (outcome.IsSuccess()) {
    report(LAMBDA, "done putting " + url);
  } else {
    throw outcome_error(outcome.GetError());
  }
}

[KaibaLopez]

Hi @skrat,
I need more info to get a better idea of your problem.
Do you get an error on outcome?
Can you provide the full trace log? (After sanitizing sensitive information like credentials and such).
It would also help if you could explain what you're trying to do here. Does this happen on any s3 putobject, regardless of the rest of the project?

[skrat]

@KaibaLopez It happens randomly, I think it happens on calling PutObject. How can I get more detailed trace log? I used backtrace_symbols_fd for this, I'm not aware of other method. Btw, I since then added this line

  options.httpOptions.installSigPipeHandler = true;

which prints an error line to stderr, but otherwise it seems to succeed. So that kind of resolved the issues but I don't understand why is this happening, why do I never get this locally using the same code (slightly different system though).

[KaibaLopez]

To activate the trace log:
options.loggingOptions.logLevel = Aws::Utils::Logging::LogLevel::Trace;