AWS S3 upload object HttpErrorResponseException

[CoderGamester]

I'm trying to upload my assets to an S3 bucket but AWS keeps getting an HttpErrorResponseException exception.
I'm testing the S3Example in the editor with only one difference, instead of using CognitoAWSCredentials I'm using _credentials = new BasicAWSCredentials(awsKey, awsSecretKey);

Is there a way to upload a file to S3 with Unity? Or is it not supported at the time?

Using Unity 5.4.2f & aws-sdk-unity_3.3.14.1 plugin

Stack Trace error:

receieved error Amazon.Runtime.Internal.HttpErrorResponseException: Exception of type 'Amazon.Runtime.Internal.HttpErrorResponseException' was thrown.
  at Amazon.Runtime.Internal.UnityWwwRequest.EndGetResponse (IAsyncResult asyncResult) [0x00000] in <filename unknown>:0 
  at Amazon.S3.AmazonS3Client.ProcessPostResponse (IAsyncResult result) [0x00000] in <filename unknown>:0 
UnityEngine.Debug:Log(Object)
AWSSDK.Examples.S3Example:<PostObject>m__7(AmazonServiceResult`2) (at Assets/Examples/S3Example.cs:175)
Amazon.S3.<>c__DisplayClass4_0:<PostObjectAsync>b__0(AmazonWebServiceRequest, AmazonWebServiceResponse, Exception, AsyncOptions)
Amazon.Runtime.Internal.UnityMainThreadDispatcher:ProcessRequests()
Amazon.Runtime.Internal.UnityMainThreadDispatcher:Update()

[sstevenkang]

What is the value of HttpErrorResponseException.Message?

[CoderGamester]

Message gives only "Exception of type 'Amazon.Runtime.Internal.HttpErrorResponseException' was thrown."

[sstevenkang]

Huh, that's really odd. I would assume an error message from the service would show up. Is there any chance you could set up a sniffer like Fiddler and monitor the http traffic and see if the request makes it to the service?

Also, is there any inner exception you could take a look at?

[CoderGamester]

Hi, The Inner Exception gives null (strange, right?)

How do you set up Fiddler? Never used a Sniffer before :(

[sstevenkang]

Fiddler is available fore free here: http://www.telerik.com/fiddler
If you are working on Mac, there's Charles: https://www.charlesproxy.com/

[CoderGamester]

Ok I installed the Fiddler and I see that the messages sent to Amazon S3 are with HTTP 200.
What do I do know? How can I find the problem?

[WebVRRollerCoaster]

Do you have the wrong time set on your device?

[si294r]

I'm also using S3Example.cs from Unity AWSSDK and got HttpErrorResponseException, then after i setting AWSConfigs in Start()

        void Start()
        {
            UnityInitializer.AttachToGameObject(this.gameObject);
            GetBucketListButton.onClick.AddListener(() => { GetBucketList(); });
            PostBucketButton.onClick.AddListener(() => { PostObject(); });
            GetObjectsListButton.onClick.AddListener(() => { GetObjects(); });
            DeleteObjectButton.onClick.AddListener(() => { DeleteObject(); });
            GetObjectButton.onClick.AddListener(() => { GetObject(); });

            AWSConfigs.HttpClient = AWSConfigs.HttpClientOption.UnityWebRequest;

            AWSConfigs.LoggingConfig.LogTo = LoggingOptions.UnityLogger;
            AWSConfigs.LoggingConfig.LogResponses = ResponseLoggingOption.Always;
            AWSConfigs.LoggingConfig.LogMetrics = true;
            AWSConfigs.CorrectForClockSkew = true;
        }

now i can see the problem

Received error response: [<?xml version="1.0" encoding="UTF-8"?>
<Error><Code>AccessDenied</Code><Message>Access Denied</Message>
<RequestId>99EB18D75BE52010</RequestId>
<HostId>gl3VFqE2t4esxMl5vXsVROEPZlM5hoXlSTdl3QdH5lJJW+5UYvMDCIg4pqAOYMa+vlux0qrqonw=</HostId></Error>]

try with Full Access Policy and it's works

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "FullAccessS3",
            "Effect": "Allow",
            "Action": [
                "s3:*"
            ],
            "Resource": [
                "*"
            ]
        }
    ]
}

[Arc8ngel]

Hit the same problem with the S3Example in Unity 2017.3.1f1 and the latest AWSSDK packages.

Bucket access is public, and I set AWSConfigs the same as @si294r

Amazon.Runtime.Internal.HttpErrorResponseException: Exception of type 'Amazon.Runtime.Internal.HttpErrorResponseException' was thrown.
  at Amazon.Runtime.Internal.UnityRequest.EndGetResponse (System.IAsyncResult asyncResult) [0x00008] in E:\JenkinsWorkspaces\v3-trebuchet-release\AWSDotNetPublic\sdk\src\Core\Amazon.Runtime\Pipeline\HttpHandler\_unity\UnityWebRequestFactory.cs:288 
  at Amazon.S3.AmazonS3Client.ProcessPostResponse (System.IAsyncResult result) [0x0001c] in E:\JenkinsWorkspaces\v3-trebuchet-release\AWSDotNetPublic\sdk\src\Services\S3\Custom\_unity\AmazonS3Client.unity.cs:266 

The inner exception is NULL, and responseObj.Response is also null.

[cecicosta]

I am having a similar issue on Unity 2017.0p4. In unity 5.6 the same code is working.

The Exception message is this:
"Amazon.Runtime.Internal.HttpErrorResponseException: Exception of type 'Amazon.Runtime.Internal.HttpErrorResponseException' was thrown.\r\n at Amazon.Runtime.Internal.UnityRequest.EndGetResponse (IAsyncResult asyncResult) [0x00008] in E:\\JenkinsWorkspaces\\v3-trebuchet-release\\AWSDotNetPublic\\sdk\\src\\Core\\Amazon.Runtime\\Pipeline\\HttpHandler\\_unity\\UnityWebRequestFactory.cs:288 \r\n at Amazon.S3.AmazonS3Client.ProcessPostResponse (IAsyncResult result) [0x0001c] in E:\\JenkinsWorkspaces\\v3-trebuchet-release\\AWSDotNetPublic\\sdk\\src\\Services\\S3\\Custom\\_unity\\AmazonS3Client.unity.cs:266 "

The get method is working, so I think it is no problem with authentication. I as I said, I can do post to the same bucket running this on unity 5.6, so no problem with permisions either. Not sure yet if the unity version is the cause. I may continue testing to confirm.

This is my post code:

` isLastRequestDone = false;
if (!File.Exists(path)) {
Debug.Log("File does not exists");
lastRequestSucceed = false;
isLastRequestDone = true;
return;
}
Debug.Log("Retrieving the file");
var stream = new FileStream(path, FileMode.Open, FileAccess.Read, FileShare.Read);

    Debug.Log("Creating request object");
    var request = new PostObjectRequest() {
        Region = _S3Region,
        Bucket = S3BucketName,
        Key = Path.GetFileName(path),
        InputStream = stream,
        CannedACL = S3CannedACL.Private
    };

    Debug.Log("Making HTTP post call");
    lastRequestSucceed = false;
    try {
        Client.PostObjectAsync(request, (responseObj) => {
            
            if (responseObj.Exception == null) {
                Debug.Log(string.Format("object {0} posted to bucket {1}", responseObj.Request.Key, responseObj.Request.Bucket));
                lastRequestSucceed = true;
            } else {
                Debug.Log("\nException while posting the result object");
                Debug.Log(string.Format("\n receieved error {0}", responseObj.Response.HttpStatusCode.ToString()));
            }
            isLastRequestDone = true;
        });
    }
    catch (Exception ex) {
        Debug.Log("Unhandled Exception while posting the result object");
        Debug.Log(string.Format("\n received error {0}", ex.ToString()));

    }`

[cecicosta]

I managed to upload the file using PutObjectRequest instead of post. I remember one issue with form on unity which I had to use put intead of post to a http request. Maybe is the same thing internally to AWSSDK.Core

` Debug.Log("Creating request object");
var request = new PutObjectRequest() {
BucketName = S3BucketName,
Key = Path.GetFileName(path),
InputStream = stream,
CannedACL = S3CannedACL.Private
};

    Debug.Log("Making HTTP post call");
    lastRequestSucceed = false;
    try {
        
        Client.PutObjectAsync(request, (responseObj) => {
            
            if (responseObj.Exception == null) {
                Debug.Log(string.Format("object {0} posted to bucket {1}", responseObj.Request.Key, responseObj.Request.BucketName));
                lastRequestSucceed = true;
            } else {
                Debug.Log("\nException while posting the result object");
                Debug.Log(string.Format("\n receieved error {0}", responseObj.Response.HttpStatusCode.ToString()));
            }
            isLastRequestDone = true;
        });
    }
    catch (Exception ex) {
        Debug.Log("Unhandled Exception while posting the result object");
        Debug.Log(string.Format("\n received error {0}", ex.ToString()));

    }`

[Arc8ngel]

I'm still stuck on this issue. I can list objects in the bucket, but neither Post or Put methods are getting me anywhere. The first error to hit the log is always HttpErrorResponseException, but others thrown seem to indicate it's an 'Access Denied' error.
 
The bucket has public access, so why would I get an access denied callback?

[cecicosta]

Maybe you can check the region you setup for accessing the S3, the key you're setting for post/put (path + filename) if it doesn't have invalid characteres, check if you can post/put with private access (if so, double check the permissions).
Maybe you can post your code here to check