Skip to content

aws profile parsed multiple times #169

@aajtodd

Description

@aajtodd

CRT appears to be parsing the profile multiple times:

[DEBUG] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Creating profile collection from file at "/Users/user/.aws/credentials"
[TRACE] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Parsing aws profile line in profile "<None>", current property: "<None>"
[TRACE] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Parsing aws profile line in profile "default", current property: "<None>"
[TRACE] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Parsing aws profile line in profile "default", current property: "aws_access_key_id"                                            
[TRACE] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Parsing aws profile line in profile "default", current property: "aws_secret_access_key"                                                                             
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "credential_process" has value "" replaced during merge
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "output" has value "" replaced during merge                                                                       
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "region" has value "" replaced during merge
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "output" has value "" replaced during merge                                                       
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "credential_process" has value "" replaced during merge       
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "region" has value "" replaced during merge                     
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "cli_pager" has value "" replaced during merge                          
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "credential_process" has value "" replaced during merge                 
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "output" has value "" replaced during merge                             
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "region" has value "" replaced during merge                                         
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "aws_session_token" has value "" replaced during merge                                 
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "aws_access_key_id" has value "" replaced during merge                                 
[WARN] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - property "aws_secret_access_key" has value "" replaced during merge                             
[INFO] [2021-06-18T14:24:44Z] [000070000265c000] [connection-manager] - id=0x7ff83dc83f20: Successfully created                                                                                                                        
[INFO] [2021-06-18T14:24:44Z] [000070000265c000] [exp-backoff-strategy] - id=0x7ff83dc816e0: Initializing exponential backoff retry strategy with scale factor: 0 jitter mode: 0 and max retries 1
[DEBUG] [2021-06-18T14:24:44Z] [000070000265c000] [AuthCredentialsProvider] - (id=0x7ff83de73530) Credentials provider chain get credentials dispatch               
[INFO] [2021-06-18T14:24:44Z] [000070000265c000] [AuthCredentialsProvider] - (id=0x7ff83dc83040) Cached credentials provider has expired credentials.  Requerying.  
[DEBUG] [2021-06-18T14:24:44Z] [000070000265c000] [AuthCredentialsProvider] - (id=0x7ff83dc842b0) Credentials provider chain get credentials dispatch               
[DEBUG] [2021-06-18T14:24:44Z] [000070000265c000] [AuthCredentialsProvider] - (id=0x7ff83dc842b0) Credentials provider chain callback 1 invoked with invalid credentials and error code 6152
[DEBUG] [2021-06-18T14:24:44Z] [000070000265c000] [AuthCredentialsProvider] - (id=0x7ff83dc842b0) Credentials provider chain invoking chain member #1
[DEBUG] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Creating profile collection from file at "/Users/user/.aws/config"   
[TRACE] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Parsing aws profile line in profile "<None>", current property: "<None>"            
[TRACE] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Parsing aws profile line in profile "user-Admin", current property: "<None>"        
[TRACE] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Parsing aws profile line in profile "user-Admin", current property: "output"
[TRACE] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Parsing aws profile line in profile "user-Admin", current property: "region"
[TRACE] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Parsing aws profile line in profile "user-Admin", current property: "credential_process"
[DEBUG] [2021-06-18T14:24:44Z] [000070000265c000] [AuthCredentialsProvider] - (id=0x7ff83f8af2f0) Profile credentials provider successfully built config profile collection from file at (/Users/user/.aws/config)
[DEBUG] [2021-06-18T14:24:44Z] [000070000265c000] [AuthProfile] - Creating profile collection from file at "/Users/user/.aws/credentials"

Turn on trace logging and make multiple concurrent requests: e.g.

fun main() = runBlocking {
    System.setProperty("aws.crt.log.level", "Trace")

    val client = S3Client { region = "us-east-2" }

    val files = listOf(...)
    val bucketName = "..."

    val headDeferreds = files.map { objKey ->
        async {
            client.headObject{
                bucket = bucketName
                key = objKey
            }
        }
    }

    val headResults = headDeferreds.awaitAll()

    headResults.forEach { println(it) }

    Unit
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugThis issue is a bug.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions