You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have tried and CLi works great simplifies submitting jobs
However, could you tell us how to enable the Glue Hive meta store when submitting a job via CLI or in Boto3
i have looked at documentation i don't see an argument for supplying use Glue CatLog option on boto3
Here is a sample of how we are submitting jobs qith EMR-CLI
AWS has announced AWS EMR CLI
https://aws.amazon.com/blogs/big-data/build-deploy-and-run-spark-jobs-on-amazon-emr-with-the-open-source-emr-cli-tool/
I have tried and CLi works great simplifies submitting jobs
![image](https://private-user-images.githubusercontent.com/39345855/237115636-e93bea7c-2928-4f04-8bcd-9a582e943419.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU1MTY3MjIsIm5iZiI6MTcyNTUxNjQyMiwicGF0aCI6Ii8zOTM0NTg1NS8yMzcxMTU2MzYtZTkzYmVhN2MtMjkyOC00ZjA0LThiY2QtOWE1ODJlOTQzNDE5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MDUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTA1VDA2MDcwMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTRkNjMxNjI4ZDdhNTQwYWQ5MjM1MTBiN2ViMjA4MTlhODc3YTVjMzQ3NzA1NTAzNGUwN2RmM2JmZjgyNDFmNTAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.IRGd3t504nYYGV0kvzforLwLePRrVOZtNCgh5nyuCbA)
However, could you tell us how to enable the Glue Hive meta store when submitting a job via CLI or in Boto3
i have looked at documentation i don't see an argument for supplying use Glue CatLog option on boto3
Here is a sample of how we are submitting jobs qith EMR-CLI
emr run
--entry-point entrypoint.py
--application-id
--job-role <arn>
--s3-code-uri s3:///emr_scripts/
--spark-submit-opts "--conf spark.jars=/usr/lib/hudi/hudi-spark-bundle.jar --conf spark.serializer=org.apache.spark.serializer.KryoSerializer"
--build `
--wait
Created A Github Issue awslabs/amazon-emr-cli#18
If you can kindly get back to us on issue that would be great 😃
The text was updated successfully, but these errors were encountered: