Grok Glue Logstash Scala
Testing data products: BDD for data engineers
Apache Spark with Cucumber for Behavioral-Driven Development
Testing strategies for Apache Spark based projects
Test Driven Development in Grok
Test-Driven Development (TDD) tests with ScalaTest
AWS Glue offers an optimized Apache Parquet writer
Glue:: l'extraction-l'enrichissement- le chargement et l'organisation DataBrew
Amazon EMR to run a PySpark job using Python 3.x
Cribl: grok-patterns-library Cribl on AWS
introduction-to-logstash-grok-patterns
Glue ETL Scala:: gluecontext , AWS
Scala jobs go with Cats, Cats-Effect, Akka, Kafka, Spark
Creating a PySpark project with pytest, pyenv, and egg files
FAQs Les cibles pour Glue Elastic Views actuellement prises en charge sont Amazon Redshift, Amazon S3 et Amazon OpenSearch Service (successeur d'Amazon Elasticsearch Service). Amazon Aurora, Amazon RDS et Amazon DynamoDB seront prochainement pris en charge.
Testing PySpark DataFrame transformations
« connectionType » : « dynamodb » comme collecteur Migrating to DynamoDB using Parquet and Glue
Apache Kafka-> Glue -> Redshift
AWS Amplify, Pinpoint and Kinesis Firehose-> AWS Glue -> Spark ETL -> AWS Athena
PySpark write/read to JSON file
Glue Jupyter Glue Jupyter Glue Jupyter
Oracle to DynamoDB (Financial Ledger and Accounting Systems Hub (FLASH)). The Financial Ledger and Accounting Systems Hub (FLASH) is a suite of microservices that ingests these financial transactions, performs complex and business-critical functions to substantiate the general ledger, and generates financial statements such as balance sheet, cash flow, and income. ( moved from 90 instances of Oracle to a managed DynamoDB).
Relating AWS Schema Conversion Tool to AWS Glue ETL Actuellement, seules les conversions Oracle ETL, Microsoft SSIS et Teradata BTEQ vers AWS Glue sont pris en charge.
Evaluation of Fault Finding Ability of Assertions
SQL-Based ETL with Apache Spark on Amazon EKS Implementation Guide
ReInvent 2020: Glue Studio, Partition Indexes, Custom Connectors, DataBrew, Schema Registry
Desarrollo y pruebas locales de scripts de ETL mediante la biblioteca de ETL de AWS Glue