AWS_GLUE

Buildig Generic Serverless Data processing Utils using AWS Glue

• In this project reading order tracking report data from the orderweb source data

Technologies

1. Source : S3
2. Processing : AWS GLUE
3. Metadata_Store: DynamoDB Table
4. Target1 : S3 (Athena External partition table data)
5. Target2 : AWS Redshift
6. Target3 : Snowflake

AWS Glue Services

1. AWS Glue Crawler
2. AWS Glue Catalog
3. AWS Glue Scripts (Pyspark) Batch and Streaming