AWS Glue
Discover, prepare, and integrate all your data at any scale
1 million objects stored free
How it works
AWS Glue is a serverless data integration service that makes it easier to discover, prepare, move, and integrate data from multiple sources for analytics, machine learning (ML), and application development.
-
Data integration engine options
-
Event-driven ETL
-
AWS Glue Data Catalog
-
No-code ETL jobs
-
Manage and monitor data quality
-
Data preparation
-
Data integration engine options
-
Choose your preferred data integration engine in AWS Glue to support your users and workloads.
-
Event-driven ETL
-
AWS Glue can run your extract, transform, and load (ETL) jobs as new data arrives. For example, you can configure AWS Glue to initiate your ETL jobs to run as soon as new data becomes available in Amazon Simple Storage Service (S3).
-
AWS Glue Data Catalog
-
You can use the Data Catalog to quickly discover and search multiple AWS datasets without moving the data. Once the data is cataloged, it is immediately available for search and query using Amazon Athena, Amazon EMR, and Amazon Redshift Spectrum.
-
No-code ETL jobs
-
AWS Glue Studio makes it easier to visually create, run, and monitor AWS Glue ETL jobs. You can build ETL jobs that move and transform data using a drag-and-drop editor, and AWS Glue automatically generates the code.
-
Manage and monitor data quality
-
AWS Glue Data Quality automates data quality rule creation, management, and monitoring to help ensure high quality data across your data lakes and pipelines.
-
Data preparation
-
With AWS Glue DataBrew, you can explore and experiment with data directly from your data lake, data warehouses, and databases, including Amazon S3, Amazon Redshift, AWS Lake Formation, Amazon Aurora, and Amazon Relational Database Service (RDS). You can choose from over 250 prebuilt transformations in DataBrew to automate data preparation tasks such as filtering anomalies, standardizing formats, and correcting invalid values.
Use cases
Simplify ETL pipeline development
Remove infrastructure management with automatic provisioning and worker management, and consolidate all your data integration needs into a single service.
Discover data efficiently
Quickly identify data across AWS, on premises, and other clouds, and then make it instantly available for querying and transforming.
Interactively explore, experiment on, and process data
Using AWS Glue interactive sessions, data engineers can interactively explore and prepare data using the integrated development environment (IDE) or notebook of their choice.
Support various processing frameworks and workloads
More easily support various data processing frameworks, such as ETL and ELT, and various workloads, including batch, micro-batch, and streaming.
How to get started
Try AWS Glue at no cost
Discover, prepare, move, and integrate data from multiple sources with the ease of a serverless environment.
Build with AWS Glue
Learn how to create data pipelines with the AWS Glue Studio visual ETL interface.
Integrate your data
Follow along to set up and start using AWS Glue.