Loome Connection
What is Amazon S3?
First introduced in 2006, Amazon S3 (Simple Storage Service) provides object storage, which is built for storing and recovering any amount of information or data from anywhere over the internet. It provides this storage through a web services interface. It is designed for developers for easier web-scale computing and provides 99.999999999 percent durability and 99.99 percent availability of objects.
Amazon S3 moves away from the traditional folder/file structure, instead storing objects with a unique identifier and supporting metadata. This allows for improved scalability and versatility over the traditional model, and its why Amazon S3 has gone on to become the largest cloud storage platform in use today.
Extract Data From Amazon S3
Loome makes it simple to connect to Amazon S3 and extract data for downstream systems such as an Integration Hub, Reporting Data Store, Data Lake or Enterprise Data Warehouse. In-built features allow bulk selection of all source tables/files to be automatically synced on a regular schedule, minimising data load size leveraging incremental logic.
Load Data into Amazon S3
Loome allows you to quickly onboard your data to the cloud and load your entire data source into Amazon S3 to support your Data Integration Hub, Reporting Data Store, Data Lake or Enterprise Data Warehouse.
Loome automatically generates target staging table structures, including automatic change detection to retain a full audit history of each version of a record received.
Related Articles
Article
What are the Must-Have Attributes of a Modern Data Warehouse?
Modern data warehouse concepts you should consider before building a data platform for your enterprise.
Article
ETL vs ELT Pipelines in Modern Data Platforms
What is the best choice transform data in your enterprise data platform?
Article
Why Data Lake Architecture is not a Silver Bullet for Analytics
Understanding the definition of a data lake is the first step to finding the right storage and analytics solution
Article
Making Data Pipelines Easier for Researchers
Solutions for handling large volumes of research data
Article
Managing Data Governance
Streamlining access to data resources and improving security, organisation-wide