Amazon Web Services (AWS) S3 Bucket¶
Digital Earth Africa data is stored on Amazon Web Services in several publicly accessible S3 buckets.
These buckets are:
For information on where products can be found, see Data Catalogue.
More information on inventory and notification services for some of the buckets can be found on their respective datasets pages on the Digital Earth Africa Registry of Open Data on AWS
These buckets are in the AWS region
To list the contents of a bucket using the AWS Command Line:
aws s3 ls --region=af-south-1 s3://deafrica-services/ --no-sign-request
While Digital Earth Africa is committed to releasing its data to the public for free, the unfortunate reality is that data leaving (data egress) the AWS region incurs a non-trivial cost to DEA. In the future, to avoid out of control costs for hosting our data, we may need to enable “Requester Pays” on the data provided here.
- This will mean:
Data that is transferred from this bucket to AWS compute resources and services within the AWS region will remain free of cost;
All other downloads will require a user have an AWS account, this AWS account will incur the charges for data egress.
If you would like to avoid disruption if and when and if this change is
applied, you will need to configure your S3 download client to use an AWS
account/identity and send the accept requester pays header
x-amz-request-charged:requester most clients offer a simple checkbox or
configuration flag to accept requester pays.
Cloud Optimized GeoTIFF (COG)¶
Most of the products in Digital Earth Africa are available as Cloud Optimized GeoTIFF (COG) files.
For more information on using these files, see the Cloud Optimized GeoTIFF site.
For using COGs on S3 with QGIS, see the tutorial How to read a Cloud Optimized GeoTIFF with QGIS.
SpatioTemporal Asset Catalog (STAC)¶
The SpatioTemporal Asset Catalog (STAC) specification provides a common language to describe a range of geospatial information, so it can more easily be indexed and discovered. A ‘spatiotemporal asset’ is any file that represents information about Earth captured in a certain space and time.
The DE Africa STAC endpoint is:
For more information, see the SpatioTemporal Asset Catalog site.