During 2021-2022 PO.DAAC has been in the process of migrating its data archive to the Earthdata Cloud, hosted in Amazon Web Services (AWS). During this transition, some data continued to be available from the on premise archive, while some data has also been available from and within the Earthdata Cloud.

The transition is set to end March 31, 2023 at which point the PO.DAAC archive has been migrated to the Earthdata Cloud (in AWS)

Timeline

PO.DAAC data is being migrated to the cloud in a set of five phases. The datasets and migration dates are below, but dates may be refined over time. For up to date information, please subscribe to the PO.DAAC mailing list. If you are having trouble finding a collection below, the transition date is also listed on each collection’s landing page.

The dates listed in the table below are the dates when on-premise access to the collections will no longer be available. At some point before the date below, discoverability (i.e. they won’t show up on collection landing pages) of the on-premise end points will be turned off, while access to them will remain until the final date. Remember that while the endpoints to the data are changing from on-premise to cloud endpoints, download capabilities remain unaffected for the data user. Users will always be able to download data from PO.DAAC.

Phase 1 (Cloud Accessable Date:  April 15, 2021;  Cloud Only Access Date: January 31, 2022)

Cloud Accessable Date:  Phase 1 -  April 15, 2021

Phase Cloud Only Access Date  Collections

Phase 1

January 31, 2022

 

Phase 2 (Cloud Accessable Date:  October 1, 2021;  Cloud Only Access Date: May 2, 2022)

Cloud Accessable Date:  Phase 2 -  October 1, 2021

Phase Cloud Only Access Date  Collections

Phase 2

May 2, 2022

 

Phase 3 (Cloud Accessable Date:  December 23, 2021;  Cloud Only Access Date: November 14, 2022) 

Cloud Accessable Date:  Phase 3 -  December 23, 2021

Phase Cloud Only Access Date  Collections

Phase 3

November 14, 2022

 

Phase 4 (Cloud Accessable Date:  April, 2022;  Cloud Only Access Date: November 14, 2022)

Cloud Accessable Date:  Phase 4 -  April, 2022

Phase Cloud Only Access Date  Collections

Phase 4

November 14, 2022

 

Phase 5 (Cloud Accessable Date:  July, 2022;  Cloud Only Access Date: March 31, 2023)

Cloud Accessable Date:  Phase 5 -  July, 2022

Phase Cloud Only Access Date  Collections

Phase 5

March 31, 2023

 

 

What to Expect

You will notice there will be some duplicate collections available. For example, if you search for "MUR-JPL-L4-GLOB-v4.1" in Earthdata Search, you will see two collections. One of these is our normal, on-premise collection, while the other is the cloud hosted collection.

The PO.DAAC Web Portal will label cloud hosted datasets as  CLOUD ENABLED  in an orange rectangle. This will let you know, at a glance, which datasets are cloud-enabled from the dataset search and dataset landing pages. For now, check out the Migration FAQ “How do I know if a collection is in the cloud or not?” below.

In the near future, we will be removing discoverability of the “on-premise” collection and only the cloud version will be available, and you will not see duplicates. 

As we approach March 31, 2023 and the completion of the transition, more and more of the datasets will only show up once, with the “Cloud Enabled” badge. 

 
 
Tutorials

The following are select tutorials that may be helpful in transitioning to cloud endpoints. More tutorials can be found on the PO.DAAC Github or accompanying PO.DAAC Cookbook (which is the curated view of the PO.DAAC Github and also includes cheatsheets, guides, additional information and tutorials).

User Goal Cloud Tutorial or Tool

Find Collections

Find Granules

Browse / Download Whole Granules

Subscribe to Granules

Direct In-Region Cloud Access

Access Data in zarr Cloud Optimized Format

Bulk Download

Transform: How do I subset L2 data?

Transform: How do I use OPeNDAP in the Cloud?

 

Migration FAQs

When are traditional (non-cloud) endpoints disabled and I will no longer be able to access data through those endpoints?

PO.DAAC migration to the Earthdata Cloud is targeted to complete by March 31, 2023. Users are encouraged to transition their legacy data access scripts and methods for compatibility with cloud data access endpoints at their earliest convenience, as PO.DAAC Drive and the legacy data access tools and services (specifically LAS, CWS, THREDDS) will retire on Mar 31, 2023.

How do I know if a collection is in the cloud or not?

There are several ways to see the PO.DAAC cloud collections.

For public collections, you can use Earthdata Search and the PO.DAAC Web portal filter options.

The PO.DAAC Web Portal will also label datasets as  CLOUD ENABLED  in an orange rectangle. This will let you know, at a glance, which datasets are cloud-enabled from the dataset search and dataset landing pages.

On Earthdata Search, you can use the ‘Available from AWS Cloud’ feature, as well as searching using the key word  ‘POCLOUD’.  But for PO.DAAC Cloud collections only, we’ve built a PO.DAAC Cloud Search Portal (again, make sure you’re logged in!).

How can I get help transitioning my legacy endpoints to the cloud endpoints for data access?

To ensure a successful transition for all PO.DAAC users, the PO.DAAC in the CLOUD Forum can be used as the primary entry point to help address technical issues and concerns. Our User Services team (podaac@podaac.jpl.nasa.gov) is also standing by to support. Several resources are also available:

Data search and access    

Recommended tool for data downloading and subscribing

Data recipes and tutorials for PO.DAAC datasets, tools & services

General Information about Earthdata Cloud (in AWS)    

Other Questions?

For more answers to frequently asked questions, please see the Cloud FAQ.

 

If your question is not here feel free to submit it to us via Forum or by emailing to podaac@podaac.jpl.nasa.gov