When used together with Direct Delivery the MMM Data API allows customers to programmatically request data by creating a project, verify the availability of new deliveries, identify specific files, and locate them within the data lake.
Important Considerations
The API is only supported when direct delivery to a data lake is enabled from within your MMM Data Platform account. All Data Sharing Agreements (DSAs) must be signed in order for the data to be delivered directly to your data lake. If the requested data is delivered to the owner (i.e. not your data lake), then the data won't be available through the API.
The recommended workflow
- Configure Data Lake by following this guide.
- Create a recurring project in the MMM Data Platform UI
- Data will collect and deliver to data lakes at the cadence selected: weekly, monthly, or quarterly.
- Use the API to periodically check for new deliveries
- Use the
ListProjectsendpoint to find the project created in the UI. - Use the
ListDeliveriesendpoint to check for new deliveries. - Once a new delivery is available, use the
ListDeliveryFilesendpoint to find all the files delivered to the data lake. Note that in this version of the API only data lake deliveries are listed. - For each file you would like to download, combine the destination information
from the Delivery with the
DeliveryFilepath and download the file using the respective data lake API (GCP, AWS, sFTP).