Sources | Date Range, Time Zone, Data Lineage and More Updates

We’re excited to announce several recent updates to sources in the Amperity Platform that make it easier to set up courier groups, view ingest details, and see data lineage:

We have added help text to date ranges in the courier group dialog. During setup, this helps make it clearer when exactly a courier will run and what date ranges it will use to search for files.

Courier Groups now allow you to use the selected time zone when searching for files to ingest. Selecting this checkbox means that for most file ingest scenarios, you no longer have to think about time zone and courier offset calculations.

We added the recently updated Ingest Details report to the Sources page. This makes it easier to find the report for workflows with a completed ingest right from the notification panel on the Sources page. You can see upsert stats like the number of inserted and updated records, copy landing file locations (e.g. for Databricks), and download the feed and file error logs from the details report when available.

To find the report, click Ingest details for any courier group run’s notification. You can continue to see the same experience from the workflow’s detail page (View workflow) as well.

This report is also available via the Amperity API.

You can now open the details for tables and objects from Data Lineage. Links are now available for most nodes when viewing the data lineage graph, including feeds, couriers, ingest queries, domain tables, custom domain tables (cdt), and database tables. When selecting or hovering over a node, an external link icon will appear which opens a new tab to the table / object in focus. This also means domain tables, ingest queries, custom domain tables, and database tables have been updated to be directly URL addressable, enabling deep link sharing scenarios.