Automated Validation: AmpIQ Validation Report

We're excited to announce the release of our first validation report.
  This helps Datagrid Administrators
 who are configuring Amperity ensure that the data they are collecting and organizing meets their criteria for quality during implementation as well as throughout ongoing changes and iterations.
Validation is a concept that has existed in our platform for a long time and we've developed an extensive set of tools for Operators to use to validate the results of Stitch (Stitch Q/A
) and Transactions (Transactions Q/A
).  but always as a very manual process. In the past, performing validation activities for Stitch
 or Transactions
 involved running manual queries, interpreting the results and configuring manual alerts. Even this proved to be rather unwieldy and error prone - and added time and complexity to implementation and iteration efforts.  For years, we dreamed of a completely automated validation process, where queries could be run automatically on their corresponding tables, and downstream workflows and features could be blocked/warned if these validations failed so we could stop the spread of bad data throughout the system and beyond. 
This initial version of the Validation Report
 automatically runs all of the Transaction Q/A
 queries (as well as some new additions) for all databases that include transaction information. It runs as part of database generation and the results are published in a report that can be referenced from the corresponding Database Update
 notification card. In the report, you can scroll the results to see any errors, failures due to missing required fields, and all  passing tests. You can also see failures due to bad data, which includes sample rows of the failing records, common solutions, and a link out to Queries for further exploration.
You can then Edit Report Settings
 (accessible via report or database configuration menu) to customize failure thresholds and toggle between % thresholds or hard values (e.g. 5% are allowed to fail or 5 records are allowed to fail).  
Eventually, the Validation Report
 will cover more and more of the standard data assets in the Amperity platform, including not just other database tables but also other transformations throughout the workflow. Furthermore, we plan to enhance the types of validations we run to be able to do more run-over-run comparison and visualization. 
Note this feature is currently available for Datagrid Administrator
 roles only focused on implementations.  