Skip to main content

Add A Download Button to Data Quality Reports

Syniti Knowledge PlatformQualityMigrate

Current data quality reports allow users to download report results, but only if the user right clicks on the results. In order to maintain a consistent UI, it would be nice to give users a button to click for this download, similar to what exists with reports in Migrate.

Posted by Tyler Triemstra ·
Status: Completed1 comment

Log in to comment and vote

Comments1

  • John Munkberg

    Team•

    May 1, 2025

    Engineers are working on a few items related to DQ Reports. First - cache the reports to a DATASTORE - similar to the Migrate REPORT Cache datasource. Second - All reports run (and debug) with a global LIMIT. This protects against BAD queries generating huge volumes of data to cache when it’s not needed.

    Once a report is ready, user can enable a SAVE ALL records option. If that report is being run against the working server (or really the same server as the report cache datastore), then we will use SQL Pushdown to cache the full report data directly. I.e. SELECT * INTO CacheTable. This avoids pulling all the data into the cloud to push it back down to the cache datastore.

    Finally, when you download the data into an XLSX file, allow me to download ALL the data. This one is a bit more challenging and may come later than the first two. Team is looking at the right solution to move LARGE volumes of “Report” data. At some point a report becomes a DATA REPLICATION because no human needs to see 4 million errors. Those errors in a download are not really a report, they are an extraction of data from the cache table to the file system…

    So - work being done, and we are aware of the gap raised here. Thank you very much for your input.