Releases: DataKitchen/dataops-testgen
Releases · DataKitchen/dataops-testgen
5.0.2
Bug Fixes
- handle duplicates before applying unique index (509541e)
Docker Image
datakitchen/dataops-testgen:v5.0.2
PyPI Package
5.0.1
Features
- add standard generation set (46d0c11)
- monitors: add volume trend and metric trend tests (4c92f14)
- monitors: add test threshold prediction (20d0c77)
- monitor: use the new table component for the monitor list (ecbd0ea)
- add table monitor dialog and enable monitor suite (9b4f797)
- monitors: display volume trend chart (27c5c6c)
- monitors: display schema anomalies by table (caa52cd)
- monitors: add settings and delete dialogs (3da24e6)
- monitors: use SARIMAX to support excluding weekends and holidays (c2584e8)
- table groups: add standard and monitor suite wizard steps (5cad913)
- connections: add standard and monitor suite steps to wizard (ab25af6)
- monitors: display prediction in volume trend chart (4b78b96)
- monitors: enable notification settings for monitors (edf41c1)
- freshness: add new test - regenerate monitors when needed (a1df201)
- notifications: warn users of duplicate notification deliveries (ae09a53)
- monitors: indicate training mode - display tables when no results (12c38d9)
- monitors: configuration for regenerating freshness (badb908)
- quick-start: Adding Monitoring features (8cc2b04)
- quick-start: Improving monitor data as QA feedback (5570cee)
- monitors: add Table Monitors dialog + misc fixes (cea61bb)
- charts: Replacing the bitnami charts and images (753a7cc)
- monitors: add metric monitors (50319d4)
- monitors: display predicted table freshness events (e1a3455)
- monitors: display threshold lines for volume and metric charts (3774dba)
- ui: add starting at/on offset to cron schedule editor (b975f6f)
- monitors: allow filtering by anomaly types (75533ee)
- monitors: add toggle to show more history in dialog (60ff579)
- monitors: add deep-link to table trends dialog (8c707a0)
- monitors: freshness monitor with gap-based thresholds and schedule inference (7b98b84)
Bug Fixes
- generation set: add dupe rows to standard (a2a47d0)
- monitors: miscellaneous fixes and enhancements (70ab739)
- css: make toolbar styles consistent (aea7e71)
- monitors: remove monitor schedules from test run schedules dialog (c3d3ced)
- monitors: bugs in cli, models and prediction (a10a6b3)
- monitors: update holiday codes and timezones (cfd3b92)
- charts: offset schema chart lines when too short (26e3081)
- security: Fix Docker Scout vulnerabilities (e87b017)
- quick-start: persist the SMTP settings (a210134)
- monitors: filter out undefined items in timestamps list (d043cb5)
- parse dates from int or str properly (c29a3f1)
- profiling: add missing column to CTE (c1b3cdb)
- monitors: sort the points to draw the volume chart path (ac1d0e2)
- monitors: freshness results used for prediction (136db77)
- monitors: misc display updates (9e5cd3d)
- quick-start: update monitor iterations (d3f3936)
- rendering errors in a couple pages (91f04aa)
- Fix Observability export (3283d83)
- monitors: improve tooltips in charts - fix state bug in threshold form (74f0412)
- monitors: improve loading and form (b5c75e3)
- monitors: fix charts height calculation (d9a22a0)
- monitors: configuration and quick start improvements (fce03aa)
- ui: improve loading performance (111fdca)
- monitors: update form states after saving (7318a53)
- ui: lazy load plugin components (a5f6203)
- test-types: update text strings to match docs (ec9c26d)
- monitors: misc style and quick start updates (904767c)
- monitors: conditionally display ticks decimals (74a3655)
- monitors: table trend chart x axis ticks overlap (751236b)
- freshness: numeric overflow errors (883016f)
- test result: history graph broken when NaN values present (50955af)
- emails: bugs in test run and monitor run templates (50666bb)
- add email source to mixpanel events (507c4bb)
- monitors: handle errored monitors (d2ac510)
- tests: fix 28 broken unit tests and restructure test suite (48ad053)
- monitors: handle dropped and re-added tables (80d40e4)
- ui: misc changes to hygiene issues and test results (b2f0381)
- monitors: widen prediction thresholds (09f3319)
- docs: update help links on all pages (74f6a21)
- monitors: reset pagination on filtering (9bc11bc)
- monitors: error on empty state (43e8156)
- data-catalog: display new table/column names in bold (74b4da1)
- monitors: tooltip position in dialog (3add174)
- tests: NULL condition for tolerances applies to 0 values (a501c4f)
- monitors: match anomaly summary in email with UI (92e065d)
- quick-start: update data for freshness anomaly (225d268)
- monitors: constrain volume lower bound for cumulative tables (064ad0c)
- monitors: constrain prediction for volume monitor to be non-negative (5118316)
- monitors: prevent overconfident prediction bounds (67a1afb)
- upgrade script missing schema (075e557)
Refactors
- schedules: reuse logic to sample cron expressions (6ee5df8)
- monitors: add job key for monitor suites (b9765e1)
- wizards: update summary step (1e87866)
- autogeneration: generate volume and schema tests without profiling (087befe)
- table groups: display progress in creation wizard (b9dc4f2)
- notifications: reset form only on edit (de34c5e)
- notifications: sort alphabetically based on the scope (ace6f79)
- monitors: open table monitor charts from anomaly tags (05897cb)
- monitors: display markers on volume chart (91af3f4)
- monitors: expand schema chart markers clickable area (69970a9)
- monitors: visual changes to the table trend charts (8e818ca)
- monitors: use multi-barchart for schema changes (5441dd6)
- monitors: allow hiding changes columns (35c540a)
- monitors: allow sorting by anomalies count (f78c126)
- monitors: dynamic tick width for trends chart (7a04e44)
- monitors: add legend to table trends charts (8ab8065)
Miscellaneous
- move sql templates to yaml files (b2ecbc9)
- work around Streamlit loading of v2 components (26cc8e2)
- monitors: limit shown prediction points to <= lookback (d0c12d0)
- check changes in styling after st upgrade (f2f81cf)
Docker Image
datakitchen/dataops-testgen:v5.0.1
PyPI Package
testgen-services-1.0.1
A Helm chart for Kubernetes
testgen-services-1.0.0
A Helm chart for Kubernetes
testgen-1.1.0
A Helm chart for Kubernetes
4.39.2
Features
- notifications: Adding Test Run notifications (52382e8)
- notifications: Adding Score drop notifications (e1dc227)
- notifications: Miscellaneous fixes (7be4abc)
- notifications: Adding Profiling Run notifications (57d697e)
- notifications: Miscellaneous fixes and unit tests (c543bc1)
Bug Fixes
- emails: update score drop template styles (43e71c9)
- emails: update test run template to avoid flex styles (3de9098)
- emails: update profiling run template (9a612fb)
- emails: normalize test definition id in results diff (c2c2577)
- table freshness: bugs in calculating historical thresholds (61bbf7c)
- misc ui improvements (a98d0b5)
- emails: add empty state message when smtp server not configured (91ff18b)
Miscellaneous
- Code review feedback (98ec5ba)
Docker Image
datakitchen/dataops-testgen:v4.39.2
PyPI Package
4.38.7
Bug Fixes
- test definitions: add dialog error (fdb3ce9)
Docker Image
datakitchen/dataops-testgen:v4.38.7
PyPI Package
4.38.6
Bug Fixes
- pass signal (275e16a)
- typing for filter options (62de7ba)
- score-breakdown: prevent infinite looping and make defaulting logic consistent (81a63af)
- temporarily disable Schema Drift test (a8d6549)
Docker Image
datakitchen/dataops-testgen:v4.38.6
PyPI Package
4.38.3
Features
- profiling: add progress, approx row counts and error handling (f5f0673)
- sampling: Apply sampling to subqueries (da60a0d)
- test-execution: add progress and error handling (1d1f68f)
- notifications: Adding basic email sending functionality (2842a4c)
- test-definitions: add sort dropdown (5be70ce)
- connections: connect to azure mssql using managed identities (b2ce30d)
Bug Fixes
- Updating services images to point to bitnamis legacy repo (809d25a)
- db-data-type: handle null values (e9c196d)
- runs: empty state css (10e0d86)
- address pr feedback (2e0bc64)
- scores: profiling rollup queries retrieval (056024a)
- schedules: migrate test run schedules to use id (bebfae5)
- test-generation: handle pipes and newlines in LOV Match test (94526a0)
- lookup: add templated limit counts to lookup queries (1c1096e)
- grid: initial selection not working (c93d08b)
- test: improve table freshness test to avoid overflow (d173535)
- address review comments (433177b)
- update default max query chars (4c4fe4f)
- ui: profiling dialog error (458d77d)
- test-results: error on refresh score (b1cb525)
- error on download dialog (a38786f)
- profiling-runs: error on cancel and improve display (57c8447)
- test-runs: improve display for canceled runs (6a17e3f)
- quality-dashboard: scorecard display and sorting (808542f)
- test-execution: improve progress tooltip (9b54583)
Miscellaneous
Docker Image
datakitchen/dataops-testgen:v4.38.3
PyPI Package
4.32.5
Features
- bigquery: Adding BigQuery to the connections pages (76ad544)
- bigquery: Support BigQuery for Profiling (b9ef2b4)
- bigquery: Support BigQuery for Test Generation (74a9569)
- add support for redshift spectrum (6fcca5e)
- pagination: paginate grid component (53bfb66)
- project-dashboard: display data point counts (1f58efb)
- schedules: support pausing/resuming job schedules (4b57cd7)
- hygiene-issues: add summary counts component (d060b0e)
- monitor: add data structure log (f07de29)
- data-type: track database data type for columns (a38046d)
Bug Fixes
- connection: save button not enabled correctly when switching flavors (cab8b61)
- sorting selector: selected items not sorted correctly (c60a840)
- sql: quote snowflake identifiers correctly (35ccbef)
- tests: don't quote columns in Timeframe Combo Match (cc50412)
- redshift: profiling error for timestamps with time zone (4d1e261)
- postgres: profiling bugs on money and time data types (32517ab)
- Applying sampling to the secondary profiling query (3c7f5ea)
- pagination: handle invalid page in query (2f86195)
- Updating services images to point to bitnamis legacy repo (56ec66d)
- source-data: fix lookup queries for Valid_US_Zip3 test (2c35f44)
- source-data: set max height for sql query (919eb3e)
- table freshness: arithmetic overflow in mssql (ca67e56)
- test-results: add details text to bottom section (b67008d)
- project-dashboard: improve css responsiveness (fc71112)
- connection-form: validation on file fields, clear db fields (8cd4849)
- test-validation: detect missing columns in Dupe_Rows test (2fe741a)
- logs: suppress noisy logs during setup and upgrade (62252a9)
- mssql: arithmetic overflow error in Incr_Avg_Shift test (a1500cd)
- add QUOTE to test and lookup queries to support non-standard identifiers (5edee1e)
- hygiene-issues: numeric value out of range error (d4076a1)
- test-validation: handle commas in column names (b5af463)
- miscellaneous qa fixes (af22198)
- sampling: trim quotes in estimate query (007a17a)
- profiling-results: make filters consistent with hygiene issues (8fd8cc8)
- grid: remove unpaginated filter and sort (5d0f4d0)
- connection: unnecessary rerender of file input (1f540de)
- hygiene-issues: include potential pii in possible count (7b4d688)
- clear cache on page refresh (d2e2246)
Refactors
- run-pages: move filters and pagination to vanjs (c83787d)
Miscellaneous
- Addressing code review feedback (730c1b6)
Docker Image
datakitchen/dataops-testgen:v4.32.5