Skip to content

Releases: GoogleCloudPlatform/professional-services-data-validator

v7.5.2

02 Apr 12:00
3201609
Compare
Choose a tag to compare

7.5.2 (2025-04-02)

Bug Fixes

  • Cater for OID > 2 billion in PostgreSQL _metadata method (#1490) (d5f72ae)
  • NaT handling in string_to_epoch now matches datetime64 cast output (#1488) (43f6e0a)

v7.5.1

31 Mar 13:12
57cfd6e
Compare
Choose a tag to compare

7.5.1 (2025-03-31)

Bug Fixes

  • Reduced VARCHAR length when casting Teradata integrals to string (#1481) (726a137)

v7.5.0

26 Mar 13:12
8feafe2
Compare
Choose a tag to compare

7.5.0 (2025-03-25)

Features

  • Add raw_column_metadata to Oracle, Teradata and PostgreSQL Backend objects (#1469) (0a96ef9)
  • Enhanced row validation summary logging (support for custom-query row, change to JSON compliant log output) (#1463) (66cff07)

Bug Fixes

  • Cater for extreme datetime pk values (#1475) (450f2db)
  • Prevent logging an exception when result_df is empty (#1461) (e85ba40)
  • Prevent RecursionError in combiner by slicing Dataframes by validation count (#1465) (b76f33e)

v7.4.0

05 Mar 16:50
a75e403
Compare
Choose a tag to compare

7.4.0 (2025-03-04)

Features

  • Add --format option to raw query command (#1450) (241f018)

Bug Fixes

  • Include Int64 in data types to cast to string during sum column validation (#1452) (98439ff)
  • PostgreSQL epoch_seconds expression now matches Oracle/BigQuery/SQL Server/etc (#1458) (bf7cb64)

v7.3.0

26 Feb 09:54
c109bd5
Compare
Choose a tag to compare

7.3.0 (2025-02-19)

Features

  • Print summary information after row validation (#1417) (edb0b4b)

Bug Fixes

  • Add PermissionDenied to ignorable exceptions in maybe_secret() (#1441) (c5883e6)
  • Convert Snowflake connect_args to a dict before passing to Ibis (#1431) (38858f7)
  • Prevent exception for COLUMN keyword in Oracle (#1437) (55e14c4)

v7.2.0

05 Feb 09:50
cc618db
Compare
Choose a tag to compare

7.2.0 (2025-02-04)

Features

  • add connections cli commands (#1398) (949d6c5)
  • Add margin to Decimal precision when deciding to SUM output to string (#1395) (f231b3d)
  • Cater for ExtractEpochSeconds overflowing integer (#1397) (c175146)

Bug Fixes

  • Cast epoch_seconds to int64 in combiner (#1407) (e76a123)
  • Cast sum of epoch_seconds to string to avoid int64 overflow (#1412) (7814906)
  • Change get_filters to not hang due to long filter strings (#1418) (a752cf5)
  • Row validations fail for values with trailing newline (#1415) (a169f63)
  • Workaround for dates < 1970 on Windows (#1392) (4ff5d3a)

Documentation

  • Add sample of horizontally scaled Oracle BLOB validation (#1404) (de6dad0)
  • Add Snowflake key-pair example (#1402) (94f8e03)

v7.1.0

10 Jan 10:57
183c816
Compare
Choose a tag to compare

7.1.0 (2025-01-08)

Features

  • Prevent exceptions due to PostgreSQL xml data type (#1384) (3828c4a)

Bug Fixes

  • Cast of Oracle Timestamp to Date removes the time component (#1387) (35dad08)
  • Explicitly close connection after adding a connection (#1381) (13b481c)

v7.0.0

18 Dec 15:24
831129d
Compare
Choose a tag to compare

7.0.0 (2024-12-18)

⚠ BREAKING CHANGES

  • Exclude views from output of find tables (#1355)

Features

  • Add UUID support (#1367) (4646757)
  • Auto populate -pks when not provided by user (#1324) (6119c18)
  • Exclude views from output of find tables (#1355) (eafdc93)
  • Prevent column validation exceptions caused by Oracle CLOB JSON columns (#1365) (b20b4dd)
  • Support customer defined api endpoint for BigQuery and Spanner (#1340) (c88e752)

Bug Fixes

  • 1261 pg custom query without creating view (#1353) (f25fe80)
  • catch InvalidArg when checking maybe_secret (#1332) (2924202)
  • Fix issue where long rows were being truncated in raw query command (#1362) (97cfdbd)

Documentation

  • Refine connection secret support section (#1358) (78c79ef)
  • Update docs/connections.md and samples/oracle/README.md (#1373) (62d0718)

v6.4.0

13 Nov 12:01
9920955
Compare
Choose a tag to compare

6.4.0 (2024-11-12)

Features

Bug Fixes

  • Fix --comp-fields bug losing option value before validation (#1323) (8813366)
  • Hardcode Oracle max_identifier_length=128, this is a hack but a necessary evil (#1316) (4c54031)
  • Issue 1312 incorrect status code (#1317) (ade6d79)
  • Issue 1325 (#1328) (dfe8b8b)

Documentation

  • Add a sample script for VM automation of partitioning (#1307) (75089b1)

v6.3.0

24 Oct 09:44
7e5a120
Compare
Choose a tag to compare

6.3.0 (2024-10-24)

Features

  • Add support for -comp-fields=*, which also adds support for --exclude-columns (#1291) (f181377)
  • Added ORC and PARQUET support among source tests (#1298) (e102d1e)
  • Partition Custom Queries (#1289) (7e947d5)
  • Support row validation of boolean columns (#1284) (c1de5f3)

Bug Fixes

  • Add proper handling for GCPSecretManager exceptions (#1285) (8028836)
  • Combiner did not take boolean datatypes into account (#1290) (84824db)
  • Correctly cater for Oracle FLOAT in custom-query validations (#1304) (fbe9d23)