Releases: datahub-project/datahub
Releases · datahub-project/datahub
v1.3.0rc1
What's Changed
- chore(kafka-setup): bump aws-msk-iam-auth by @chakru-r in #14085
- chore(): bump pyspark by @chakru-r in #14086
- fix(ci): image publish only for master branch push or release by @chakru-r in #14091
- fix(quickstart): update commit hash with resolved quickstart profile by @chakru-r in #14089
- fix(ui) Allow aggregation searches for enum filter types by @chriscollins3456 in #14076
- refactor(queries): refactor query edges by @david-leifker in #14095
- fix(ingest/dbt): improve dbt-cloud error message by @hsheth2 in #14098
- chore(setuptools): bump setuptools by @david-leifker in #14099
- fix(ingest/deltalake): pin upperbound for delta lake by @yoonhyejin in #14083
- fix(snowflake): Add missing config fields to SnowflakeV2Config by @sgomezvillamor in #14093
- fix(snowflake): correct additional_database_names OR logic in access_history filter by @sgomezvillamor in #14104
- feat(tableau): add support for Google BigQuery connection type in pla… by @brock-acryl in #14080
- docs(mcp): prefer the latest MCP server by @hsheth2 in #14077
- feat(ui) Add framework for template/module state and editing templates/modules to UI by @chriscollins3456 in #14029
- fix(openapi): openapi 3.1.0 - use oneOf to mark nullable primitive props as well by @kevin1chun in #14103
- chore(deps): bump kafka in kafka-setup by @chakru-r in #14094
- feat(graphql) Add deletePageModule GraphQL resolver by @chriscollins3456 in #14000
- fix(ingestion/oracle): table_name column in constraint table incorrectly referenced by @acrylJonny in #14107
- fix(ui/tests): Cypress test failures by @sakethvarma397 in #14090
- fix(ingestion/abs): updated deprecated azure sdk parameter to supported parameter and uri prefix support of https by @acrylJonny in #14106
- feat(logical): Add feature flag and models by @asikowitz in #14097
- chore(deps): bump commons-beanutils by @chakru-r in #14110
- fix(spring): fix null custom search config by @david-leifker in #14113
- build(actions): optimize docker layer caching by @chakru-r in #14114
- chore(deps): bump commons-beanutils - one more location by @chakru-r in #14116
- fix(smoke): add pydantic mypy plugin to smoke-tests by @hsheth2 in #14111
- feat(dbt/ingestion): add support for nested meta properties mapping by @pezik1 in #13396
- Update add-user-data.md by @SaravanaKumarG-1365462 in #11542
- fix(ci): use depot runners when possible by @chakru-r in #14115
- feat(ingest): enable use_queries_v2 by default for snowflake/bigquery by @hsheth2 in #13601
- fix(ingest/athena): Make Athena simple column v1 conversion optional by @treff7es in #14112
- feat(mock-data): allow throwing uncaught exception, errors, warning by @anshbansal in #14105
- feat(ci): add username to pr-labeler by @yoonhyejin in #14118
- feat(ui) Add ability to remove modules from page templates by @chriscollins3456 in #14067
- docs(api): update recommendations on apis by @RyanHolstien in #14117
- Enabling SSL for gms if the keystore and password is passed by @relaxedboi in #14121
- feat(ui) Add ability to edit global template on homepage by @chriscollins3456 in #14078
- feat(homePage): add the ability to create asset collection module by @purnimagarg1 in #14050
- test(datahub-schematron): update golden diff to fix schema translation test by @vinayakhulawale in #14132
- feat(ingest/mock-data): misc changes by @anshbansal in #14133
- fix(cli/upgrade): handle safely invalid version by @anshbansal in #14134
- docs(ingestion/snowflake): Remove comment that streams are not ingested by @acrylJonny in #14136
- feat(ui) Add drag and drop functionality to modules on home page by @chriscollins3456 in #14100
- fix(ci): quickstart ci - additional tests by @chakru-r in #14138
- feat(homepage): support documentation modules in the new home page by @purnimagarg1 in #14137
- docs(upgrade): Add instructions / user guide for upgrading from Core to Cloud by @jjoyce0510 in #14101
- feat(ui) Add banner on v1 home page to warn of v2 UI deprecation by @chriscollins3456 in #14131
- feat(permissions) Add platform privilege for editing global home page by @chriscollins3456 in #14081
- feat(ui) Fix alignment of rows and columns on new home page by @chriscollins3456 in #14142
- feat(homepage): Add support for Quick Link modules in the new home page by @purnimagarg1 in #14141
- fix(tests): disable auth for spark test via env var instead of env file by @chakru-r in #14148
- fix(ui): pass createdBy to highlight query column by @yoonhyejin in #14042
- feat(sdk): use discriminated unions for Filter types by @hsheth2 in #14127
- feat(customHomePage): adjust the views popover to the new home page by @v-tarasevich-blitz-brain in #13920
- docs: updates for release v1.2.0 by @chakru-r in #14139
- feat(ui/homepage): handle drag and drop with small modules by @purnimagarg1 in #14151
- feat(quickstart): bump default version to v1.2.0 by @chakru-r in #14154
- feat(ingestion): make REST emitter batch max payload size configurable by @pedro93 in #14123
- v0.3.12.4-acryl release notes by @david-leifker in #14149
- feat(sdk): add container filter to search sdk by @hsheth2 in #14130
- feat(ui) Add user role to custom home page behind feature flag by @chriscollins3456 in #14146
- fix(docs): add missing privileges for 3.12 by @kevinkarchacryl in #14140
- ci(cypress): resize observer fix (#6263) by @benjiaming in #14157
- feat(ingest): change asset list by @anshbansal in #14073
- fix(ingest/looker): prioritize explore project name over field-level source_file project assignment by @sgomezvillamor in #14119
- fix(ui/ingest): change title by @anshbansal in #14172
- fix(ui/ingest): cleanup, exception handling by @anshbansal in #14167
- feat(kafka-consumer): micrometer kafka consumer metrics by @david-leifker in #14156
- feat(customHomePage): create hierarchy module by @v-tarasevich-blitz-brain in #14143
- feat(sdk): add data products to suggested entity type filters by @hsheth2 in #14159
- fix(api): missing time duration for token expiration by @kevinkarchacryl in #14145
- feat(ui/homepage): handle adding module to a row with 3 modules already by @purnimagarg1 in #14177
- feat(postgres): add support for stored procedures in postgres. by @EmmetAVS in #14102
- fix(ingestion/abs): align add_partition_columns_to_schema functionality with working s3/gcs functionality in abs connector by @acrylJonny in #14153
- ER-Model-Relationship UI Changes by @Anshul759 in https://github.com/datahub-project/datahub/pull/...
v1.1.0.1
Full Changelog: v1.1.0...v1.1.0.1
v1.2.0.1rc1
Full Changelog: v1.2.0...v1.2.0.1rc1
v1.2.0.1
Note: The only change is for users of the Internal Schema Registry, if you're running a separate Schema Registry there is no need to upgrade from v1.2.0.
Includes Internal Schema Registry fix: Fix Internal Schema Registry Deserialization Issues
Full Changelog: v1.2.0...v1.2.0.1
v1.2.0
What's Changed
- ci: don't rerun docker workflows on labels by @hsheth2 in #13405
- test(audit-events): updates for audit event tests by @david-leifker in #13419
- feat(ingest): associate queries with operations by @hsheth2 in #13404
- Update search results page by @annadoesdesign in #13303
- chore(airflow): update dev mypy to 1.14.1 by @anshbansal in #13374
- feat(changeSyncAction): support RESTATE type syncs by @RyanHolstien in #13406
- feat(ui/lineage): Make show ghost entities toggle local storage sticky by @asikowitz in #13424
- ci: Add yaml format check by @asikowitz in #13407
- fix(graphql): remove false deprecation note by @jayacryl in #13402
- feat(ingestion): Make jsonProps of schemaMetadata less verbose by @skrydal in #13416
- feat(sdk): scaffold assertion client by @anthonyburdi in #13362
- fix(): DUE Producer Configuration & tracking message validation by @david-leifker in #13427
- fix(build): fix version in jars by @chakru-r in #13432
- fix(smoke-test): fix flakiness of audit smoke test by @RyanHolstien in #13429
- fix(ingest/snowflake): fix previously broken tests by @hsheth2 in #13428
- fix(searchBarAutocomplete): ui tweaks by @v-tarasevich-blitz-brain in #13430
- fix(docker): Fix for metadata ingestion docker build by @treff7es in #13435
- fix(ui) Add ellipses and tooltip to long names on home page header by @chriscollins3456 in #13425
- updated search menu items after search update by @annadoesdesign in #13422
- docs(release): Adding notes for v0.3.10.3 release by @jjoyce0510 in #13437
- fix(ingest/tableau): Fix infinite loop in Tableau retry by @treff7es in #13442
- fix(cli): ignore extra configs by @anshbansal in #13444
- fix(ingest/snowflake): parsing issues with empty queries by @anshbansal in #13446
- docs: remove old pages & assets by @yoonhyejin in #13367
- fix(build): fix local quickstart builds by @chakru-r in #13445
- docs: Adding color to 3.10 release notes by @jayacryl in #13448
- fix(ingest/mode): Not failing if queries endpoint returns 404 by @treff7es in #13447
- chore(avro): bump parquet-avro version by @esteban in #13452
- ci(): run smoke tests on release by @david-leifker in #13454
- feat(UI): funnel subtype for dataflows and datajobs all the way to the UI by @gabe-lyons in #13455
- improvement(ui): add wrapper component for stop propagation by @purnimagarg1 in #13434
- chore(ingest): bump bounds on cooperative timeout test by @hsheth2 in #13449
- feat(docs): Add 0.3.10.4 hotfix release notes by @pedro93 in #13458
- fix(authentication) redirection for native login and sso to function within iframes by @jayacryl in #13453
- fix(docs): Add feature availability to audit API by @pedro93 in #13459
- docs: remove markprompt by @yoonhyejin in #13463
- docs: add runllm chatbot by @yoonhyejin in #13464
- feat(sdk): add datajob lineage & dataset sql parsing lineage by @yoonhyejin in #13365
- fix(versioning): Properly set versioning scheme on unlink; always run side effects by @asikowitz in #13440
- feat(sdk): update lineage sample script to use client.lineage by @yoonhyejin in #13467
- feat(docs): Add doc links for 1.0.0 by @pedro93 in #13462
- docs: remove 0.15.0 from archived list by @yoonhyejin in #13468
- fix(docs): Add requirement on yarn for documentation for local development by @pedro93 in #13461
- feat(ingestion/kafka): Add optional externalURL base for link to external platform by @acrylJonny in #12675
- feat(ingest): filter by database in superset and preset by @kevinkarchacryl in #13409
- fix(web) domain search result item visual cleanup by @jayacryl in #13474
- fix(test): prevent audit test flakiness by @RyanHolstien in #13475
- fix(ingest/hive): Fix hive properties with double colon by @treff7es in #13478
- fix(sdk): use pluralized assertions by @anthonyburdi in #13481
- docs: Add show manage tags environment var by @asikowitz in #13482
- docs(): v0.3.11 DataHub Cloud Docs by @david-leifker in #13439
- tests(ingestion): fixes hex and hive docker flakiness by @sgomezvillamor in #13476
- fix(sdk): always url-encode entity links by @hsheth2 in #13483
- tests(smoke): removes non existing
mix_stderr
param inCliRunner
by @sgomezvillamor in #13485 - docs: Adding notes on remote executors handling smart assertions by @jayacryl in #13479
- fix(cli): warn more strongly about hard deletion by @anshbansal in #13471
- fix(ui): enable to edit tag when properties aspect was not present by @anshbansal in #13470
- docs(cloud): fix indent, remove note not relevant for cloud users by @anshbansal in #13493
- Adding KafkaClients dependency to the datahub-upgrade module by @RafaelFranciscoLuqueCerezo in #13488
- feat(cassandra): Support ssl auth with cassandra by @gabe-lyons in #13465
- fix(ingest/presto): Presto/Trino property extraction fix by @treff7es in #13487
- chore(): graphiql latest versions by @david-leifker in #13484
- feat(ingest/sql): column logic + join extraction by @hsheth2 in #13426
- chore(hex): debug logs by @sgomezvillamor in #13473
- fix(mssql): improve stored proc lineage + add
temporary_tables_pattern
config by @sgomezvillamor in #13415 - fix(ingest/mode): Additional pagination and timing metrics by @mminichino in #13497
- feat(config): add configurable search filter min length by @RyanHolstien in #13499
- ci(workflow): postgres consolidation & release unit tests by @david-leifker in #13500
- fix(config): fix mcp consumer batch property by @david-leifker in #13504
- fix(ci): enable publish on release by @david-leifker in #13506
- feat(ingestion/looker): extract group_labels from looker and add as tags in datahub by @acrylJonny in #13503
- Refactor elasticsearch search indexed by @jmacryl in #13451
- fix(ingest/mode): Additional 404 handling and caching update by @mminichino in #13508
- feat(platform): up limit of corpuser char length from 64 to 128 by @acrylJonny in #13510
- feat(ingest): improve join extraction by @hsheth2 in #13502
- feat(ingest): support pydantic v2 in mysql source by @hsheth2 in #13501
- fix(ci): metadata-io test by @david-leifker in #13514
- build(deps): bump gradle/gradle-build-action from 2 to 3 by @dependabot[bot] in #12951
- build(deps): bump actions/cache from 3 to 4 by @dependabot[bot] in #13346
- Support di...
v1.2.0rc4
v1.2.0rc3
v1.2.0rc2
v1.2.0rc1
v1.1.0
What's Changed
- dataset cli - add support for schema, round-tripping to yaml by @chakru-r in #12764
- feat(ingestion/superset): ownership info for charts, dashboards and datasets by @PeteMango in #12750
- feat(ingest): allowdenypattern for dashboard, chart, dataset in superset by @kevinkarchacryl in #12782
- feat(models): adds subtypes to most entities in the model by @shirshanka in #12783
- fix: fixes mypy complaints about pkgresources by @sgomezvillamor in #12790
- fix(ingestion): fixes producing some URNs with reserved characters by @sgomezvillamor in #12772
- feat(okta): custom properties for okta user by @sgomezvillamor in #12773
- feat(mssql): adds subtypes aspect for dataflow and datajobs by @sgomezvillamor in #12775
- feat(searchBarAutocomplete): add feature flag for search bar's autocomplete redesign by @v-tarasevich-blitz-brain in #12690
- fix(ingest): enable fuzzy case resolution for oracle sql by @hsheth2 in #12778
- style: update azure.md by removing extra word by @alexbransky in #12780
- fix(ui): change tags to properties in ml model view by @yoonhyejin in #12789
- fix(ui) Fix changing color and icon for domains in UI by @chriscollins3456 in #12792
- Support container in ML Model Group, Model and Deployment by @ryota-cloud in #12793
- docs: update mlflow ingestion docs to include new concept mappings by @yoonhyejin in #12791
- fix(web) move form entity sidebar to right to align with cloud by @jayacryl in #12796
- doc(iceberg): iceberg doc updates by @chakru-r in #12787
- docs: add exporting from source to write mcp guide by @yoonhyejin in #12800
- feat(ingest/redshift): support for datashares lineage by @mayurinehate in #12660
- feat(ingestion/business-glossary): Automatically generate predictable glossary term and node URNs when incompatible URL characters are specified in term and node names. by @acrylJonny in #12673
- fix(ingestion/oracle): Improved foreign key handling by @acrylJonny in #11867
- feat(ingest/iceberg): Introduce network problems resiliency for Iceberg source by @skrydal in #12804
- chore(postgres): bump version by @david-leifker in #12808
- chore(aws): bump aws libraries by @david-leifker in #12809
- feat(api): URN, Entity, and Aspect name Async Validation by @david-leifker in #12797
- feat(ingest): improve extract-sql-agg-log command by @hsheth2 in #12803
- fix(UI): Showing platform instances only once by @sakethvarma397 in #12806
- fix: search cache invalidation for iceberg entities by @chakru-r in #12805
- feat(docs): Release for DataHub Cloud 0.3.8.2 by @pedro93 in #12811
- refactor(graphql): simplify getLastIngestionRun method by @trialiya in #12706
- docs(ingest): update metadata-ingestion dev guide by @hsheth2 in #12779
- fix(ingest/oracle): refresh golden files by @hsheth2 in #12818
- fix(openapi): fix openapi timeseries async ingestion by @david-leifker in #12812
- docs(ingest/mode): update mode workspace docs by @hsheth2 in #12774
- fix(ingestion/superset): fixed iterate over int error for building urns by @PeteMango in #12807
- fix(doc): Disable Algolia search by @treff7es in #12831
- fix(build): build improvements to help with incremental builds by @chakru-r in #12823
- feat(docs) add perms req to ai docs by @jayacryl in #12819
- Add variable to show full title in lineage by default by @Blize in #12078
- fix(doc): re-enable Algolia search by @hsheth2 in #12834
- feat(ui): support all entities with display names in browse paths v2 by @Masterchen09 in #11657
- feat(ingestion/mlflow): improve mlflow connector to pull run and experiments by @yoonhyejin in #12587
- fix(workflows): Update pr-labeler by @asikowitz in #12835
- chore(ruff): enable some ignored rules by @sgomezvillamor in #12815
- feat(ingest/redshift): lineage for external schema created from redshift by @mayurinehate in #12826
- feat(openapi-ingestion): implement openapi ingestion by @david-leifker in #12757
- fix(ui) Hide default filters we want to hide from impact analysis by @chriscollins3456 in #12843
- fix(ui) Fix submitting when selecting replacement in deprecation modal by @chriscollins3456 in #12842
- fix(UI): Multiple data product delete modals by @sakethvarma397 in #12781
- fix(graphql/search): Remove schema field and data process instance from default search types by @asikowitz in #12845
- docs: clear remote executor docs by @anshbansal in #12839
- build(deps): bump @babel/runtime from 7.24.4 to 7.26.10 in /docs-website by @dependabot in #12844
- build(deps): bump @babel/runtime-corejs3 from 7.24.4 to 7.26.10 in /docs-website by @dependabot in #12846
- build(deps): bump @babel/helpers from 7.24.4 to 7.26.10 in /docs-website by @dependabot in #12847
- fix(jaas): fix jaas login by @david-leifker in #12848
- feat(gql) allow unsetting optional incident fields by @jayacryl in #12801
- fix(ingest/dynamodb): pass env to dataset urn function by @anshbansal in #12853
- feat(models): Add edges fields to data process instance relationship aspects by @asikowitz in #12860
- feat(ui): Update ExternalUrlButton to include self-hosted gitlab URLs by @k7ragav in #12734
- fix(ui) Support glossary nodes in autocomplete by @chriscollins3456 in #12858
- feat(ingest/mlflow): update dpi to use edge for lineage by @yoonhyejin in #12861
- fix(ge-profiler): catch TimeoutError by @sgomezvillamor in #12855
- fix(databricks): fixes profile median by @sgomezvillamor in #12856
- fix(ingest): fix error in deploy command by @hsheth2 in #12820
- docs(ingest): custom transformer remote executor by @anshbansal in #12864
- feat(restore-indices): createDefaultAspects argument by @david-leifker in #12859
- ci(tests):show cypress smoke tests in junit format for better reporting by @chakru-r in #12865
- feat(ingest/salesforce): include formula in in field description by @mayurinehate in #12840
- feat(ingestion-tracing): implement ingestion with tracing api by @david-leifker in #12714
- hotfix(ui): Addressing assertions hotfixes by @jjoyce0510 in #12785
- feat(ingestion) Adding vertexAI ingestion source (v1 - model group and model) by @ryota-cloud in #12632
- feat(ingest/hive): identify partition columns in hive tables by @deepgarg-visa in #12833
- fix(api-tracing): handle corner case for historic by @david-leifker in #12870
- docs(website) update docusaurus config by @maggiehays in #12862
- feat(system-metrics): track api usage by user, client, api by @david-leifker in #12872
- fix(ingest/snowfla...