Data catalogue and governance

Data products in Knowledge Catalog now support Looker (Google Cloud core) assets.

You can package, govern, and share Looker (Google Cloud core) dashboards, dashboard elements, Looks, Explores, and LookML projects, models, and views in a data product using Google Group mirroring and IAM access controls. This feature is generally available.

Knowledge Catalog support for importing dbt metadata is now generally available and includes the following updates:

You can import metadata from dbt Cloud job runs using the dbt Cloud interface, the dbt platform CLI, or the dbt Administrative API and webhooks.

Data products now support configuring a default IAM role in an access group.

The default role, once configured, is automatically granted on all packaged and supported assets in the data product. Data product owners can override the default role for individual assets.

Metadata for BigQuery Graph is now automatically ingested and searchable in Knowledge Catalog.

This feature is available in preview.

Data domains in Knowledge Catalog allow you to logically organize the resources within the enterprise to discover and curate your data at scale.

This feature is available in Preview.

Knowledge Catalog support for importing metadata from dbt Core and MetricFlow is available in Preview.

You can use the gcloud alpha dataplex dbt metadata-jobs command to extract and import technical, semantic (MetricFlow), operational, data quality, and lineage metadata from dbt Core artifacts into Knowledge Catalog.

AWS Glue now supports catalog federation for remote Apache Iceberg catalogs in AWS GovCloud (US) regions

AWS Glue now supports catalog federation for remote Iceberg REST catalogs in AWS GovCloud (US) Regions. This capability provides direct and secure access to Iceberg tables, stored in Amazon S3 and cataloged in remote catalogs, using AWS analytics engines.

Knowledge Catalog data products now support Apache Iceberg REST Catalog resources as data assets.

You can include Iceberg REST Catalog catalogs, namespaces, and tables in a data product. This feature is generally available.

You can now publish Knowledge Catalog data products to SAP Business Data Cloud (BDC) using BigLake Delta Sharing.

Publishing a data product exposes its underlying data assets, such as Apache Iceberg REST catalog tables, as read-only federated tables in the SAP ecosystem, without moving or replicating your data. This feature is generally available.

AWS Lake Formation extends table permissions to access underlying data in Amazon S3

AWS Lake Formation now enables you to read and write the underlying data files in Amazon S3 for tables registered in the AWS Glue Data Catalog.

AWS Lake Formation enhances cross-account sharing

AWS Lake Formation now enhances cross-account sharing, allowing you to share hundreds of thousands of tables across accounts.

AWS Lake Formation is now available in Asia Pacific (New Zealand) Region

AWS Lake Formation is now available in the Asia Pacific (New Zealand) Region, enabling you to centrally manage and scale fine-grained data access permissions and share data securely within and outside your organization.