← Professional Data Engineer: pipelines and data decisions
01 / 8 · 35 MIN

Design, governance, and identity

Translate data requirements into controls, ownership, and observable outcomes.

Concept and mechanism

Begin design with the data product the business needs to use: content, deadline, freshness, authorized consumers, and discrepancy tolerance. API availability does not demonstrate that today’s report is complete. If the decision needs reconciled data at 07:00, measure that outcome and define who accepts a provisional version. Then allocate responsibilities across source, transformation, storage, and consumption. A dedicated workload identity helps scope permissions and distinguish automated execution from human intervention. Dataset read access does not replace authorization needed for a protected column; check the actual path using the consumer identity.

Guided application

In a fictional banking project, analysts need to join files by customer without seeing original identifiers. Deterministic pseudonyms can support joining, but require consistent configuration and do not automatically make the dataset anonymous. Other fields and key access remain relevant. A catalog provides discovery, owners, and lineage; it does not prove resource grants were corrected or imply copying all data. Current documentation uses Knowledge Catalog while the exam guide still refers to Dataplex. Record this mapping without inventing a new exam version. Finally, recovery planning must include encryption keys for historical exports. Rotating a key does not prove those exports stopped depending on previous versions.

IN PRACTICE

Green endpoint at 07:00, yesterday’s file: technical availability without data-product freshness.

Common pitfalls

Catalog as enforcement; pseudonym as anonymity; rotation as re-encryption; dataset grants as universal access.

Related topics: Quality, migration, and cutover · Streaming, time, and effects · Ingestion, publication, and CI/CD

Take this idea with you

Define the business outcome and demonstrate controls at each boundary.

Create account

Reference: Knowledge Catalog introduction · Current linked standard guide (document title v4.2); edition date unconfirmed (2026-09-30 inspection)

Google Cloud is a trademark of Google LLC. bigsavant.com is an independent preparation platform and is not affiliated with, associated with, sponsored, authorised or endorsed by Google. Content and questions are original, are not official exam questions, and completing our tests does not award or guarantee any certification. Names are used only to identify the subject. All other trademarks belong to their respective owners.