Databricks Certified Data Engineer Associate Test Questions and Exam Dumps Part15 Q281-300

View Full Databricks Certified Data Engineer Associate Exam Dumps and Practice Test Dumps.

Question 281

A data engineer needs to create a copy of a Delta table for testing while preserving the source table. Which Delta Lake capability can create a table copy without manually rebuilding the entire table definition?

  1. CLONE
  2. VACUUM
  3. CHECK constraint
  4. DESCRIBE HISTORY

Correct Answer: 1

Explanation

Delta Lake supports table cloning, which can create a copy of an existing Delta table for development, testing, or other use cases. Cloning can be useful when engineers need an independent table representation without manually recreating the complete schema and data structure. VACUUM removes eligible obsolete files, CHECK constraints enforce data rules, and DESCRIBE HISTORY displays transaction history. Therefore, CLONE is the capability most directly associated with creating a copy of an existing Delta table for separate use.

Question 282

A development team wants a cloned Delta table that initially references the source data files instead of creating a completely independent physical copy of all source data. Which type of clone is designed for this behavior?

  1. Deep clone
  2. Shallow clone
  3. Streaming table
  4. Materialized view

Correct Answer: 2

Explanation

A shallow clone creates a new Delta table definition while initially referencing the underlying data files of the source table. This can make the operation faster and require less additional storage than creating a complete independent physical copy. A deep clone copies the underlying data and metadata so the cloned table can become independent of the original data files. Streaming tables and materialized views serve different purposes. Therefore, shallow clone is the appropriate choice when avoiding an immediate full physical copy is desired.

Question 283

A team needs a completely independent copy of a Delta table, including its underlying data files, so that the source table can later be changed without affecting the copy. Which approach is appropriate?

  1. Temporary view
  2. Shallow clone
  3. Deep clone
  4. Query history

Correct Answer: 3

Explanation

A deep clone creates an independent copy of a Delta table, including the underlying data files and relevant metadata. This makes it useful for scenarios such as testing, backup, or creating an independent dataset that should not rely on the source table’s physical files. A shallow clone references source files rather than creating a complete physical copy. Temporary views and query history do not create independent table copies. Therefore, deep clone is appropriate when the cloned data must be physically independent of the source.

Question 284

A data engineer wants to review the sequence of operations that changed a Delta table, including information about versions and operations performed. Which command should be used?

  1. DESCRIBE DETAIL
  2. DESCRIBE TABLE
  3. SHOW FUNCTIONS
  4. DESCRIBE HISTORY

Correct Answer: 4

Explanation

DESCRIBE HISTORY provides the transaction history of a Delta table. It can show table versions, operations, timestamps, and other information associated with changes made to the table. This makes it useful when engineers need to investigate how a table changed over time or identify a specific version for troubleshooting. DESCRIBE DETAIL provides table metadata, while DESCRIBE TABLE focuses on schema information. Therefore, DESCRIBE HISTORY is the appropriate command for reviewing Delta transaction history.

Question 285

A data engineer wants to prevent duplicate records from being inserted into a Delta table when the same event is accidentally delivered more than once. The event has a unique event_id. Which strategy is appropriate?

  1. Enforce uniqueness through deduplication logic using event_id
  2. Increase the number of workers
  3. Disable checkpointing
  4. Convert the table to a view

Correct Answer: 1

Explanation

A stable unique identifier such as event_id can be used to identify duplicate events and support idempotent processing. Deduplication logic can ensure that repeated deliveries of the same event do not result in multiple copies being stored in the target table. Increasing workers does not address duplicate records, disabling checkpointing can negatively affect streaming reliability, and a view does not inherently prevent duplicate data. Therefore, using the stable event identifier as part of deduplication is appropriate for this requirement.

Question 286

A streaming pipeline receives records from a source where the same event may be delivered more than once. Which design helps the pipeline safely process repeated deliveries?

  1. Randomly delete records after every batch
  2. Use an idempotent processing strategy
  3. Disable all data validation
  4. Collect every record to the driver

Correct Answer: 2

Explanation

An idempotent processing strategy ensures that processing the same event more than once does not produce an incorrect final state. This can be achieved through stable event identifiers, deduplication, merge logic, or other techniques appropriate to the pipeline design. Random deletion can remove valid records, disabling validation does not address duplicates, and collecting records to the driver is unsuitable for large streaming workloads. Therefore, designing the pipeline to be idempotent is an important approach when duplicate deliveries are possible.

Question 287

A data engineer needs to process a static customer table together with continuously arriving transaction data. Which join pattern can combine the streaming transaction DataFrame with the static customer DataFrame?

  1. Stream-static join
  2. Cross-database clone
  3. Git merge
  4. Table constraint

Correct Answer: 1

Explanation

A stream-static join combines a continuously updated streaming DataFrame with a static DataFrame. This can be useful when streaming transactions need enrichment with relatively stable reference information, such as customer names, account classifications, or product details. Git merge manages source-code changes, table constraints enforce data rules, and cloning creates table copies. Therefore, a stream-static join is the appropriate processing pattern when continuously arriving records need to be enriched using a static reference dataset.

Question 288

A streaming pipeline calculates an aggregate and needs the output to contain only newly generated result rows rather than repeatedly rewriting previously emitted results. Which output mode is generally associated with this behavior?

  1. Complete mode
  2. Update mode
  3. Append mode
  4. Overwrite mode

Correct Answer: 3

Explanation

Append mode outputs only rows that are newly added to the result and are considered final according to the streaming query’s semantics. It is commonly appropriate for streaming operations where previously emitted results do not need to be modified. Complete mode outputs the entire result table each time, while update mode outputs rows whose results have changed. Overwrite is a batch write concept rather than a standard Structured Streaming output mode. Therefore, append mode matches the described behavior.

Question 289

A data engineer is building a streaming aggregation where existing aggregate values can continue changing as new events arrive. Which output mode is designed to emit rows whose results have been updated?

  1. Update mode
  2. Append mode
  3. Complete mode only
  4. Static overwrite mode

Correct Answer: 1

Explanation

Update mode outputs only those rows in the result table that have changed since the previous trigger. This is useful for streaming aggregations where incoming records can modify existing aggregate results. Append mode is intended for rows that are newly added and will not change later, while complete mode outputs the full result table on each trigger. Static overwrite mode is not a standard Structured Streaming output mode. Therefore, update mode is appropriate when existing aggregation results continue to change.

Question 290

A streaming aggregation needs to output the entire current result table after each trigger. Which output mode provides this behavior?

  1. Append
  2. Update
  3. Complete
  4. Merge

Correct Answer: 3

Explanation

Complete mode outputs the entire current result table after each trigger. It can be useful for streaming aggregations where the complete state of the aggregation needs to be made available to the downstream sink. Append mode emits only newly finalized rows, while update mode emits rows whose results have changed. MERGE is a Delta operation for conditionally inserting, updating, or deleting records and is not a Structured Streaming output mode. Therefore, complete mode provides the described behavior.

Question 291

A data engineer wants to determine how a Delta table is currently stored and inspect metadata such as its location and other table-level details. Which command should be used?

  1. DESCRIBE DETAIL
  2. DROP TABLE
  3. SELECT COUNT(*)
  4. CREATE VIEW

Correct Answer: 1

Explanation

DESCRIBE DETAIL provides detailed metadata about a Delta table, including information such as its format, location, and other table-level properties and statistics. This is useful when engineers need to understand how a table is physically represented or investigate storage-related characteristics. SELECT COUNT(*) returns a row count, CREATE VIEW defines a view, and DROP TABLE removes a table. Therefore, DESCRIBE DETAIL is the appropriate command when detailed table metadata and storage information are required.

Question 292

A data engineer wants to enforce that every order record contains a non-null order_id before it is accepted into a Delta table. Which constraint is appropriate?

  1. CHECK (order_id IS NULL)
  2. CHECK (order_id IS NOT NULL)
  3. CHECK (order_id = NULL)
  4. CHECK (order_id IS DISTINCT FROM NULL)

Correct Answer: 2

Explanation

A CHECK constraint can enforce a condition that every accepted record must satisfy. Using CHECK (order_id IS NOT NULL) requires the order_id value to be present rather than null. This provides table-level enforcement of an important data-quality rule. The first option permits null values, the third uses incorrect null comparison semantics, and the fourth does not express the intended simple requirement. Therefore, a CHECK constraint requiring order_id IS NOT NULL is appropriate for enforcing this rule.

Question 293

A data engineer needs to derive a partitioning date from an existing timestamp column so that the derived value is consistently generated whenever records are written. Which feature can support this design?

  1. Generated column
  2. Job notification
  3. Git branch
  4. SQL warehouse

Correct Answer: 1

Explanation

A generated column can automatically derive a value from an expression based on existing table columns. For example, a date column can be generated from a timestamp expression, providing a consistent value without requiring every data producer to calculate it independently. Job notifications communicate workflow events, Git branches isolate source-code changes, and SQL warehouses provide SQL compute. Therefore, a generated column can support a design where a derived partitioning-related value is generated consistently from an existing timestamp.

Question 294

A data engineer needs to query a shared dataset provided by another organization through a governed data-sharing mechanism. Which capability is designed for consuming shared data without requiring direct access to the provider’s storage account?

  1. Cluster policy
  2. Delta Sharing
  3. Spark cache
  4. Job cluster

Correct Answer: 2

Explanation

Delta Sharing enables data providers to share governed datasets with recipients without requiring the recipients to obtain direct credentials for the provider’s underlying cloud storage. This supports cross-organization data sharing while allowing the provider to maintain control over what is shared. Cluster policies govern compute configuration, Spark caching is a performance feature, and job clusters provide isolated workflow compute. Therefore, Delta Sharing is the appropriate capability for consuming governed data from an external provider.

Question 295

A company wants to restrict users from selecting unusually large or expensive compute configurations. Which administrative mechanism can enforce approved compute settings?

  1. Cluster policy
  2. Temporary view
  3. Delta table history
  4. Window function

Correct Answer: 1

Explanation

Cluster policies allow administrators to define and enforce restrictions on compute configurations. Organizations can use policies to limit instance types, runtime settings, worker counts, autoscaling parameters, and other supported configuration choices. This helps control costs and maintain organizational standards. Temporary views and window functions are query-related features, while Delta table history records data changes. Therefore, a cluster policy is the appropriate administrative mechanism for restricting users to approved compute configurations.

Question 296

A production SQL workload has a changing number of concurrent queries throughout the day. Which capability can help the SQL compute environment respond to varying workload demand?

  1. Table constraints
  2. Git branches
  3. Warehouse scaling
  4. Generated columns

Correct Answer: 3

Explanation

Warehouse scaling allows SQL compute resources to respond to changes in workload requirements. This is particularly relevant when query concurrency or demand varies significantly throughout the day. Scaling capabilities can help provide additional resources when demand increases and reduce unnecessary resources when demand decreases, depending on the configured warehouse behavior. Table constraints enforce data rules, Git branches manage source code, and generated columns derive data values. Therefore, warehouse scaling is the relevant capability for changing SQL workload demand.

Question 297

A data engineering team wants to use a managed identity for an automated workflow so that the workflow does not depend on an employee’s personal Databricks account. Which identity type is appropriate?

  1. Service principal
  2. Temporary view
  3. SQL function
  4. DataFrame

Correct Answer: 1

Explanation

A service principal provides an identity intended for applications and automated processes. Using one for an automated workflow avoids tying production execution to an individual employee account and allows administrators to assign specific permissions to the application identity. Temporary views, SQL functions, and DataFrames are data or query constructs and do not provide an identity for authentication. Therefore, a service principal is appropriate for automated workloads that need controlled access independent of an employee’s personal account.

Question 298

A team wants to give five engineers identical access to a collection of governed tables and then manage that access centrally when team membership changes. Which approach is most appropriate?

  1. Grant every privilege separately to each user forever
  2. Use a group and assign privileges to the group
  3. Give every engineer ownership of the tables
  4. Embed permissions in notebook code

Correct Answer: 2

Explanation

Assigning users to a group and granting the required privileges to that group provides centralized access management. When team membership changes, administrators can add or remove users from the group without repeatedly modifying every table privilege. Granting ownership to every engineer provides unnecessary administrative control, while embedding permissions in notebook code is not an appropriate governance mechanism. Individual grants can also become difficult to maintain at scale. Group-based permissions therefore provide a centralized approach to shared access management.

Question 299

A data engineer is troubleshooting a Delta table and needs to determine which operation created a particular historical version. Which information should be inspected?

  1. DESCRIBE HISTORY
  2. Cluster policy
  3. Git branch list
  4. SQL warehouse size

Correct Answer: 1

Explanation

DESCRIBE HISTORY provides information about changes made to a Delta table, including table versions and the operations associated with those versions. This makes it useful for troubleshooting and understanding how a particular historical state was produced. Cluster policies control compute configurations, Git branches track source-code versions, and SQL warehouse size relates to SQL compute. Therefore, when an engineer needs to identify the operation associated with a historical Delta table version, DESCRIBE HISTORY is the appropriate resource.

Question 300

A development team wants to deploy the same Databricks workflow to multiple environments while keeping resource definitions and deployment settings version controlled. Which practice best supports this requirement?

  1. Manually recreate every resource in production
  2. Keep production settings only in notebook comments
  3. Use source-controlled deployment configuration
  4. Maintain unrelated copies of the workflow for each environment

Correct Answer: 3

Explanation

Source-controlled deployment configuration allows teams to define workflows and related resources in a repeatable, versioned manner. Changes can be reviewed, tracked, and promoted across development, testing, and production environments while keeping environment-specific settings separate where necessary. Manual recreation is error-prone, notebook comments are not a reliable deployment mechanism, and maintaining unrelated copies can cause configuration drift. Therefore, source-controlled deployment configuration provides a structured approach for consistent multi-environment Databricks workflow deployment.