Databricks Certified Generative AI Engineer Associate Practice Test Questions and Exam Dumps Part9 Q161-180

View Full Databricks Certified Generative AI Engineer Associate Exam Dumps and Practice Test Dumps

 

Question 161. What is the primary purpose of grounding a generative AI response?

  1. To make the response longer
    2. To increase model temperature
    3. To connect generated claims to reliable provided information
    4. To eliminate the need for retrieval

Correct Answer: 3. To connect generated claims to reliable provided information

Explanation:

Grounding means generating responses using reliable information supplied to the model rather than relying entirely on unsupported model knowledge. In a RAG application, retrieved documents can provide evidence that the model uses when constructing its answer. Grounding is especially useful for enterprise knowledge assistants where responses should reflect organizational policies, documentation, or other authoritative sources. Although grounding can reduce unsupported claims, it does not guarantee that every response will be correct. The quality of the source material and retrieval process remains important. Grounding also works together with prompt instructions, evaluation, validation, and monitoring to create a more reliable generative AI workflow.

Question 162. Which component converts a user’s query into a vector for semantic similarity search?

  1. Embedding model
    2. Output validator
    3. Reranker
    4. Guardrail

Correct Answer: 1. Embedding model

Explanation:

An embedding model transforms text such as a user’s query into a numerical vector representation. The resulting vector can then be compared with vectors representing stored document chunks to identify content with similar semantic meaning. This allows a retrieval system to find relevant information even when the query and document use different wording. The same or a compatible embedding approach is generally used when preparing documents for indexing so that query and document vectors can be compared consistently. A reranker can refine results after initial retrieval, while a validator checks generated output. Embeddings therefore form a core foundation of semantic vector search.

Question 163. What is one reason to use a reranker after initial vector retrieval?

  1. To improve the ordering of candidate documents based on query relevance
    2. To permanently modify the source documents
    3. To replace the language model
    4. To increase user authentication strength

Correct Answer: 1. To improve the ordering of candidate documents based on query relevance

Explanation:

Initial vector retrieval is generally optimized for efficiently finding candidate documents that are semantically similar to a query. However, similarity alone may not always produce the most useful ranking. A reranker can examine the query and retrieved candidates more deeply and assign a refined relevance order. This can place the strongest evidence closer to the beginning of the context supplied to the language model. Reranking can therefore improve the quality of the information available during generation. It does not modify source documents, replace the generation model, or provide authentication. Its role is specifically to refine candidate retrieval results before generation.

Question 164. Which action can help maintain a clean RAG knowledge base?

  1. Keep every outdated document indefinitely
    2. Remove duplicates and obsolete content according to data-management rules
    3. Disable document updates
    4. Increase model temperature

Correct Answer: 2. Remove duplicates and obsolete content according to data-management rules

Explanation:

A clean knowledge base helps a RAG system retrieve accurate and relevant information. Duplicate documents can cause redundant results, while obsolete documents may cause the assistant to provide outdated information. A data-management process can identify duplicate records, replace superseded versions, and remove content that should no longer be used. Metadata such as version numbers and effective dates can further support document lifecycle management. Increasing model temperature does not improve the quality of source data, and disabling updates prevents current information from reaching the index. Maintaining source quality is therefore an important part of RAG engineering and should be handled as an ongoing data-management process.

Question 165. What can a similarity threshold help determine during retrieval?

  1. Whether a retrieved result is sufficiently similar to the query to be considered
    2. Whether a user should be authenticated
    3. Whether the model needs more training data
    4. Whether the endpoint should generate tokens faster

Correct Answer: 1. Whether a retrieved result is sufficiently similar to the query to be considered

Explanation:

A similarity threshold provides a rule for determining whether retrieved candidates are sufficiently related to a user’s query. If a candidate’s similarity score does not meet the defined threshold, the application can exclude it from the context or treat the retrieval result as insufficient. This can reduce irrelevant information and help the system avoid generating answers from weakly related documents. Threshold selection should be based on evaluation because an excessively high threshold can remove useful evidence, while a very low threshold can introduce noise. Similarity thresholds do not authenticate users or improve model training. They are retrieval controls used to manage relevance.

Question 166. Which retrieval method is particularly useful when exact identifiers or terms must match?

  1. Lexical or keyword search
    2. Random generation
    3. Conversation summarization
    4. Output formatting

Correct Answer: 1. Lexical or keyword search

Explanation:

Lexical or keyword search is useful when exact terms have significant importance. Examples include error codes, product IDs, document numbers, technical commands, legal references, and specific names. Semantic search can identify conceptually related content, but exact-match techniques can be more effective when the precise wording or identifier matters. Many RAG systems combine lexical and semantic retrieval through hybrid search to cover both use cases. Conversation summarization and output formatting serve different purposes and do not directly perform document retrieval. Selecting an appropriate search method depends on the application’s content, query patterns, and the types of information users need to locate.

Question 167. Why can hybrid retrieval be useful in enterprise knowledge systems?

  1. It can combine semantic similarity with exact keyword matching
    2. It removes the need for source data
    3. It guarantees every generated answer
    4. It replaces authorization

Correct Answer: 1. It can combine semantic similarity with exact keyword matching

Explanation:

Hybrid retrieval combines multiple retrieval approaches, commonly semantic vector search and lexical or keyword search. Semantic search is useful when a query expresses an idea differently from the wording in the source material, while lexical search can perform strongly when exact terms, identifiers, or phrases matter. Combining both can make retrieval more robust across diverse enterprise content. Hybrid retrieval does not guarantee that generated answers are correct because generation quality still depends on source quality, retrieval accuracy, and model behavior. It also does not replace authorization. Access controls must remain in place to ensure that users only retrieve information they are permitted to access.

Question 168. What is an important consideration when selecting chunk boundaries?

  1. Chunks should preserve meaningful semantic units when possible
    2. Every document should become one enormous chunk
    3. Chunk boundaries should be selected randomly
    4. Chunking should eliminate all metadata

Correct Answer: 1. Chunks should preserve meaningful semantic units when possible

Explanation:

Effective chunking attempts to divide documents into sections that retain meaningful information together. For example, a heading and its associated explanation may be more useful when kept within the same chunk rather than separated arbitrarily. Poor chunk boundaries can cause retrieved passages to lack necessary context or include excessive unrelated content. The appropriate chunk size depends on the document structure, embedding model, retrieval strategy, and application requirements. Very large chunks may introduce noise, while extremely small chunks may fragment important information. Metadata should generally be preserved because it can support filtering and traceability. Chunking should therefore be designed and evaluated rather than applied randomly.

Question 169. What is the purpose of an ingestion pipeline in a RAG architecture?

  1. Prepare and index source content for retrieval
    2. Generate every final user response
    3. Authenticate users at login
    4. Increase the model’s temperature

Correct Answer: 1. Prepare and index source content for retrieval

Explanation:

An ingestion pipeline prepares source information so that it can be searched and retrieved by the application. Typical steps can include extracting content, cleaning it, splitting it into chunks, attaching metadata, generating embeddings, and writing the resulting records to an index or vector store. For changing knowledge sources, the pipeline can also detect updates and refresh affected records. The ingestion process is separate from the online generation stage, where a user query is processed and relevant content is retrieved. It does not normally generate the final answer or authenticate users. A reliable ingestion pipeline helps keep the knowledge base consistent, searchable, and current.

Question 170. Why should an ingestion pipeline handle document updates carefully?

  1. Incorrect update handling can leave stale or conflicting information in the index
    2. Updates always improve every response automatically
    3. Updates eliminate the need for evaluation
    4. Updates permanently increase model capacity

Correct Answer: 1. Incorrect update handling can leave stale or conflicting information in the index

Explanation:

When source documents change, the corresponding indexed records must be updated appropriately. If old versions remain active alongside new versions without suitable metadata or filtering, retrieval may return conflicting information. If an updated document is not reprocessed, the index may continue to contain stale embeddings and outdated text. An ingestion pipeline should therefore define how additions, modifications, deletions, and superseded versions are handled. Effective-date and version metadata can help manage these situations. Updating the index does not automatically guarantee better responses, and evaluation remains important after data changes. Proper update handling supports information freshness and retrieval consistency.

Question 171. Which metric is most directly related to how many requests a service can process over time?

  1. Groundedness
    2. Throughput
    3. Retrieval precision
    4. Answer relevance

Correct Answer: 2. Throughput

Explanation:

Throughput measures the amount of work a system can process over a given period. In a model-serving environment, it can be represented by requests per second, tokens processed per second, or another workload-specific unit. Throughput is useful for understanding whether a service can support expected traffic levels and how performance changes as demand increases. It is different from latency, which measures how long an individual request takes to complete. Groundedness, retrieval precision, and answer relevance are primarily quality-oriented measures. Production monitoring should generally consider throughput alongside latency, errors, resource utilization, and application quality so that teams can understand both operational capacity and user-facing behavior.

Question 172. What can latency monitoring reveal in a RAG application?

  1. Which parts of the workflow may be contributing to slow responses
    2. Whether every answer is factually correct
    3. Whether a source document is permanently accurate
    4. Whether a user prefers a particular writing style

Correct Answer: 1. Which parts of the workflow may be contributing to slow responses

Explanation:

Latency monitoring can help identify performance bottlenecks in different stages of a RAG workflow. Developers may measure total request time as well as individual stages such as query processing, vector search, reranking, prompt construction, model inference, and downstream operations. If retrieval is taking much longer than generation, optimization efforts can focus on the retrieval infrastructure. If generation dominates latency, model or serving configuration may need investigation. Latency does not directly determine factual accuracy or source correctness. Detailed monitoring therefore provides useful operational evidence and can help teams improve responsiveness without assuming that a slow application necessarily has a quality problem.

Question 173. Which approach can help control the amount of conversation history sent to a model?

  1. Summarize older messages and retain relevant recent context
    2. Include every historical message indefinitely
    3. Delete the current user query
    4. Remove all system instructions

Correct Answer: 1. Summarize older messages and retain relevant recent context

Explanation:

Long conversations can consume a significant portion of a model’s context window. Summarizing older messages allows an application to retain important facts, decisions, and conversational state without sending every historical message in full. Recent messages can then be retained directly when their detailed wording remains important. This approach can reduce token consumption while preserving useful context. However, summaries may omit details or introduce errors, so the application should determine which information must be preserved exactly. Including unlimited history can create context pressure and irrelevant information. Removing the current query or system instructions would undermine the model’s ability to understand and safely respond to the request.

Question 174. What is one benefit of using a structured output schema?

  1. It makes responses easier to validate and consume programmatically
    2. It guarantees the model’s factual correctness
    3. It removes the need for prompts
    4. It replaces the knowledge base

Correct Answer: 1. It makes responses easier to validate and consume programmatically

Explanation:

Structured output schemas define the expected format of a model response, including fields, data types, and sometimes required or optional elements. This is valuable when generated information must be passed to software components that expect predictable data. For example, an application can validate whether a response contains required fields before sending it to a database or another API. Structured outputs do not guarantee that the values are factually correct, so semantic evaluation and grounding remain necessary. They also do not eliminate prompts or external knowledge sources. Their primary benefit is making model output more predictable, machine-readable, and easier to validate.

Question 175. Why should model outputs sometimes be validated before being passed to downstream systems?

  1. Validation can detect malformed or unexpected output before it causes downstream problems
    2. Validation automatically retrains the model
    3. Validation increases vector-search recall
    4. Validation eliminates the need for monitoring

Correct Answer: 1. Validation can detect malformed or unexpected output before it causes downstream problems

Explanation:

Generative models produce probabilistic outputs, so applications should not always assume that every response will exactly match the format expected by downstream software. Validation can check required fields, data types, allowed values, length constraints, or other application-specific requirements before the response is processed further. If the output fails validation, the application can reject it, request a corrected response, or route the case for additional handling. Validation does not retrain the model or directly improve retrieval recall. It is one layer of reliability that can protect deterministic application components from malformed model output and should be combined with appropriate evaluation and monitoring.

Question 176. What is a key purpose of application observability?

  1. Provide visibility into system behavior and help diagnose problems
    2. Replace all security controls
    3. Increase model context automatically
    4. Guarantee zero production failures

Correct Answer: 1. Provide visibility into system behavior and help diagnose problems

Explanation:

Observability provides information that helps teams understand what is happening inside an application and diagnose unexpected behavior. For a generative AI system, useful observability can include request latency, errors, retrieval results, model versions, prompt versions, token usage, endpoint performance, and other relevant signals. Traces can connect these events across multiple components so that a team can investigate where a failure occurred. Observability does not guarantee that failures will never happen and does not replace authentication, authorization, or other security controls. Instead, it gives developers and operators the information needed to detect issues, investigate causes, and improve the system over time.

Question 177. Which practice can help make generative AI experiments reproducible?

  1. Record the relevant model, prompt, data, and configuration versions
    2. Change several variables without recording them
    3. Delete evaluation results after every experiment
    4. Use a different evaluation dataset for every comparison

Correct Answer: 1. Record the relevant model, prompt, data, and configuration versions

Explanation:

Reproducibility requires enough information to recreate an experiment and understand why a particular result occurred. In generative AI applications, this may include the model version, prompt template, embedding model, source-data version, retrieval parameters, generation settings, and evaluation dataset. Recording these artifacts makes it possible to compare experiments consistently and identify which change affected performance. Without this information, developers may struggle to reproduce a successful result or diagnose a regression. Deleting evaluation results and changing datasets between experiments also makes comparisons less meaningful. Version tracking is therefore an important engineering practice for controlled experimentation and reliable generative AI development.

Question 178. What can user feedback contribute to an evaluation dataset?

  1. Real-world failure cases and representative examples of user needs
    2. Automatic model-weight updates
    3. Guaranteed factual answers
    4. Permanent elimination of security risks

Correct Answer: 1. Real-world failure cases and representative examples of user needs

Explanation:

User feedback can provide valuable examples of how an application performs in actual usage. Feedback may identify incorrect answers, missing information, confusing responses, poor retrieval, or requests that were not represented in the original evaluation dataset. With appropriate privacy and governance controls, useful feedback cases can be transformed into evaluation examples that help test future versions. This creates a feedback loop between production usage and development. User feedback does not automatically change model weights or guarantee correctness. It should complement structured evaluation, monitoring, and expert review rather than replace them. Real-world examples can help make future testing more representative of actual user needs.

Question 179. Why is it useful to evaluate retrieval separately from final answer quality?

  1. It helps determine whether a failure originated in retrieval or generation
    2. Retrieval quality has no effect on generation
    3. It eliminates the need for model evaluation
    4. It guarantees perfect source data

Correct Answer: 1. It helps determine whether a failure originated in retrieval or generation

Explanation:

A RAG application contains multiple stages, and evaluating them separately can make troubleshooting much easier. Retrieval evaluation can determine whether relevant documents are being found, while answer evaluation can determine whether the model uses the supplied evidence appropriately. If the correct document was never retrieved, changing the generation prompt may not solve the underlying problem. Conversely, if highly relevant evidence was retrieved but the answer is still incorrect, the generation stage may require investigation. Separating these evaluations helps teams identify component-level weaknesses and choose targeted improvements. It also supports more meaningful experimentation with retrieval settings, prompts, models, and source data.

Question 180. Which approach best supports reliable deployment of a generative AI application?

  1. Deploy changes without evaluation or monitoring
    2. Test representative cases, version artifacts, deploy carefully, and monitor results
    3. Make random production changes whenever users report an issue
    4. Remove rollback procedures

Correct Answer: 2. Test representative cases, version artifacts, deploy carefully, and monitor results

Explanation:

Reliable deployment involves more than simply placing a new model or prompt into production. Teams should evaluate changes against representative test cases, compare them with a known baseline, and record relevant versions of models, prompts, data, and retrieval configuration. Deployment can then be performed using appropriate release controls, with monitoring used to identify unexpected changes in quality, latency, errors, or resource consumption. A rollback mechanism can provide an additional safeguard when a release causes unacceptable behavior. Random production changes make it difficult to determine what caused a problem. A structured development, evaluation, deployment, and monitoring process supports more predictable and maintainable generative AI systems.