Amazon AWS Certified Generative AI Developer – Professional AIP-C01 Practice Test Questions and Exam Dumps Part11 Q201-220

View Full Amazon AWS Certified Generative AI Developer – Professional AIP-C01 Exam Dumps and Practice Test Dumps

 

Question 201

Which AWS service can be used to monitor application metrics, logs, and alarms for a generative AI workload?

  1. AWS KMS
  2. Amazon CloudWatch
  3. AWS Secrets Manager
  4. Amazon S3

Correct Answer: 2

Explanation

Amazon CloudWatch provides monitoring and observability capabilities for AWS applications and infrastructure. Developers can collect metrics and logs, create dashboards, configure alarms, and investigate operational problems. For generative AI workloads, CloudWatch can help monitor model invocation latency, errors, resource utilization, and application-specific metrics. These signals can be used to identify performance degradation or unexpected behavior. AWS KMS focuses on encryption keys, Secrets Manager protects credentials, and Amazon S3 provides object storage. CloudWatch is therefore the most appropriate service for centralized operational monitoring.

Question 202

An application uses retrieved documents to answer customer questions. The developer wants to prevent documents from one customer being retrieved for another customer. What should be implemented?

  1. Higher model temperature
  2. Metadata-based access filtering
  3. Larger prompts
  4. Random document sampling

Correct Answer: 2

Explanation

Metadata-based access filtering can restrict retrieval results according to attributes such as customer ID, tenant ID, department, or security classification. In a multi-tenant RAG application, this filtering should occur before or during retrieval so that unauthorized documents are not supplied to the foundation model. Authorization should also be enforced by trusted application components rather than relying solely on prompt instructions. Increasing temperature or prompt size does not provide tenant isolation. Proper metadata design and access controls are essential for protecting customer-specific information.

Question 203

A developer is designing an agent that can call a payment-processing API. Which approach provides the strongest protection against unauthorized transactions?

  1. Give the agent unrestricted API permissions
  2. Rely only on the system prompt
  3. Enforce authorization and validate tool parameters before execution
  4. Increase the model context window

Correct Answer: 3

Explanation

Sensitive agent actions should be protected by trusted controls outside the model itself. The application should validate tool parameters, verify authorization, and ensure that the requested transaction is permitted before invoking the payment API. Depending on the risk, additional confirmation or approval may also be required. System prompts can describe safe behavior but should not be treated as a security boundary because models can be influenced by malicious or unexpected input. Least-privilege permissions and backend validation significantly reduce the risk of unauthorized transactions.

Question 204

A company needs to process thousands of independent documents and generate embeddings for each document. Which design is generally most suitable for efficient processing?

  1. Process every document manually
  2. Use parallel or asynchronous processing
  3. Place all documents into one prompt
  4. Disable monitoring

Correct Answer: 2

Explanation

Independent document-processing tasks can often be handled efficiently through asynchronous or parallel processing. An event-driven architecture can trigger processing when documents arrive, while workflow services can coordinate multiple processing steps. Parallel execution can reduce total processing time when workloads and service quotas permit it. Sending thousands of documents in a single prompt is inefficient and can exceed context limits. Manual processing does not scale effectively, and disabling monitoring removes important visibility into failures, throttling, and processing performance.

Question 205

Which change is most likely to reduce generative AI inference cost without necessarily reducing the number of user requests?

  1. Increase output token limits
  2. Use unnecessarily large models
  3. Reduce unnecessary input and output tokens
  4. Duplicate every prompt several times

Correct Answer: 3

Explanation

Token usage is an important cost factor for many generative AI workloads. Developers can reduce unnecessary costs by removing redundant prompt content, limiting unnecessary output length, improving context selection, and avoiding retrieval of irrelevant information. Appropriate model selection can also reduce cost when a smaller model provides sufficient quality. Increasing token limits or using larger models unnecessarily can increase expenses. Duplicate prompts add additional processing without providing proportional value. Cost optimization should always be validated against response quality and application requirements.

Question 206

A RAG system retrieves many documents, but only a few are highly relevant. Which technique can help place the most useful results at the top before generation?

  1. Reranking
  2. Encryption
  3. Tokenization of IAM policies
  4. Log rotation

Correct Answer: 1

Explanation

Reranking evaluates retrieved candidates using a relevance-oriented process and can reorder them so that the most useful documents appear first. This can improve the quality of the context provided to a foundation model, particularly when the initial retrieval stage returns many candidates. Reranking is often used after broad retrieval to improve precision before generation. Encryption protects data, IAM policies control permissions, and log rotation manages operational data. Reranking should be evaluated using representative queries to confirm that it improves retrieval quality.

Question 207

A developer wants to keep prompt templates organized, reusable, and easier to update across multiple applications. Which practice is most appropriate?

  1. Store prompts only in individual developer notes
  2. Maintain versioned prompt templates
  3. Hard-code different prompts into every API call
  4. Randomly modify prompts in production

Correct Answer: 2

Explanation

Versioned prompt templates make prompts easier to manage, reuse, test, and roll back. Teams can maintain controlled versions and evaluate changes against consistent datasets before promoting them to production. Centralized prompt management also reduces duplication when multiple applications use similar instructions. Hard-coding unrelated prompt copies makes maintenance difficult, while undocumented production changes can introduce unpredictable behavior. Prompt versions should ideally be associated with evaluation results so developers can identify which template produced a particular quality, safety, or performance outcome.

Question 208

A company needs an application to execute several dependent AI-processing steps where a later step should run only after the previous step succeeds. Which AWS service is well suited for this orchestration?

  1. AWS Step Functions
  2. Amazon S3
  3. AWS KMS
  4. Amazon CloudWatch

Correct Answer: 1

Explanation

AWS Step Functions provides workflow orchestration using state machines. It can coordinate sequential and parallel tasks, implement retries and error handling, and control execution based on the outcome of previous steps. This makes it useful for multi-stage generative AI workflows such as document processing, validation, retrieval, model invocation, and post-processing. Amazon S3 is primarily object storage, KMS manages encryption keys, and CloudWatch provides monitoring. Step Functions is particularly valuable when the workflow requires explicit control over dependencies and failure paths.

Question 209

A developer wants to prevent sensitive customer information from being included in model responses. Which approach provides an appropriate safety layer?

  1. Remove all authentication
  2. Use sensitive-data detection and filtering
  3. Increase model temperature
  4. Increase the number of retrieved documents

Correct Answer: 2

Explanation

Sensitive-data detection and filtering can identify information such as personally identifiable information or other protected content before it reaches the model or before a response is returned to a user. Depending on the application, developers can combine this with Bedrock Guardrails, application-level validation, authorization, and data-minimization techniques. Increasing temperature does not protect sensitive information, and retrieving more documents may increase the amount of sensitive content exposed to the model. Security controls should operate independently of model-generated instructions wherever possible.

Question 210

An application frequently receives throttling errors when invoking a foundation model. What should the developer investigate first?

  1. Request rate, quotas, and retry behavior
  2. S3 bucket naming
  3. Document font size
  4. User interface colors

Correct Answer: 1

Explanation

Throttling generally indicates that requests are exceeding a service’s permitted throughput or that a workload is experiencing capacity constraints. The developer should examine request rates, applicable quotas, concurrency, retry behavior, and traffic patterns. Exponential backoff with appropriate jitter can help prevent clients from repeatedly sending requests during temporary throttling. The application may also need workload smoothing or architectural changes. S3 naming, document fonts, and interface styling do not address model invocation throttling and therefore should not be the initial troubleshooting focus.

Question 211

A developer wants to compare two foundation models for summarization using the same test dataset. What is the best evaluation approach?

  1. Compare outputs using consistent evaluation criteria
  2. Evaluate each model with different questions
  3. Change the scoring method for each model
  4. Test only one example

Correct Answer: 1

Explanation

A fair model comparison requires consistent evaluation conditions. Both models should be tested against the same representative dataset, with comparable prompts, relevant inference settings, and consistent evaluation criteria. Metrics may include accuracy, relevance, groundedness, latency, cost, and safety depending on the application. Using different questions or scoring methods makes the comparison less reliable. A single example is also insufficient to characterize model behavior. Systematic evaluation allows developers to select a model based on measurable application requirements rather than assumptions.

Question 212

A company wants to deploy an updated AI application while reducing the risk of immediately exposing all users to the new version. Which deployment strategy is appropriate?

  1. Delete the old version first
  2. Use a gradual or canary deployment
  3. Change all prompts manually after deployment
  4. Disable monitoring during deployment

Correct Answer: 2

Explanation

A canary or gradual deployment exposes the new version to a limited portion of traffic before expanding it to the broader user base. Developers can monitor error rates, latency, quality metrics, and other operational signals to determine whether the release behaves as expected. If serious problems occur, traffic can be redirected to the previous version. Deploying to everyone immediately increases the potential impact of regressions. Monitoring should remain enabled throughout the deployment so that unexpected behavior can be detected quickly.

Question 213

A RAG application suddenly begins returning outdated answers after new documents are uploaded to Amazon S3. What should the developer investigate?

  1. Whether the ingestion and indexing pipeline processed the new documents
  2. Whether the model temperature is exactly zero
  3. Whether the application logo changed
  4. Whether IAM usernames are alphabetically ordered

Correct Answer: 1

Explanation

New source documents must pass through the application’s ingestion and indexing process before retrieval can use them. The developer should verify that document ingestion succeeded, text extraction completed correctly, embeddings were generated, and the vector or search index was updated. Synchronization delays or failed indexing jobs can cause an application to continue retrieving older information. Model temperature does not determine whether new source data is available. Monitoring ingestion workflows and index freshness is therefore important for maintaining accurate and current RAG responses.

Question 214

Which design principle is most important when assigning IAM permissions to a generative AI application’s Lambda function?

  1. Grant administrator access for convenience
  2. Use the least privileges required
  3. Allow access to every AWS service
  4. Share the same credentials with users

Correct Answer: 2

Explanation

The principle of least privilege requires granting a workload only the permissions necessary to perform its intended functions. A Lambda function processing AI requests might need access to a specific S3 bucket, model invocation permission, or a particular database operation, but it should not automatically receive administrator access. Narrow permissions reduce the potential impact of compromised credentials, application vulnerabilities, or unexpected behavior. IAM roles should be reviewed regularly and adjusted as application requirements change. Least privilege is a core component of secure AWS architecture.

Question 215

An AI application repeatedly retrieves irrelevant documents even though the correct documents are present in the vector index. Which area should the developer investigate first?

  1. Retrieval configuration and query formulation
  2. CloudTrail log retention
  3. KMS key rotation schedule
  4. API domain registration

Correct Answer: 1

Explanation

When relevant documents exist but are not being retrieved, the developer should examine the retrieval pipeline. Important factors include embedding-model consistency, query construction, similarity thresholds, metadata filters, chunking, index configuration, and retrieval parameters. If hybrid search is used, keyword and semantic retrieval settings should also be reviewed. CloudTrail retention and KMS key rotation are important security and operational concerns but do not normally determine retrieval relevance. Retrieval quality should be measured with representative queries to identify where the pipeline is failing.

Question 216

A developer wants an AI workflow to continue even if one noncritical enrichment step fails. Which workflow behavior is appropriate?

  1. Configure controlled error handling and a fallback path
  2. Terminate the entire application for every error
  3. Retry the failed task forever
  4. Ignore every error without recording it

Correct Answer: 1

Explanation

Controlled error handling allows a workflow to distinguish between critical and noncritical failures. If an enrichment step is optional, the workflow can catch the failure, record the problem, and continue with a fallback path or reduced functionality. This improves resilience while maintaining visibility into failures. Retrying forever can waste resources and create cascading problems, while ignoring all errors makes troubleshooting difficult. Workflow services such as Step Functions can provide explicit error-handling logic, retries, catch states, and alternative execution paths.

Question 217

A company wants to ensure that every production model invocation can be associated with the identity or service that initiated it. Which capability is most relevant?

  1. Audit logging
  2. Increasing temperature
  3. Document chunking
  4. Vector normalization

Correct Answer: 1

Explanation

Audit logging provides a record of important application and AWS activity, helping organizations determine which identity or service performed an operation. AWS CloudTrail is commonly used for auditing AWS API activity. For generative AI systems, audit records can support security investigations, compliance requirements, and operational troubleshooting. Logging should be designed carefully to avoid unnecessarily recording sensitive information. Temperature affects generation behavior, chunking affects retrieval, and vector normalization relates to numerical representations. None of those capabilities provides the required audit trail.

Question 218

A developer wants to reduce latency in a RAG application. Which optimization can directly reduce the amount of information sent to the foundation model?

  1. Retrieve only the most relevant context
  2. Increase the number of retrieved documents
  3. Add unrelated examples to every prompt
  4. Remove all retrieval evaluation

Correct Answer: 1

Explanation

Sending only relevant context can reduce input token count and therefore potentially decrease processing time and cost. Retrieval systems can use top-k selection, metadata filtering, reranking, and other techniques to remove unnecessary documents before generation. Excessive context can increase latency and may distract the model from the most important evidence. Adding unrelated examples increases prompt size and provides little value. Retrieval evaluation should not be removed because developers still need to verify that context reduction does not negatively affect answer quality or groundedness.

Question 219

An enterprise application needs to connect its generative AI workflow with existing internal systems and APIs. Which architectural approach is most appropriate?

  1. Use well-defined APIs and controlled integration points
  2. Give the model direct database administrator access
  3. Store credentials inside prompts
  4. Allow unrestricted network access

Correct Answer: 1

Explanation

Well-defined APIs and controlled integration points provide a structured way for generative AI applications to interact with enterprise systems. APIs can enforce authentication, authorization, input validation, rate limits, logging, and other security controls. Agent tools should expose only the operations necessary for the intended workflow. Giving a model direct administrator access to databases or unrestricted network access creates significant security risks. Credentials should be stored securely rather than placed in prompts. Enterprise integrations should therefore combine controlled interfaces with least-privilege access.

Question 220

A production AI application experiences increasing latency after traffic grows significantly. Which investigation is most appropriate?

  1. Examine only the model’s temperature
  2. Remove monitoring to improve performance
  3. Analyze service metrics, concurrency, throttling, and downstream dependencies
  4. Increase the prompt length

Correct Answer: 3

Explanation

Increasing traffic can expose bottlenecks in model invocation, application compute, retrieval services, APIs, databases, or downstream dependencies. Developers should analyze latency metrics, concurrency, throttling events, request rates, resource utilization, and dependency performance to identify the actual bottleneck. CloudWatch and application-level telemetry can provide useful evidence. Changing temperature or increasing prompt size does not address the underlying capacity problem. Removing monitoring would make diagnosis harder. Performance troubleshooting should be evidence-driven so that optimization targets the component responsible for the latency increase.