Microsoft AI-300 Practice Test Questions and Exam Dumps Part20 Q381-400

View Full Microsoft AI-300 Exam Dumps and Practice Test Dumps

 

Question 381. Which practice helps ensure that changes to an ML pipeline can be reviewed before they are merged?

  1. Direct production editing
    2. Shared administrator access
    3. Pull requests and source-control review
    4. Undocumented configuration changes

Correct Answer: 3. Pull requests and source-control review

Explanation:

Pull requests provide a structured mechanism for reviewing changes before they become part of a shared codebase or deployment workflow. In an ML environment, pipeline code, infrastructure definitions, configuration, and other artifacts can be reviewed for correctness, security, and consistency before they are merged. Reviewers can examine the proposed changes, discuss potential issues, and verify that required tests have been completed. This creates an auditable history of modifications and reduces the likelihood of introducing untested changes into later pipeline stages. Source-control review also supports collaboration by giving teams a common process for discussing and approving changes to important MLOps artifacts.

Question 382. Which capability helps identify which training run produced a particular ML model?

  1. Experiment tracking and run metadata
    2. Endpoint availability alone
    3. DNS configuration
    4. Network routing only

Correct Answer: 1. Experiment tracking and run metadata

Explanation:

Experiment tracking records information about training runs so that teams can understand how a particular model was produced. Useful metadata may include parameters, metrics, source-code revisions, data references, environment information, timestamps, and generated artifacts. When a model is promoted to production, linking it back to its originating run improves traceability and reproducibility. Engineers can use the information to compare experiments, investigate model differences, and understand why a particular candidate was selected. Experiment tracking therefore complements model registries and source control by preserving the context surrounding model creation rather than storing only the final model artifact.

Question 383. What should be done with a model that fails a mandatory security validation check?

  1. Promote it immediately
    2. Pause or stop its promotion
    3. Delete all security results
    4. Disable future security validation

Correct Answer: 2. Pause or stop its promotion

Explanation:

A failed security validation indicates that a model deployment or its supporting configuration has not satisfied an established security requirement. The deployment pipeline should therefore stop or pause promotion until the issue has been investigated and resolved. Depending on the problem, remediation might involve correcting permissions, changing configuration, updating dependencies, protecting secrets, or addressing another identified security weakness. Automatically promoting the candidate would bypass a control specifically designed to prevent unsuitable releases. Security validation results should be retained so that the team can understand the failure and demonstrate what checks were performed. Once remediation is complete, the candidate should undergo the required validation again.

Question 384. Which monitoring metric is most useful for detecting whether an endpoint is taking longer than expected to respond?

  1. Model version
    2. Request latency
    3. Training dataset name
    4. Source-code branch count

Correct Answer: 2. Request latency

Explanation:

Request latency measures the time required for an online endpoint to process an inference request and return a response. Monitoring this metric allows teams to identify performance degradation that may affect applications or users. Increased latency can result from higher traffic, resource constraints, model complexity, dependency failures, or deployment configuration changes. Establishing an expected baseline and defining thresholds makes it easier to identify significant deviations. Latency should be monitored together with error rate, availability, resource utilization, and model-specific signals because response time alone cannot describe every aspect of service health. Consistent latency monitoring helps teams investigate performance problems before they become widespread.

Question 385. Why should an ML deployment retain the previous validated model version?

  1. To provide a known-good recovery option
    2. To prevent all future testing
    3. To remove model lineage
    4. To increase deployment uncertainty

Correct Answer: 1. To provide a known-good recovery option

Explanation:

Retaining a previously validated model version provides a dependable recovery target if a newly deployed model behaves unexpectedly. The previous version should ideally be stored together with its compatible environment, configuration, and relevant deployment metadata. If the new release causes unacceptable errors, performance degradation, or other issues, the deployment process can redirect traffic or restore the known-good version. Without a retained recovery target, engineers may need to reconstruct an earlier state during an incident, increasing recovery complexity. Keeping validated versions also supports comparison, auditing, and historical analysis throughout the model lifecycle.

Question 386. Which practice helps detect whether production inputs differ significantly from the data used during model development?

  1. Model naming
    2. Data drift monitoring
    3. Source-code formatting
    4. Endpoint labeling

Correct Answer: 2. Data drift monitoring

Explanation:

Data drift monitoring compares characteristics of production inputs with a reference distribution or historical baseline. Significant differences can indicate that the environment in which the model operates has changed. Changes might result from user behavior, business processes, external conditions, data collection modifications, or other factors. Drift monitoring does not automatically prove that the model has become inaccurate, but it provides an important signal that further investigation may be necessary. Teams can combine drift measurements with prediction distributions and available model-quality metrics to determine whether the observed changes are affecting outcomes. Continuous monitoring helps organizations respond to changing data conditions over the model’s operational lifetime.

Question 387. What is the purpose of storing deployment configuration together with model release information?

  1. To make the release easier to reproduce
    2. To eliminate source control
    3. To remove rollback options
    4. To prevent deployment auditing

Correct Answer: 1. To make the release easier to reproduce

Explanation:

A model release depends on more than the model artifact itself. Deployment configuration can determine the runtime environment, resource settings, traffic allocation, endpoint behavior, and other characteristics that influence how the model operates. Storing this configuration with the release information makes it easier to reconstruct the deployment later and understand exactly how the model was exposed to production. It also improves rollback because a previous model can be restored with the configuration that was validated alongside it. Version-controlled deployment configuration therefore contributes to reproducibility, traceability, troubleshooting, and consistent promotion across environments.

Question 388. Which control provides a formal checkpoint before a model is promoted to production?

  1. Model filename
    2. Approval gate
    3. Training notebook
    4. Endpoint URL

Correct Answer: 2. Approval gate

Explanation:

An approval gate provides a formal checkpoint in a model promotion workflow. After automated tests and validation have completed, an authorized reviewer or team can examine the available evidence before permitting the model to continue toward production. Depending on organizational requirements, the review may consider model-quality results, security validation, deployment configuration, operational readiness, and monitoring plans. Approval gates are not intended to replace automated controls; they can complement them when human authorization is required. Recording the approval decision against a specific model and deployment version also improves auditability and makes the release process easier to understand later.

Question 389. Which approach reduces the impact of a new model if problems occur immediately after release?

  1. Sending all traffic to the new model
    2. Removing monitoring
    3. Gradual traffic exposure
    4. Deleting the previous deployment

Correct Answer: 3. Gradual traffic exposure

Explanation:

Gradual traffic exposure limits the amount of production traffic received by a new model during the initial rollout. This provides an opportunity to observe the model under realistic conditions while reducing the number of users or requests affected if problems occur. Teams can monitor latency, errors, availability, resource utilization, prediction behavior, and available model-quality indicators. If the new version meets the defined criteria, traffic can be increased progressively. If issues appear, the rollout can be paused or traffic can be redirected to the established version. This approach works particularly well with canary deployments and automated monitoring.

Question 390. Which information is most important when investigating a model’s unexpected production behavior?

  1. Only the model display name
    2. Model version, deployment configuration, logs, and monitoring data
    3. Only the number of developers
    4. Only the endpoint description

Correct Answer: 2. Model version, deployment configuration, logs, and monitoring data

Explanation:

Investigating unexpected model behavior requires enough information to reconstruct what was running and how it behaved. The model version identifies the artifact, while deployment configuration describes the environment and settings in which it operated. Logs provide details about events and failures, and monitoring data shows operational behavior such as latency, errors, availability, and other signals over time. Together, these records allow engineers to correlate problems with deployments and identify potential causes. Additional lineage information, such as source revision and evaluation results, can further strengthen the investigation. Maintaining these records is therefore an important part of production MLOps observability.

Question 391. What is the main purpose of automated model evaluation in a deployment pipeline?

  1. To determine whether the candidate satisfies predefined quality criteria
    2. To remove the model registry
    3. To disable source control
    4. To guarantee perfect production results

Correct Answer: 1. To determine whether the candidate satisfies predefined quality criteria

Explanation:

Automated model evaluation measures a candidate model against predefined criteria before it is considered for production promotion. Depending on the workload, evaluation can examine accuracy, precision, recall, error measures, resource consumption, fairness-related requirements, or other relevant indicators. The results can then be compared with established thresholds or with the performance of a currently deployed model. If requirements are not satisfied, the pipeline can stop or pause promotion. Automated evaluation provides repeatable evidence and reduces reliance on subjective or inconsistent manual checks. It does not guarantee future production performance, but it provides an important quality-control stage before deployment.

Question 392. Which practice helps ensure that an ML pipeline uses a reproducible set of infrastructure resources?

  1. Manual configuration changes
    2. Temporary administrator access
    3. Infrastructure as Code
    4. Undocumented resource creation

Correct Answer: 3. Infrastructure as Code

Explanation:

Infrastructure as Code represents infrastructure requirements through declarative or programmatic definitions that can be version controlled and reused. For ML workloads, these definitions can describe resources and configurations required to run pipelines, endpoints, storage, networking, permissions, and supporting services. Using IaC reduces reliance on undocumented manual changes and makes infrastructure easier to reproduce across environments. Changes can also be reviewed and tracked through source control. When infrastructure must be recreated after an incident or deployed to another environment, the definitions provide a consistent starting point. IaC therefore supports reproducibility, governance, consistency, and controlled infrastructure management.

Question 393. Why should sensitive values not be written to deployment logs?

  1. Logs may be accessible to users or systems that should not see the secrets
    2. Logs cannot contain timestamps
    3. Logging prevents model deployment
    4. Secrets become automatically versioned

Correct Answer: 1. Logs may be accessible to users or systems that should not see the secrets

Explanation:

Deployment logs are valuable for troubleshooting, but they can also be accessed by operators, monitoring systems, support personnel, or other authorized users who may not require access to sensitive credentials. Writing passwords, keys, tokens, or other secrets into logs can therefore create unnecessary exposure. Secure pipelines should retrieve sensitive values through appropriate secret-management mechanisms and avoid printing them during execution. Logs should contain enough information to diagnose problems without revealing confidential values. Access controls, retention policies, and auditing should also be applied to logging systems. Protecting log contents is an important part of securing automated ML deployment workflows.

Question 394. Which metric can help identify whether an online service is experiencing an unusually high number of failed requests?

  1. Error rate
    2. Model version
    3. Training duration
    4. Dataset column count

Correct Answer: 1. Error rate

Explanation:

Error rate measures the frequency or proportion of failed requests and is a key operational metric for online inference services. Monitoring it against an established baseline can reveal sudden increases associated with deployment defects, invalid requests, dependency failures, resource limitations, or infrastructure problems. An elevated error rate should trigger investigation rather than automatically being attributed to a particular cause. Engineers can correlate the metric with deployment timestamps, logs, health checks, resource utilization, and configuration changes to identify the underlying issue. Error-rate monitoring is most useful when combined with other operational signals such as latency and availability, providing a more complete view of endpoint health.

Question 395. Which model management capability helps teams distinguish between multiple releases of the same model?

  1. Model versioning
    2. Endpoint deletion
    3. Manual file renaming without records
    4. Disabling metadata

Correct Answer: 1. Model versioning

Explanation:

Model versioning assigns distinct identities to different releases of a model so that teams can determine which artifact was trained, evaluated, or deployed. This is essential when multiple candidate models exist or when a production service needs to move backward to a previously validated version. Version information can be combined with source revisions, environment definitions, evaluation results, and deployment metadata to establish complete lineage. Without versioning, teams may confuse artifacts or accidentally deploy the wrong file. A structured model registry can help organize these versions and provide a central reference for model lifecycle management.

Question 396. What should happen when a model fails a required data-quality check?

  1. The model should bypass validation
    2. The pipeline should stop or flag the failure
    3. The validation results should be deleted
    4. The model should receive production traffic immediately

Correct Answer: 2. The pipeline should stop or flag the failure

Explanation:

Data-quality checks are intended to prevent invalid or unexpected data from progressing through important ML workflow stages. If required checks fail, the pipeline should stop or flag the issue so that the underlying problem can be investigated. Depending on the workflow, remediation might involve correcting the source data, adjusting the validation rules when appropriate, or changing the processing logic. Automatically continuing after a known validation failure can allow bad inputs to affect training, evaluation, or deployment. Retaining the validation results provides evidence for troubleshooting and auditing. Data validation is therefore an important quality-control mechanism within an automated MLOps pipeline.

Question 397. Which practice helps ensure that deployment changes can be audited later?

  1. Source control and deployment history
    2. Manual changes without records
    3. Shared administrator passwords
    4. Deleting old deployment information

Correct Answer: 1. Source control and deployment history

Explanation:

Source control and deployment history provide a record of what changed, when the change occurred, and which release or configuration was involved. This information supports auditing because teams can trace modifications to specific revisions and deployment events. It is also useful for troubleshooting when production behavior changes after a release. Maintaining deployment history alongside model versions, source revisions, environment definitions, and configuration creates stronger lineage across the lifecycle. Manual changes without records make it much harder to reconstruct events accurately. A controlled deployment process should therefore preserve appropriate historical information while applying suitable retention and access controls.

Question 398. What is the purpose of continuous monitoring after a model reaches production?

  1. To observe operational and model behavior over time
    2. To prevent all future model updates
    3. To remove the need for testing
    4. To guarantee that drift never occurs

Correct Answer: 1. To observe operational and model behavior over time

Explanation:

Continuous monitoring provides ongoing visibility into how a model and its supporting service behave after deployment. Operational signals can include latency, error rate, availability, health status, and resource utilization. Model-related signals can include prediction distributions, data drift, and quality metrics when ground-truth information becomes available. Monitoring helps teams identify deviations from expected behavior and determine when investigation or remediation may be required. It does not replace pre-deployment testing or guarantee that problems will never occur. Instead, it provides an ongoing feedback mechanism that supports maintenance, incident response, model lifecycle decisions, and continuous improvement.

Question 399. Which combination helps maintain secure and traceable access to resources used by an ML workload?

  1. Shared administrator credentials
    2. Hard-coded passwords
    3. Managed identity with least-privilege permissions
    4. Credentials stored in source code

Correct Answer: 3. Managed identity with least-privilege permissions

Explanation:

Managed identity provides an identity-based authentication mechanism for supported workloads, while least-privilege permissions restrict that identity to the resources and actions it actually requires. Together, these controls reduce the need to distribute long-lived credentials and limit the potential impact of unauthorized access. Permissions can be reviewed and adjusted as workload requirements change. This approach is generally preferable to embedding passwords or access keys in source code because secrets can accidentally become exposed through repositories, logs, or copied configuration. Proper authorization remains necessary because a managed identity does not automatically grant access to every resource. Security controls should therefore be applied together.

Question 400. Which approach represents a mature MLOps strategy for production model management?

  1. Manual deployment with no monitoring
    2. Version control, automated validation, controlled promotion, monitoring, and rollback
    3. Direct production changes from developer workstations
    4. Untracked models and shared credentials

Correct Answer: 2. Version control, automated validation, controlled promotion, monitoring, and rollback

Explanation:

A mature MLOps strategy applies controls throughout the model lifecycle rather than focusing only on deployment. Version control provides traceability for code, configurations, environments, and related artifacts. Automated validation and testing help determine whether a candidate satisfies established requirements before promotion. Controlled deployment techniques limit exposure while production behavior is observed. Continuous monitoring provides operational and model-related feedback after release, while retained known-good versions and deployment configurations provide a practical rollback path. Together, these practices support reproducibility, security, traceability, quality control, and recovery. They also create a repeatable framework for managing models as production systems evolve over time.