Skip to content

Databricks Certified Machine Learning Professional - Practice Questions

15 questions for the ML Professional exam, weighted toward MLOps and ML pipelines (30%), advanced ML (25%), feature engineering (20%), then deployment and serving (15%) and monitoring (10%).

Cert page: exams/databricks/ml-professional/

Question 1

Scenario: A feature must be computed from events strictly before each label's timestamp.

A. Join on the key only B. A point-in-time join using the feature store's time-aware lookup, so no future information leaks into training C. Use the latest feature values D. Ignore timestamps

Answer **Correct: B** **Why:** Joining on key alone attaches today's feature values to a label from last year, which is leakage that inflates validation scores and collapses in production. Point-in-time correctness is the reason feature stores track feature timestamps at all.

Question 2

Scenario: A production model must be retrained and redeployed automatically when quality degrades.

A. Manual retraining when someone notices B. A monitored trigger feeding a pipeline that retrains, evaluates against the incumbent, and promotes only if it wins C. Retrain daily regardless D. Never retrain

Answer **Correct: B** **Why:** The champion-challenger comparison is what makes automation safe: a retrained model on a bad data batch will not be promoted. Without that gate, automated retraining is a mechanism for automatically deploying regressions.

Question 3

Scenario: Two model versions must be compared on live traffic.

A. Offline evaluation only B. A serving endpoint with traffic split between versions, or shadow serving the challenger without returning its responses C. Replace the model entirely D. Ask users

Answer **Correct: B** **Why:** Shadow mode measures the challenger on real traffic at zero user risk, which is the right first step when the model affects decisions. A traffic split then gives real outcome data on a bounded share before full promotion.

Question 4

Scenario: Model quality monitoring needs ground truth that arrives days after the prediction.

A. Monitor input drift only B. Monitor input drift immediately and join delayed labels to predictions when they arrive, computing quality metrics on that lag C. Skip monitoring D. Assume quality is stable

Answer **Correct: B** **Why:** Label delay is normal, so you need both signals: drift as the leading indicator available now, and realized accuracy as the lagging ground truth. Inference tables make the join straightforward because requests and predictions are already in Delta.

Question 5

Scenario: A model artifact must carry its input schema so bad requests fail clearly.

A. No schema B. Log the model with an MLflow signature and an input example C. Document it separately D. Validate in the client only

Answer **Correct: B** **Why:** The signature makes serving reject malformed input with a clear error instead of silently coercing types and producing nonsense predictions. It also documents the contract for whoever integrates months later.

Question 6

Scenario: Custom preprocessing and postprocessing must ship with the model.

A. Ask callers to reimplement it B. An mlflow.pyfunc custom model wrapping the full logic, logged as one artifact C. Two separate services D. A README

Answer **Correct: B** **Why:** Packaging preprocessing with the model means every caller gets identical behavior and there is one thing to version. Asking callers to reimplement transformation logic is how training-serving skew re-enters after you removed it from your own pipeline.

Question 7

Scenario: Feature computation is expensive and shared by several models.

A. Recompute per model B. Materialize features into feature tables on a schedule, with online tables for low-latency serving C. Compute in each notebook D. Cache in memory only

Answer **Correct: B** **Why:** Materialization amortizes the cost across consumers and gives one definition to govern. Online tables replicate the values into a low-latency store so real-time serving does not need to run the batch computation on the request path.

Question 8

Scenario: A pipeline must be promoted across dev, staging, and production workspaces.

A. Copy notebooks B. Databricks Asset Bundles or CI/CD, with environment-specific catalogs and configuration, and models registered in Unity Catalog C. Manual export D. One workspace for everything

Answer **Correct: B** **Why:** Bundles define jobs, pipelines, and models as code with per-target configuration, so the same artifact is promoted rather than reimplemented. Unity Catalog lets a model registered once be referenced from every workspace with governed access.

Question 9

Scenario: An ensemble of models must be served behind one endpoint.

A. Multiple endpoints and client-side logic B. A pyfunc model that loads the components and implements the combination logic, served as a single version C. It is not possible D. Retrain as one model

Answer **Correct: B** **Why:** Wrapping the ensemble keeps the combination logic versioned with the components, so a change to the weighting is a new model version rather than a client deployment. Client-side ensembling spreads the logic across every consumer.

Question 10

Scenario: Model explanations are required for individual predictions in production.

A. Global feature importance only B. Compute per-prediction attributions (for example SHAP) and store them alongside the prediction for later inspection C. Model documentation D. Training curves

Answer **Correct: B** **Why:** Global importance describes the model; a contested decision needs the attribution for that specific row. Computing it at inference and persisting it means the explanation is available when the question arrives months later, rather than needing a reconstruction.

Question 11

Scenario: A time-series model must be validated correctly.

A. Random k-fold B. Rolling-origin (walk-forward) validation, training on past and validating on future, respecting the forecast horizon C. Stratified split D. Leave-one-out

Answer **Correct: B** **Why:** Random folds let the model learn from the future, which yields validation numbers that cannot be reproduced in production. Walk-forward validation also gives several evaluation windows, which reveals whether performance is stable over time.

Question 12

Scenario: Training data must be versioned so a model can be rebuilt exactly.

A. Overwrite the table each run B. Delta table versions or a snapshot, with the version recorded in the MLflow run C. Note the date D. Keep the latest only

Answer **Correct: B** **Why:** Recording the Delta version number in the run makes rebuild deterministic without duplicating the data, since time travel can read that version directly. A date alone is insufficient when the table is updated multiple times a day.

Question 13

Scenario: An endpoint's latency must be reduced for a large model.

A. Add more model versions B. Right-size the compute (including GPU where appropriate), enable caching where responses repeat, and consider a distilled or quantized model C. Increase the batch size D. Reduce logging

Answer **Correct: B** **Why:** Latency work starts with measuring where the time goes: model compute, feature lookup, or queueing. Larger batches improve throughput while worsening latency, so they are the wrong lever for a p99 target.

Question 14

Scenario: Governance requires knowing which data a model was trained on and who can use it.

A. A wiki page B. Unity Catalog lineage linking the model to the tables and features it consumed, with grants controlling access to the model C. Comments in code D. File permissions

Answer **Correct: B** **Why:** Lineage is captured automatically rather than documented manually, which is why it stays accurate. Governing the model in the same catalog as the data means one permission model covers both, which is what an audit is actually asking for.

Question 15

Scenario: A model exhibits degraded performance for one customer segment.

A. Report only aggregate accuracy B. Evaluate disaggregated performance by segment, investigate representation and feature quality for that group, and document known limitations C. Increase the model size D. Remove the segment

Answer **Correct: B** **Why:** Aggregate metrics average away subgroup failures, so they must be broken out to be seen at all. Removing the segment from evaluation makes the number look better while leaving the harm in production, which is the outcome the practice exists to prevent.

Where to go deeper