Answered Bug Report asked by Milco

AZ-400 practice question shows the wrong answer after shuffling

The question

This question from section D3 has the wrong answer: “Diana Kowalski, Senior Release Engineer at Sterling Dynamics, needs to run automated Selenium UI tests against the staging environment between the staging and production deployment stages of the release pipeline. The staging environment is an Azure App Service accessible both via a public URL and through a VNet-integrated private endpoint. Diana needs to decide which agent type to use for running the browser-based tests based on staging environment accessibility.

Which pipeline configuration for Selenium tests between environments?” A - selenium gate B - MS hosted agents C - Self hosted agents D - A and B are correct

The correct answer should be that both B and C are correct, not A and B. Hence, option D lists the wrong answer options.

Regards, Milco

The answer

Hi Milco — thank you, this was a real bug and you nailed it. Our practice engine shuffles the answer options each attempt but was labelling them by on-screen position, while the answer text referred to fixed letters — so after a shuffle “Both A and B” no longer matched what you saw.

You’re right on the substance too: because the staging App Service is reachable both via its public URL (Microsoft-hosted agents) and via the VNet private endpoint (self-hosted agents), both agent types are valid.

Fixed the root cause — coupled questions like this one now keep a stable option order — and reworded the answer to name the agent types directly (“Both Microsoft-hosted and self-hosted agents are valid…”) instead of using letters. I also found and fixed the same class of issue on a handful of other questions and added a build check so it can’t recur.

Really appreciate the detailed report. — Sush