Why do questions appear to randomized on my test even though I didn't randomize questions?

It is likely the test is set to have randomized answers, which is less obvious.

Please try the following: Click the chevron that appears to the right of the test's title Select 'Edit the Test' Click the 'Question Settings' button on the top right Uncheck the 'Specify random order of answers' found in the 'Display' section at the bottom Click the 'Submit' button to save settings.

More about reusing questions in Blackboard tests: https://help.blackboard.com/Learn/Instructor/Tests_Pools_Surveys/Reuse_Questions