Ambient environmental stimuli may impact how a student is or is not able to apply themselves in cognitive and educational tasks. For neurodivergent learners, these barriers can be compounded as they may be more likely to attend to task-irrelevant ambient noise. The affordances of new systems, such as virtual reality (VR), could be useful for allowing neurodivergent students more deliberate control over what information they experience and what information they do not. This study seeks to explore the dynamics of attention in VR environments. To address this, participants were asked to perform a number of visual search tasks in VR to assess the impact of both visual and auditory distractions on speed and accuracy markers. Results indicate a differential impact of background noise on the performance of neurotypical and neurodivergent participants. Potential benefits to neurodiverse populations and design recommendations in this emerging space are discussed.