@matigo for what it's worth, my own noise tolerance has changed over the years. Used to be able to do certain tasks with music or podcasts in the background, can't anymore. It's mostly about the cognitive load of my brain.
Also, probably as a function of Aspergers, I have a hard time conversing in environments where there are lots of voices and I can distinguish them. I often have trouble processing the one voice I'm trying to understand.