Actually, the debate is out. The medical community is 50/50 split on if there is a physical basis for chemical sensitivity or if it's a mental problem. But, ask someone with bipolar, or clinical depression if it's any less "real" because it originates in the mind.
While paint fumes are certainly worse indoors, if you're near the castle and the wind is blowing it in your face, it can certainly still be noticed. This is true for any sort of paint. (It was nauseating when they repainted the outsides of my old apartment complex for example.)
I have a very mild case of PMLE (polymorphic light eruptions) which is basically an allergy to the sun. Not many people have heard of it and the cause of it isn't known, but it's certainly a real condition. (If you watch Extreme Home Makeover, a girl last season had a much more severe case of it.) And while no, it's not directly related to chemical sensitivities, I mention it to illustrate that sensitivities are extremely diverse and can come in many forms. I haven't been around while they were painting, so I'm not personally saying I was bothered by it (I could be, I could not, I wouldn't know until I was there) but
some people might be. That's the entirity of my argument. It could most certainly be disruptive to some people and aggravate medical problems they have.
Consider yourself lucky if you've never considered something like paint fumes to be a source of medical worry. Or sunlight. Or a specific food item. Sadly, some people
do have these concerns and it's a fact of life for them.
-m