If you go from, say, Munich towards the East or from Warshaw to the South, you'll find a continuity of on average ever darker skins. Locally, everywhere, you will find most of the population considering themselves "white", Gypsies "brown"; and you'll find at least a significant minority who considers the neighbour to the East/South "brown". (Of course, when these people move to the West/North, they are in for a surprise.)
To be considered "brown", apparently clothing suffices. This is something sociologists studying Gypsies emphasize; and something I can confirm from personal experience by again citing that I was taken for a Turk (considered "brown" by most West Europeans) when fresh in West Germany. *Lunatic*, n. One whose delusions are out of fashion.