I agree with a lot of what you have to say with respect to the difficulty in having a discussion of immigration in Sweden without somehow ending up being called a racist. This is stupid as there are some problems in this area and it is not helpful to any possibility of progress.
As for the Sweden Democrats they still strike me as a basically racist party that has cleaned up a bit to be more presentable. They offer an alternative to people who think and say: "I am not racist, but get those welfare sucking foreigners out of our country." I don't think that by calling them racist I implied they are of the "gas the nigger monkeys" variety. They are of the "darkies are okay, just not in our country" variety.