Great song. It's one of the ones where Justin is singing from the perspective of someone with totally different views to himself. In this case, someone with dodgy, nationalistic views. I almost see it as being from the point of view of someone in the EDL or something like that. See this quote from Justin;
"It’s always been a compulsion to do the opposite of what people want or expect. We very much reserve the right to write about anything and from any point of view, including those we don’t agree with, for example My People or One Of The Chosen, written from the point of view of a nationalist or religious maniac."