Swarm definitely loses the Distraction ability regardless - Dustform explicitly removes all special attacks, which distraction is.
The problem is whether Dustform keeps subtypes - if it did, it would be the first construct template that did so (I went and checked all the others listed in Bhu's handbook, and the sample creatures don't have subtypes, even though they should). If it doesn't, you get some very strange creatures. If it does, you end up with some construct swarms.
Edit: Summon Desert Ally V is up. Absolute crap. Like normal