What level is the group?
If you don't stop it from teleporting, you have to take it out in a single round before it acts. You already mentioned the poison immunity part (heck, Delay Poison can work for the battle, even).
Heck, two 6th level pounce chargers each with potions of Delay Poison could probably take him out on the first round.