I have found that using random objects works much better than the actaul soap mold I have. It came with a MP kit and even with that it was hard to get out. I used CP once in it and thought I was going to have to break it to get the soap out. The PVC pipe was easier, silicone baking/ice molds are amazing! The stuff just pops right out of them! I haven't done wood yet but probably will in the next couple weeks.
As for the batch you are dealing with right now. Freeze it and then try to pop it out like you would an ice cube tray... gently flex the mold if possible (careful not to break it, would it matter that much if you did if it's going to be such a nightmare to use?!

) I also had some luck banging the frozen mold on the counter.
Good luck!