I have just made my first foray into the soap making world. So far so good!

I was curious though on a couple of things and can't seem to locate any information on it.
1) When does soap become too cool/hard to work with? (Rough temperature or rule of thumb is fine)
2) When to add essential/fragrance oils?
The reason I am asking is I'm going to be using rosemary essential oil which has a pretty low flash point and I'm worried that it will all disappear if the soap is still too warm (right now the soap is WAY to hot right now in terms of adding any scent that I want to stick). At the same time I don't want the soap to be too cool for me to be able to incorporate the EOs. A rough recipe is below (I know it's weird but I was trying to use up fats around my apartment). Some additional info is below in case they are important.
Rough Recipe
69% Lard
4% Virgin Coconut Oil
26% Sesame Oil
Superfatted 5%
Total Fats by weight: about 1250 g or 2.75 lb
Method: Hot processed using double boiler method
Essential oils: Lavender, Rosemary, Cedarwood
Colorant: Merlot Sparkle Mica and Liquid Black (both from BB)
Intended Use: Personal use for hair/hands/body (aka everything but laundry and dishes)
An answer will likely be too late, but I'd still like to know! Thank you.