Is 11.89V on the 12V rail considered too weak?

Nick, the 0.11 Volt is negligible. The 9500GT video card requires a minimum of 350W, your PSU is to small for the video cards power requirement. You did not tell us what model your BTX is. Hope this helps, good luck.