In trying to tackle all three quests at once, you've alerted every faction to your presence. The ogres strengthen their defenses, the spellbook is moved to an unknown location, and the time travel mainframe is put under heavy guard. Sometimes, a focused approach is better...