The time varies a bit, but for scheduled outage purposes, you should allow about 1 hour for each upgrade (so in your case a 2 hour window). Chances are it will complete early.
And yes, the ZoneDirector will automatically upgrade each managed AP to the same version (that's part of why the time varies)