Workers must be present in all types of building site.
Even if you are allowed to build an outbuilding in your jurisdiction sometimes there are utility easements on the player do not want you set a permanent structure in. In order to keep hydrated have a water bottle at your desk.