There is zero reason a leader needs to be in the office all day. If that's the case then the leader has poor time management skills or is being overtaxed.
You can't lead a team effectively without some type of leadership bond or buy in, and you can't garner that from an office.
During my most managerially tasking time (manage remodel, flow, backroom and instocks process, write schedule for the store minus front end, plan transitions) I spent one 8 hour day in the office, and spread the rest over the week in 30 minute blocks.
This has maybe changed, but a huge majority of target leaders whom I worked with never even used a calendar to track daily time. The company in general had poor time management practices.