It's a completely optional cost, though, not a hidden cost. Plus it sounds like they allowed everyone to bring their partners and families, too. And, most companies that have physical offices also have corporate retreats or events, so it's not even really exclusive to companies that work remotely.
But they were never renting office space for their entire staff. If you really wanted to compare apples to apples (i.e., "Should everyone have an office payed for by the company" or "Should we have an annual retreat for the whole company"), a bit more analysis is needed.