With a federal public service of 600,000 employees, that's an average of 5 hours per employee per year. Hardly earth shattering. When looking at numbers it's a good idea to consider the context and relative scale of what you see.
The context is this - those Guv employees are not working for a corporation or business that contributes anything to the economy, the employees contribute nothing to the making of a profit but rather get paid well by fellow taxpayers, and they do not work under conditions where excellence is required - or even expected. And their employment is protected by all sorts of rules and guarantees.
So - a "union" is not needed and, due to the above noted context, government workers should not be unionized. Further, in such a sensible context, there would be zero free/paid time given to union work - and at least that 162.5 million would not be going down the drain.