Some people stay busy even when they're supposedly relaxing. They go to their country house or lie on their couch, completely alone. They've pulled away from everyone, but they still worry themselves to death. We shouldn't call this leisure. Their business is just being lazy.
Some men's leisure is busy: in their country house or on their couch, in complete solitude, even though they have retired from all men's society, they still continue to worry themselves: we ought not to say that such men's life is one of leisure, but their very business is sloth.