In short - no, not with one of each of those devices.
The mixer has 4 aux sends*, routable to individual outputs... if you use no effects. Every effect send you need will lose one headphone mix.
So, with no effects, you could set up 4 individual headphone mixes.
Each of those mixes would need to go to its own headphone amp. The Behringer only has one input to those 4 outputs, so it cannot do individual mixes to each player.
So, at minimum, for a 4-piece band, you need 4 Behringers.
If you also want FX sends, you need a board with more sends.
*I'm ignoring that some are pre, others are post. That could be worked around.