Do I need to have the bench off the box to do barre?

No - you can have the bench on or off the box to do barre - whatever suits you. It is preferable to position yourself on the closed side of the bench.