Really up to you and how the panel is to be fixed? I always build in a box as it protects the wires and anything else. But if the panel was to be screwed into the frame of the layout then perhaps no backing is needed.
Inside of another panel before wiring starts
Front of the above