Fix modal overflow style nesting (#26742)

Created by: jdanil

Nest .modal styling directly under .modal-open to avoid issues when bootstrap is nested.

Fixes #26742 (closed).