They can be flush. In fact this is typically assumed because of tolerances of groove depth vs o-ring size,  which produces interference that must be within the allowable range of squeeze % for the o-ring material and application. The groove has excess width that provides empty volume into which the o-ring material displaced by the interference can go. See Parker O-ring Handbook (free pdf) for a pretty good reference text, and standard groove sizing tables.