The border between Federation (left) and non-Federation space (right)
Non-Federation space was any location in space that was not under Federation control and Starfleet jurisdiction. (SNW: "The Serene Squall", "All Those Who Wander")
The Ryton system was considered to be outside of Federation space. (PIC: "The Next Generation", "Disengage")