OG settings
In the screenshot, the "directory" refers to the list of all groups on the site. Excluding a group from the directory makes it more difficult to find. Excluding the group from the directory and making membership in the group invite-only effectively creates a fully private area within the site.
The "Registration Form" settings allow a site admin or group creator to control whether a new user has the ability to join the group as they join the site.