When you enable the Manage Webhooks section in the Github configuration, the webhooks created with Organization Folders do not include PR support. To enable you need to manually go to the organization and enable PRs in the webhook configuration. Github Org Folders should enable it when creating the webhook by default.