Xvnc plugin tries to use already allocated displays

Xvnc plugin creates a new allocator for each build, and forgets previously allocated ports and tries to allocate them again.