They get removed by dpkg if they are emtpy during package removal. This covers
the case when vim-ultisnips is the only installed addon in vim-addon-manager and
prevents unowned directories. (Closes: #810695)

This ensures that compiled Python byte code files are present when symlinks are
created.