Remove (legacy) build info from build manifest

The build manifest currently includes a flat dictionary with some information about the build. This was meant to be temporary, as it is not schema checked or otherwise handled.

All the information are already included, as labels and annotations.