This is part of the d-i modification to improve the LTSP installation. The apt
cache is cleaned up anyway at the very end of the installation.