Create cache in between test runs

As a developer, I would like to have cache in between test runs. Very useful for reducing the build time.