Having lots of patches modifying the one cmake file seems to only introduce fuzzing issues.

This patch still needs to prevent cmake from using git and downloading anything, however rectify what is available for patching or should use a packaged lib.