Also explicitly set some dependent symbols to their defaults.
Follow the logic from d1929b0e ("net: Enable NET_SWITCHDEV; disable on armel/marvell (Closes: #949863)") as applied in 5.5.13-1 upload.
Request from inclusion from @vasudev and @tzafrir for buster.
Closes: #949863