Forgive me if I missed some sort of joke but you can do exactly that. Don't need the hevc decoder? disable it. Only need the hevc decoder? disable everything and enable only it.

That is a compile time option but if you're not using the system ffmpeg libs then I guess you'd be compiling it anyway.