The heavy metals used in batteries and solar panels are also very toxic [1]. Only reason we don't talk about them is because they can be offshored since they can't be weaponized.
Batteries: huge recycling projects ( such as https://northvolt.com/ ) are moving forward and the market is ready: in many industrial nations battery-equipped vehicles and buildings are already recycled, not thrown in a trashcan.
[1] https://www.bbc.com/future/article/20150402-the-worst-place-...