Right, isoflavonoids can bind estrogen receptors. The affinity and activity is different than estrogen though.
As far as I am aware there is no definitive research to show that its actually bad for you, and in East Asian populations that consume a lot of it there is no evidence of detrimental health effects.