Jesus Christ. Alcohol does not lower testosterone by a significant amount unless you habitually drink a LOT of it.
It can raise it:
http://www.ncbi.nlm.nih.gov/pubmed/12711931
It can stay the same:
http://www.ncbi.nlm.nih.gov/pubmed/10642377
It can lower it slightly: (OMG 6.8%!!!)
http://www.ncbi.nlm.nih.gov/pubmed/15166654
It can lower it by even more:
http://www.ncbi.nlm.nih.gov/pubmed/2128439
But all of these effects are transient. It's just not that big of a deal. Soy can be far more estrogenic.