For me it is a simple matter of biology.
As long as we continue to ignore the Australian system of utilising 2 referees it will be of paramount importance that the referee is able to keep up with the run of play.
Whilst I have no doubts that female referees can learn and interpret the rules equally as well as males the truth is that they generally cannot run as fast.
Ideally we need referees who are as good an athlete as the players but I recognise that that is highly unlikely. Using female referees is only going to make matters worse as they are even more unlikely to keep up with play.
And no, I am not a misogynist.