Not sure if the spelling is right.

Lets say for instance a ton of the fans from a given team all brough whistles, and blew them at strategic times during plays. As a ref would you have any trouble down near the goal line or side lines knowing if another ref possibly blew the whistle, if you are across the field? Perhaps Being on the opposite side and you got a Lineman or even receiver blocking you think that whistle you heard was from another ref... and throw a flag cause someone is blocking after what you think was another ref's whistle... I imagine that flag would get waved off, but if the play ends seconds later the other refs woudln't know when "what you saw" happen happened. Since no instant replay or what have you.. how would this situation be handled? Flag waved off? if so how can you be sure with all this whistle blowing of all the fans?