Depends on the fish. Often size is the difference. For clowns, after they pair up, one will become larger and more dominant, this is the female. The both start life as males.
For Cardinal fish, I have heard the mouth is a little larger, and sqaurer, as the male keeps the eggs in there for safe keeping.