Brown algae most of the time, not always, is diatoms. Does it look like a dust or thin film? Is your setup a newer setup, less then 4 months old? If so odds are it is diatoms you are referring to.
Diatoms are common in newer setups and require silicates to survive. If no more silicates are added...