It does appear to be aggression. What type of damsels do you have? Also, what is your tank size? I have also seen this occur not from other fish, but from the fish itself darting around rock while evading more aggressive fish types.
Thanks guys. That makes me feel a little better. I have two yellow belly damsels that are only about 1.5-2.0 inches long. I haven't seen any sign of aggression other than my cleaner shrimp trying to get a hold of everything that passes by. My tank is a 38 gallon.