It's best to keep it running 24/7, bdubbya is right in saying that the waste can build up.. Along with taking out harmful wastes and excess nutrients.. Skimmers oxygenate the water well, turning it off wouldn't be fatal, but it would definetly make your inhabitants feel better with it on!
Cheers,
Elvis