A puffer's natural diet consists of crabs and invertebrates, so I'm pretty sure he will be okay.
Go the the grocery store and buy some squid (calamari). They might even have it at your LFS, but it would be more expensive. Also try silversides from the LFS.