Those machines are portable RO units. If it says Reverse Osmosis on it, it is probably OK. To be sure, as mentioned, bring a bucket home, and test it.
I have used those water machines regularly for new tanks, and for top offs, and have never had a problem.
Not familiar with Publix, but probably the same type of thing. Just test it.