Water changes will help.
In the future sou should avoid trying to artificially bump up PH. PH is not a level, it's an indicator. If PH is low or high it indicates a problem. You need to fix the problem not add chemicals to change the PH.
That's like trying to use white-out to fix a typo on the bulletin board. It doesn't fix the problem, it just makes it invisible.