I'll guess that the old prefilter was clogged/dirty and was restricting the flow through the Mag5.
This reduced flow was within the flow capacity of your overflow.
Life was good.
Then by replacing the prefilter - you're allowing more water to pass through this clean filter - and this allows more water through the Mag5 - more water up the returnline to the display tank. Now you're exceeding the flowrate capacity of your overflow.
Tank level rises no matter what you do.
Life is not so good now.
It's better that you're not restricting the inlet of the Mag.
So the solution(s) to your troubles are;
Install a ball valve on the returnline, and close it some to reduce flowrate to the display tank.
Get another or larger overflow (if external ).
Get a smaller return pump ( not recommended )
Ball valve - inexpensive - much easier - life be good again
