I can't say for sure but maybe if your clown had a mate he wouldn't be bothered by the Chromis'.
I had a pair in which the smaller male jumped out the the tank and died and the remaining female was more agressive towards the remaining fish. I went out and bought a new one (always add a much smaller clown if you decide to do so) and the harassing ended
