You will always have as many bristle worms as needed to clean up excess food. If you feed too much then you will have lots of worms.
They are great detrivores and as far as i'm concerned a necessary part of any clean up crew.
*edit* I hope that algae isn't the same as this stuff

you may regret having it in the display tank