I know what you mean, man. Everytime I leave the tank alone for a while, though it may look unkept, everything seems to grow super fast.
Apparently we're not the only ones thinking this. When it comes to reefs we all need to take our mother's advice "Quit poking at it!"