Yang Jiabo couldn't tell the adults himself because that would make others think he was also a victim and look at him with colored glasses. He originally planned to wait for the perverted gardener to "commit a crime" and then lead people to expose him, however the victimized child would probably be affected.
[戴有色眼镜 dài yǒu sè yǎn jìng : lit. to wear colored glasses; fig. to have a prejudiced viewpoint]
Yang Jiabo never considered telling the adults in his family about this. He was just a little kid and didn't want to draw attention to himself. He didn't know what a pervert like him would do if he provoked. He couldn't think of any good solution for a moment, and he was worried about it for the next few days.