Do you feed nori? Some of my dwarf angels, including two potters, will pick at nori continually if it's available so that might distract him. Though if he isn't used to it, it may take a while for him to eat it at first. Also, make sure you feed often and enough. Other than that I don't know how you would discourage the behavior. These guys are natural pickers so it is kind of just something that they do.
Potters do tend to be reserved, so I think it is pretty normal for more aggressive and established fish to be higher in the pecking order and chase him off of food, even with little effort. As long as he stays healthy and not too thin, I wouldn't worry about it.