Why does my click detector not work properly?

So I've placed a click detector inside a part, but whenever I hover over the part from certain angles, my cursor keeps alternating between the select cursor and the click cursor very fast. There are angles that do work and only display the click cursor as supposed to but if I move the camera to the right or left, it seems to break the detector again. I've set the click detector range to about 500 to allow it to work with the way I've set up the fixed camera so is the error to do with the range or something else?