How do I connect to bricks where both are unanchored, and one is not cancollide?

So the ball has to be able to role through people, but follow gravity. So I figured the best way to do this was make one part cancollide and the other not, unanchor both and weld them together. Does work though, they just fall apart. Advice? Solutions?