How do I reduce reflection on bricks?

How do I remove or reduce reflections on a brick?

I am making a game and I want to remove the reflection but I cant figure out how to. I've tried messing around with the lighting and brick properties but I can't figure out how to. Also I don't want to change the material.

Here is the issue: https://media.giphy.com/media/jsy1nM60NXqyhOT3yx/giphy.gif