How would I make a melee weapon in VR?

I've been trying to learn how to make a simple VR game and so far I've gotten spheres to stay where my hands are (Its a little choppy but it will do for now). After doing this I decided I wanted to make a baseball bat that I could hit stuff with. I had two ideas for this, I could either weld it to the hands or I could add attachments, AlignOrientations, and AlignPositions. After trying the attachments I realized that there was far too much latency for the purpose that I had in mind. This left my only option as welding. This method started off promising, there was no difference in where the bat should be and where it was. The problem now was that the bat would no longer fire touched events and would go through solid objects. I'm now out of ideas and I was wondering if anyone has a suggestion for how I could do this. I'm not expecting any code, just an idea to work off of.