Mesh scale instantly changes back to original size when I change it?

I am trying to make a hat grow bigger when the user clicks on a button but every time I make it bigger it instantly goes back to the original size.

Server Script:

script.Parent.OnServerEvent:Connect(function(player)
	local char = workspace:FindFirstChild(player.Name)
	local hat = char:FindFirstChild("StarterShag")
	local scale = hat.Handle.Mesh.Scale
	
	print(scale)
	scale = Vector3.new(scale.X+1,scale.Y+1,scale.Z+1)
	print(scale) 
end)

Local Script:

local sizeUp = workspace:WaitForChild("Remotes"):WaitForChild("SizeUp_Event")
script.Parent.MouseButton1Click:Connect(function()
	sizeUp:FireServer()
end)