Problem with remoteEvent (I think)?

Hi! I'm making a game where you are a ball and you can move around and stuff. I'm trying to make it work server side so people can see each other. I've come to a problem where I can move on roblox studio but not on servers. Am I doing something wrong. Am I firing the remoteEvent to fast? Here's a part of my code that sends information to my serverscript

--//LOCAL SCRIPT LOCATED IN THE STARTERPLAYERSCRIPTS//--
while wait(0.05) do
	if A and D and W and S then
		ControlEvent:FireServer(Vector3.new(0, 0, 0))
	elseif A and D and W then
		ControlEvent:FireServer(camera.CFrame.RightVector*-speed)
	elseif D and W and S then
		ControlEvent:FireServer(camera.CFrame.LookVector*speed)
	elseif W and S and A then
		ControlEvent:FireServer(camera.CFrame.LookVector*-speed)
	elseif S and A and D then
		ControlEvent:FireServer(camera.CFrame.RightVector*speed)
	elseif A and D then
		ControlEvent:FireServer((camera.CFrame.LookVector*-speed)+(camera.CFrame.LookVector*speed))
	elseif D and W then
		ControlEvent:FireServer((camera.CFrame.LookVector*speed)+(camera.CFrame.RightVector*-speed))
	elseif W and S then
		ControlEvent:FireServer((camera.CFrame.RightVector*-speed)+(camera.CFrame.RightVector*speed))
	elseif S and A then
		ControlEvent:FireServer((camera.CFrame.RightVector*speed)+(camera.CFrame.LookVector*-speed))
	elseif A and W then
		ControlEvent:FireServer((camera.CFrame.LookVector*-speed)+(camera.CFrame.RightVector*-speed))
	elseif D and S then
		ControlEvent:FireServer((camera.CFrame.RightVector*speed)+(camera.CFrame.LookVector*speed))
	elseif A then
		ControlEvent:FireServer(camera.CFrame.LookVector*-speed)
	elseif D then
		ControlEvent:FireServer(camera.CFrame.LookVector*speed)
	elseif W then
		ControlEvent:FireServer(camera.CFrame.RightVector*-speed)
	elseif S then
		ControlEvent:FireServer(camera.CFrame.RightVector*speed)
	else
		ControlEvent:FireServer(Vector3.new(0, 0, 0))
	end
end

--//SCRIPT LOCATED IN SERVERSCRIPTSERVICE//--
function Controller(player, velocity)
	game.Workspace:FindFirstChild("Ball".. player.Name).Ball.BodyAngularVelocity.AngularVelocity = velocity
end

If I put more wait on the wait it will be input delay, so I don't wanna do that. If you want me to post the hole script. Let me know in the comments. This started happening when I did this, so this may be the problem...

--//LOCAL SCRIPT LOCATED IN THE STARTERGUI//--

local StarterGui = game:GetService("StarterGui")

while not success do
	success = pcall(function()
		StarterGui:SetCore("TopbarEnabled", false)
		StarterGui:SetCore("ResetButtonCallback", false)
	end)
	if success then
		break
	end
	wait(.2)
end