How can I get :Destroy() to delete the tool while equipping it?

I am making a tool that is raw beef and I was gonna make it so after a certain amount of bites, the tool gets destroyed. I am destroying on the server, and I did connect with remotes. The tool does get destroyed, but after I unequip the tool

--Client
wait()
local yes = false
local tool = script.Parent
local bites = 0
local foodHandler = game:GetService('ReplicatedStorage'):WaitForChild('foodHandler')
local foodItem = tool.Name

tool.Activated:Connect(function()
	if not yes then
		yes = true
		eatAnim:Play()
		bites = bites + 1
		print(bites)
		wait(3)
		if bites == 3 then
			foodHandler:FireServer(foodItem) 
		end
		yes = false
	end
end)

--Server

local foodHandler = game:GetService('ReplicatedStorage'):WaitForChild('foodHandler')

local function removeFood(player, foodItem)
	player.Backpack:WaitForChild(foodItem):Destroy()
end
foodHandler.OnServerEvent:Connect(removeFood)

everything else in the script works. If you can help me then tysm!