Inventory keeps adding more items when I unequip a tool?

So basically I have this script that adds a tool into this table from ReplicatedStorage

{
                    ["Basic Axe"] = 1,
                    ["Wood"] = 1
                 }

and that works but whenever I equip a tool it leaves the players backpack and when I unequip it, it gets readded to the backpack making how many Basic Axes I have go up to 2 when I only ever picked up 1

{
                    ["Basic Axe"] = 2,
                    ["Wood"] = 1
                 }

and if I spam equip and unequip it, it just keeps adding up, any ideas on what to do would be very appreciated

Full code if needed:

local replicatedStorage = game:GetService("ReplicatedStorage")
local player = game.Players.LocalPlayer

wait(1)

--Count Variables
local counts = {

}

--Add all game items/resources to the counts variable
for i, child in ipairs(replicatedStorage.Inventory:GetDescendants()) do
	if child:IsA("Tool") then
		counts[child.Name] = 0
	end
end

--Check what is in player inventory
player.Backpack.ChildAdded:Connect(function()
	local inventory = player.Backpack:GetChildren()

	for i, child in ipairs(inventory) do
		if counts[child.Name] then
			counts[child.Name] = counts[child.Name] + 1
		end
	end
	print(counts)
end)

edit: I found a new problem where if I pick up 5 logs, it says I have 11 as described up before with the stuff leaving my backup, but if I equip one of those logs and unequip it then it goes from 11 logs to 16