I aam trying to make a delete script for my placement systmem, but it's not deleting. Not sure why?

Here is the client side:

local runService = game:GetService("RunService")

local player = game.Players.LocalPlayer
local mouse = player:GetMouse()
local DeleteRE = game.ReplicatedStorage.remotes.Delete
local button = script.Parent.Parent

local obj

local Isdelete = false

script.Parent.MouseButton1Click:Connect(function()
	if Isdelete then
		Isdelete = false
		button.ImageColor3 = Color3.new(255,0,0)
	else
		Isdelete = true
		button.ImageColor3 = Color3.new(0,255,0)
	end
end)

mouse.Button1Down:Connect(function()
	if obj and mouse.Target == obj then
		DeleteRE:FireServer(obj.Parent)
	end
end)

runService.RenderStepped:Connect(function()
	if Isdelete then
		if mouse.Target then
			if mouse.Target.Name == "Primary" then
				obj = mouse.Target
			end
		end
	else
		obj = nil
	end
end)

And here is Sever side:

local DeleteRE = game.ReplicatedStorage.remotes.Delete

DeleteRE.OnServerEvent:Connect(function(plr, obj)
	obj:Destroy()
end)

Not deleting though. The object does have a primary part names "Primary", which is anchored, and no errors are coming through. Why is this happening?

Edit: The script works if i try to delete things that are loaded from the save script. But as soon as i place a new object down, it prevents me from deleting anything.