Object not positioned at mouse when in first person?

I'm making a tool that is used off of the **Dragger **Instance and for some reason when I try to go in first person or zoomed in to a close perspective of my characters head, the object that is being dragged on the grid is placed elsewhere away from my mouse's position.

GIF: https://gyazo.com/c13e4049d407bc22e9b81390fad043b2

I took the importance of the code and pasted it here, some variables might be missing but they aren't important for understanding, the name should be enough.

Server Side

ObjectToServer.OnServerEvent:Connect(function(_, Id, ObjCF)
    local ModelPlaced = RegisteredObjects[Id]:Clone();
    ModelPlaced.PrimaryPart.CFrame = ObjCF;
    local ModelOwner = Instance.new("ObjectValue", ModelPlaced);
    ModelOwner.Value = _;
    for i,v in next, ModelPlaced:GetDescendants() do
        pcall(function()
            v.CanCollide = true;
            v.Transparency = 0;
        end)
    end
    if(objectIsInBuildingBoundary(_, ModelPlaced)) then
        ModelPlaced.Parent = getOccupiedPlate(_).StoredObjects;
    end
end)

Client Side

local CurrentPlacingModel;
local CurrentPlacingModelID;
local isPlacingObject = false;

local Connection = game:GetService("RunService").RenderStepped;
local Abs = math.abs;

function Module:SelectObject(uniqueId)
    local function Select()
        ClearPlacingObjects(Player);
        local PlayerPlate = getOccupiedPlate(Player);
        local StoredObjects = PlayerPlate.StoredObjects;
        local RegisteredItem = RegisteredItems[uniqueId];
        if(RegisteredItem) then
            CurrentPlacingModelID = uniqueId;
            isPlacingObject = true;
            local outlineObject = RegisteredItems[uniqueId]:Clone();
            outlineObject.Parent, outlineObject.Name = StoredObjects, "PlacingObject";
            outlineObject.PrimaryPart.CFrame = CFrame.new(Mouse.Hit.p);
            local pPart = outlineObject.PrimaryPart;
            for i, Object in next, outlineObject:GetDescendants() do
                pcall(function()
                    Object.Transparency = 0.5;
                end)
            end
            Dragger:MouseDown(pPart, Vector3.new(0, 0, 0), {pPart});
        end
    end
    if(uniqueId ~= CurrentPlacingModelID) then
        if(isPlacingObject) then
            updateCurrentPlacingModel(uniqueId, RegisteredItems[uniqueId]);
        else
            Select();
        end
    else
        Select();
    end
end

function PlaceObject()
    if(isPlacingObject) then
        local PlayerPlate = getOccupiedPlate(Player);
        local StoredObjects = PlayerPlate.StoredObjects;
        local FakeObject = CurrentPlacingModel:Clone();
        local ObjectCF = FakeObject.PrimaryPart.CFrame;
        FakeObject.Name, FakeObject.Parent = "Model#" .. tostring(math.random(1,1000000)), StoredObjects;
        ObjectToServer:FireServer(CurrentPlacingModelID, ObjectCF);
        Dragger:MouseUp();
        FakeObject:Destroy();
        isPlacingObject = false;
        Module:SelectObject(CurrentPlacingModelID);
    end
end

Connection:Connect(function()
    if(isPlacingObject == true) then
        CurrentPlacingModel = getOccupiedPlate(Player).StoredObjects:FindFirstChild("PlacingObject") or false;
        Mouse.TargetFilter = CurrentPlacingModel;
        Dragger:MouseMove(Mouse.UnitRay);
    end
end)

I tried setting the TargetFilter to the object being dragged but that didn't work. I feel like it has something to do with the Mouse.UnitRay but I might be wrong.

Any help would be appreciated, thanks!