How do I set a players spawn by there team color?

I tried using a spawn location and setting the team color to that of the team and it works 1 out of 2 times, I have a button at the beginning that changes the team and loads character does that have something to do with it? Here is the script for the button.

--Button script in GUI
local Frame = script.Parent:WaitForChild("Frame")
local RemoteEvent = game.ReplicatedStorage.Events.ChangeTeam
local VikingColor = "Dark orange"
local ScandinavianColor = "Electric blue"

script.Parent:WaitForChild("TeamChnage").MouseButton1Click:Connect(function()
    Frame.Visible = not Frame.Visible
end)

Frame.Viking.MouseButton1Click:Connect(function()
    RemoteEvent:FireServer(BrickColor.new(VikingColor))
end)

Frame.Scandinavian.MouseButton1Click:Connect(function()
    RemoteEvent:FireServer(BrickColor.new(ScandinavianColor))
end)

--Remote Event script in ServerScripts
game.ReplicatedStorage.Events.ChangeTeam.OnServerEvent:Connect(function(player, teamcolor)
    player.TeamColor = teamcolor
    wait(0.5)
    player:LoadCharacter()
    wait(0.5)
end)