TortoiseGit with openssh key not authenticating using ssh-agent

No tweaks needed.

Just make TortoiseGit point to the same ssh client used by git itself, see the screenshot:

This should be C:\Program Files\Git\usr\bin\ssh.exe in latest version of Git as mentioned by Aleksey Kontsevich in the comments.