gpg key for ssh authentication windows

I would like to use my gpg key for ssh authentication. I already know how to create a gpg subkey for authentication, but that’s all. I have no idea, how to tell putty or git4windows bash (-> ssh command) to use the key. And I have no idea, how to replace password authentication with ssh key authentication on the remote server.

I’ve already googled a bit and found some tutorials, but all of them were for linux and I didn’t manage to do all that on windows. I’m looking forward to your help, thanks in advance!