Conclusions and Limitations

We have successfully configured secure web filtering proxy in Azure with client authentication using TLS certificates.

Limitations

Currently due to internal issues with Microsoft Edge and Google Chrome the certificate select dialog is presented each time you connect to a different domain. This is very annoying.

Unfortunately only Mozilla Firefox allows you to remember the chosen certificate. So it is recommended to use that browser if you decide to deploy the proxy authenticating clients by their certificates.