Key Vault: Invalid credentials when setting up integration

When trying to set up an integration with Key Vault (Azure), I keep getting the message: “Unable to authenticate with Azure. Please check your credentials and try again.”

I have permissions to Get, List, Update, Create, Import, Delete, … keys and secrets.

Any suggestions on what needs to be checked in order to set up the sync?