ADFS Extranet Smart Lockout - Users cannot be unlocked with powershell

We are using ADFS on Windows Server 2019. External login to O365 will authenticate via this ADFS server instead of Azure AD.

Recently we have been trying on the Extranet Smart Lockout feature.
In order to see how it would work, we have set the lockout mode to enforce.

set the ExtranetLockoutMode to <ADFSSmartLockoutEnforce>  

Things seems to work as expected, except for one issue - when a user got locked, we cannot unlock the account via powershell.
Here's the scenario.

1. We intentionally logging in an account with false password to trigger a lockout.

   PS C:\Users\administrator.contoso> Get-AdfsAccountActivity -Identity ******@contoso.com  
   
   
   Identifier             : contoso\Extest01  
   BadPwdCountFamiliar    : 6  
   BadPwdCountUnknown     : 0  
   LastFailedAuthFamiliar : 12/5/2020 5:18:11 PM  
   LastFailedAuthUnknown  : 12/5/2020 4:51:56 PM  
   FamiliarLockout        : True  
   UnknownLockout         : False  
   FamiliarIps            : {202.xxx.xxx.109}  
   

2. Then we try to unlock it by the following script. (As it is a FamiliarLockout, we added the parameter -Location Familiar)

   PS C:\Users\administrator.contoso> Reset-AdfsAccountLockout ******@contoso.com -Location Familiar  
   

3. It is verified that the account has been unlocked using powershell.

   PS C:\Users\administrator.contoso> Get-AdfsAccountActivity -Identity ******@contoso.com  
   
   
   Identifier             : contoso\Extest01  
   BadPwdCountFamiliar    : 0  
   BadPwdCountUnknown     : 0  
   LastFailedAuthFamiliar : 12/5/2020 5:18:11 PM  
   LastFailedAuthUnknown  : 12/5/2020 4:51:56 PM  
   FamiliarLockout        : False  
   UnknownLockout         : False  
   FamiliarIps            : {202.xxx.xxx.109}  
   

4. However, we try logging in again with the correct password, it is still not able to login.
5. We also tried logging from internal network, it worked. So the account is not locked in AD.

Please help to see if there is anything missing here. Thanks in advanced.

Additional information.
We have set the ESL via the following powershell:

    Set-AdfsProperties -EnableExtranetLockout $true -ExtranetLockoutThreshold 3 -ExtranetObservationWindow (new-timespan -Minutes 10) -ExtranetLockoutRequirePDC $false