You must create validated event for the component, example:
Private Sub myTextBox_Validated(ByVal sender As System.Object, ByVal e As System.EventArgs) Handles myTextBox.Validated
'Clear de erroProvider
ErrorProvider.SetError(myTextBox, "")
End Sub
------------------------------
See you.