As long as the charge is still listed as a temporary authorization or as pending, you do not need to worry. This is simply a temporary hold that occurs when a payment vendor checks to make sure your account has the necessary funds to deposit. If the deposit fails after this check, the pending charge will remain for a short period of time.
This happens frequently, so it is not a cause for concern. The charges are resolved automatically, usually within 3 business days. If you do not wish to wait, you should call your issuer and let them know the deposit was declined so the temporary charge should be dropped.