There was a minimal Method of Procedure misstep in our EMV service when releasing database enhancements. We recognized the situation quickly when it began, isolated the cause and performed a rollback. This did result in a small number of transactions left in an incomplete authorized state in our system, we have pinpointed these and any effects will be automatically cleaned out.
We have identified a few procedure improvements to help assist to lesson this type of scenario in the future. The problem was not caused by our systems or any infrastructure concerns, but as a result of oversight by people working on complicated systems.
The next day we were able to release our EMV service database enhancements with a non-disruptive Method of Procedure.