Letter from Ken Keller, the SVP/CTO of Usio
I am writing to follow up on the recent system outage that occurred on March 28. We understand that the outage may have caused inconvenience and disruption to your organization, and we apologize for any inconvenience this may have caused.

Here is a summary of the outage and what we have done to address the issue:

• The outage occurred at 12:36 PM CT on 3/28/2023
• Our technical team was immediately alerted and began working to resolve the issue.

• The system was down for approximately 6 hours, during which time we worked to identify and address the outage:

  • We identified our internal firewall configuration experienced an automated failover after a faulty deployment release
  • This failover triggered an unexpected change in IP addresses, leading to mismatched routing and lack of internal service communication

• We have taken steps to ensure that similar outages do not occur in the future including:

  • Availability options for internal services
  • Strengthening deployment gates
  • Continued investigation into automated process

We recognize that downtime is a serious matter, and we take it very seriously. We would like to assure you that we are implementing enhanced steps to prevent similar issues. We are reviewing our incident response procedures to ensure that we are better prepared for any future outages. We will continue to monitor our systems closely and take proactive steps to ensure that our services remain secure and reliable.

Thank you for your continued support.

Sincerely,
Ken Keller SVP, CTO Usio, Inc.