Vexera - Notice history

All systems operational

Website - Operational

100.0% uptime
Dec 2021 · 100.0%Jan 2022 · 100.0%Feb · 100.0%

Previous page

Next page

Dec 2021
Jan 2022
Feb 2022

Notice history

View current status

Feb 2022

High latency
ResolvedMajor outage2 hours 22 minutes
  • ResolvedUTC

    Everything is back to normal for all servers. The issue that triggered this incident is know since some time, and work is in progress to fix it.

    Sorry for the inconvenience 😦

  • UpdateUTC

    As the underlying issue got quickly out of control, we are going to do a cold restart of Vexera to recover. Vexera will slowly become available in servers again. The whole operation can take up to 1 hour.

  • InvestigatingUTC

    Vexera is currently handling commands with very high latency (30+ seconds). We are investigating.

Jan 2022

Vexera unresponsive
ResolvedMajor outage3 hours 43 minutes
  • ResolvedUTC

    Vexera is back up!

  • IdentifiedUTC

    Vexera is starting back up. Vexera Pro is back up & has been for around 15 minutes.

    We will provide update when Vexera is completely back up.

  • InvestigatingUTC

    Vexera is currently unresponsive and shows as offline in all servers. Both Vexera and Vexera Pro are affected by this.

    We're looking into the issue and will send out updates as they become available. Thank you for your patience!

Vexera unresponsive
ResolvedMajor outage3 hours
  • ResolvedUTC

    Vexera is back up everywhere 🙂

  • UpdateUTC

    Vexera is restarting, it will be online again in your guild within 15-30 minutes.

  • IdentifiedUTC

    Due to a database issue, Vexera is currently unresponsive. We're resolving this now and Vexera will be back up soon.

High latency
ResolvedDegraded performance2 hours 57 minutes
  • ResolvedUTC

    During the last 3 hours, Vexera experienced again the same issue than 3 days ago.

    The probable cause of these issues is a contexts leak in an internal service that causes slowness after a few days of operations and ultimately a backlogging of Discord events when encountering our daily peak hours around 17:00 UTC.

    We will implement scheduled restarts of the affected service to mitigate the issue until we can identify and fix the cause of these leaks.

    Sorry for the inconvenience

  • InvestigatingUTC

    We are currently investigating a high bot latency.

High latency/Errors when executing commands
ResolvedDegraded performance53 minutes
  • ResolvedUTC
  • MonitoringUTC

    Vexera experienced issues during the last hour which have lead to delayed responses and Internal Server Error messages (mainly with music related commands).

    In an attempt to remediate the issue, we have restarted the voice manager (our internal service controlling the voice encoders). This may have disconnected Vexera from voice channels.

    We believe the issue is now fixed, and our error rate is back to normal levels since 15 minutes. However, we are still monitoring the situation, because the root cause of the issue is still unknown.

  • InvestigatingUTC

    Vexera may respond with a delay. We are investigating the issue.

Vexera unresponsive in some servers
ResolvedMinor outage46 minutes
  • ResolvedUTC

    The issue is now resolved.

  • MonitoringUTC

    Vexera should have recovered in all servers. We are monitoring our error rate.

  • IdentifiedUTC

    We are aware that Vexera is unresponsive on some servers. We are currently taking remediation steps to resolve this issue.

Dec 2021

DEC28
Planned maintenance
CompletedMaintenance2 hours
  • CompletedDecember 28th, 2021 at 13:00UTC

    Maintenance has completed successfully.

  • In progressDecember 28th, 2021 at 12:42UTC

    We took this opportunity to upgrade the infrastructure behind Vexera. We have completed the infrastructure upgrades, and our hosting provider has completed their maintenance.

    We will be starting Vexera back up in the next 15 minutes or so. Vexera will be back online in your server in under an hour.

  • PlannedDecember 28th, 2021 at 11:00UTC

    Our hosting provider has planned a maintenance starting today at 11:00 UTC, to reboot a network equipment that have issues.

    During this maintenance, Vexera may go temporarily offline. If that happens, this shouldn't take longer than 1 hour.

Vexera unresponsive in some servers
ResolvedMinor outage1 hour 51 minutes
  • ResolvedUTC

    The issue should now be resolved.

  • IdentifiedUTC

    We are aware that Vexera is currently unresponsive in some servers, following an issue with a few shards (logical processes handling a subset of servers).

    We are currently restarting affected shards.

Previous

Dec 2021 to Feb 2022

Next