Incidents | Karta Incidents reported on status page for Karta https://status.karta.sh/ https://d1lppblt9t2x15.cloudfront.net/logos/3c8bd8140e58f22aa3abcceef54063c5.png Incidents | Karta https://status.karta.sh/ en karta.sh and console unavailable for 15 minutes https://status.karta.sh/incident/993042 Sun, 02 Aug 2026 22:52:16 -0000 https://status.karta.sh/incident/993042#3e3801a71f458b86ad8986437e0df69b9ef91f45ff563a8d7daf564356355886 Resolved as of 22:39 UTC. karta.sh and the console are serving normally. We are adding image retention limits and a low-disk alarm to prevent a recurrence. karta.sh and console unavailable for 15 minutes https://status.karta.sh/incident/993042 Sun, 02 Aug 2026 22:51:57 -0000 https://status.karta.sh/incident/993042#0e2b4b50708c886772f69e487f2193a41844993d6c625f6a2535d310c2af5b31 Between 22:24 and 22:39 UTC on 2 August, karta.sh and the control plane console returned 502 errors. The host disk filled up, which prevented the database from starting. Container images from previous deploys had accumulated on the host and were not being cleaned up. We reclaimed the disk space and the database restarted cleanly with no data loss. Service was restored at 22:39 UTC. Agent sessions on the data plane were not affected. karta.sh recovered https://status.karta.sh/ Sun, 02 Aug 2026 22:39:00 +0000 https://status.karta.sh/#d3a7a6d73d9fc84c5748326c5b93900758a30368a5e970c95b067f21fad21a18 karta.sh recovered Control plane recovered https://status.karta.sh/ Sun, 02 Aug 2026 22:38:04 +0000 https://status.karta.sh/#8b4c7317f790b4cf43d67be2ac3ad3aca55afde3f20b62619609697c8f940078 Control plane recovered karta.sh went down https://status.karta.sh/ Sun, 02 Aug 2026 22:26:55 +0000 https://status.karta.sh/#d3a7a6d73d9fc84c5748326c5b93900758a30368a5e970c95b067f21fad21a18 karta.sh went down Control plane went down https://status.karta.sh/ Sun, 02 Aug 2026 22:26:42 +0000 https://status.karta.sh/#8b4c7317f790b4cf43d67be2ac3ad3aca55afde3f20b62619609697c8f940078 Control plane went down Data plane / API recovered https://status.karta.sh/ Sun, 26 Jul 2026 01:17:01 +0000 https://status.karta.sh/#7cbeab1260b26a8473430a3ce2575473507bc35b1b6c89e6d5b5b046694dcbd1 Data plane / API recovered Data plane / API went down https://status.karta.sh/ Sun, 26 Jul 2026 00:52:04 +0000 https://status.karta.sh/#7cbeab1260b26a8473430a3ce2575473507bc35b1b6c89e6d5b5b046694dcbd1 Data plane / API went down Scheduled maintenance: session database memory upgrade https://status.karta.sh/incident/977903 Sat, 25 Jul 2026 16:57:00 -0000 https://status.karta.sh/incident/977903#5de44f3410725371fe59f6b00d0605a78759f856ba22edd143feb4d1a1e5f7e6 Maintenance completed Data plane / API recovered https://status.karta.sh/ Sat, 25 Jul 2026 16:53:02 +0000 https://status.karta.sh/#00565a8ff716635538fe47beed497d2f642619a8b21c6c744bb370e89b8a405f Data plane / API recovered Data plane / API went down https://status.karta.sh/ Sat, 25 Jul 2026 16:48:27 +0000 https://status.karta.sh/#00565a8ff716635538fe47beed497d2f642619a8b21c6c744bb370e89b8a405f Data plane / API went down Scheduled maintenance: session database memory upgrade https://status.karta.sh/incident/977903 Sat, 25 Jul 2026 16:46:00 -0000 https://status.karta.sh/incident/977903#0ee9e727f3698a09fa5c763999cba54510875b77530b5948e493b2271e6c74b2 We are doubling the memory on the database that backs agent sessions, following the outage on 23 July. The database restarts as part of the change. Requests to api.karta.sh that need session data will fail for up to 10 minutes during the window. karta.sh and the control plane are unaffected. Session database outage affected the agent API https://status.karta.sh/incident/977899 Thu, 23 Jul 2026 07:35:00 -0000 https://status.karta.sh/incident/977899#7a42681e973a5b14f3cf72ea3b7cd7b0b7c56d4ebe79804a3a1956e79707346d Resolved. The database completed its restart and the API recovered. Session database outage affected the agent API https://status.karta.sh/incident/977899 Thu, 23 Jul 2026 07:35:00 -0000 https://status.karta.sh/incident/977899#5beb5b9ea458f59f69c62b83914443f2ea2fdb590ac0c1be2cce7018fc4f6d41 Between 07:18 and 07:35 UTC on 23 July, the database that stores agent session state ran out of memory and was restarted automatically. Requests to api.karta.sh that needed session data failed or timed out during that window. karta.sh and the control plane were unaffected. A change deployed at 05:12 UTC caused a background usage-accounting job to replay 24 hours of records on every five-minute cycle. That load drained the database's memory over roughly two hours until it restarted. A fix that bounds the job landed the same day. We have since added memory, CPU credit, and storage alarms on that database, and the API readiness check now verifies it can reach the session store, so this kind of failure surfaces directly instead of appearing as a brief unexplained timeout. Data plane / API recovered https://status.karta.sh/ Thu, 23 Jul 2026 07:22:56 +0000 https://status.karta.sh/#f5e11d6df37bec0f09a67b5e5d2235084d6a11e6d220db148756d8f34b604963 Data plane / API recovered Data plane / API went down https://status.karta.sh/ Thu, 23 Jul 2026 07:21:30 +0000 https://status.karta.sh/#f5e11d6df37bec0f09a67b5e5d2235084d6a11e6d220db148756d8f34b604963 Data plane / API went down