# Abacus Operations

# Overview

This document is meant to be the go-to place for all things related to Abacus operations. 

## Support Rotation (Business Hours only)

Weekly Rotation, ends every Wednesday at 10:00am ET. After standup on Wednesday, a hand-off document is filled by the person who just completed their shift.
[Oncall Handoff Log](./oncall-handoff.md)

1. [new hire]
2. Aarti
3. Diego
4. Jonathan
5. Michael
6. Serhii
7. Xavier

## Abacus Run On-Call Rotation (DataDog 24/7 paging)

This on-call only happens for 1 week before the run, including the day of the run.

1. Diego
2. Jonathan
3. Michael
4. [new hire]

George will be as a secondary on-call during each run.

# Key Resources

* [Oncall Handoff Log](./oncall-handoff.md)
* [Support Board](https://theorchard.atlassian.net/jira/software/c/projects/ACC/boards/1021) [filter](https://theorchard.atlassian.net/issues/?filter=23908)
* [Support Slack Channel](https://sonymusic.enterprise.slack.com/archives/C041MDL16UT)

## Incident Resources

## 1. Incident Management

* Who is on call? [DataDog On-Call](https://sonymusic-pde.datadoghq.com/on-call/schedules?query=team%3Aabacus)
* [Declare Incident NOW](https://sonymusic-pde.datadoghq.com/incidents/new?query=teams%3Aabacus)
* [DataDog Incidents List](https://sonymusic-pde.datadoghq.com/incidents?query=teams%3Aabacus)

## 2. Technical
* [Pipelines Dashboard](https://pipeline.theorchard.io/view/Abacus%20Pipeline%20Dashboard/)
* [Software Catalog](https://sonymusic-pde.datadoghq.com/software?query=team%3Aabacus&env=%2A&fromUser=true&hostGroup=%2A&start=1773402410553&end=1773406010553)
* [Active Monitors](https://sonymusic-pde.datadoghq.com/monitors/manage?q=team%3Aabacus&p=1)
* [Recent Alerts List](https://sonymusic-pde.datadoghq.com/event/explorer?query=source%3Aalert%20env%3Aprod%20team%3Aabacus%20%40monitor_id%3A%2A&cols=&index=%2A&messageDisplay=expanded-lg&options=&refresh_mode=sliding&sort=DESC&type=feed&view=all&from_ts=1772795710789&to_ts=1773400510789&live=true)
* [Monitor Alerts Dashboard](https://sonymusic-pde.datadoghq.com/dash/integration/monitor_alerts_overview?fromUser=true&refresh_mode=sliding&tpl_var_env%5B0%5D=prod&tpl_var_team%5B0%5D=abacus&from_ts=1772795710690&to_ts=1773400510690&live=true)
* [System Performance Dashboard](https://sonymusic-pde.datadoghq.com/dashboard/zcg-zpw-r9z/abacus-health--performance-dashboard?fromUser=false&refresh_mode=sliding&from_ts=1770981067553&to_ts=1773400267553&live=true)
* [Sentry PROD](https://the-orchard.sentry.io/settings/teams/abacus-prod/), [Sentry QA](https://the-orchard.sentry.io/settings/teams/abacus-qa/)
* [Adjustment Files Dashboard](https://app.snowflake.com/sme/orchard/#/abacus-adjustments-d3Oud3J7B)
* [FrontEnd: Session Replay](https://sonymusic-pde.datadoghq.com/rum/replay/search?query=%40application.id%3A58a6e16e-67a1-4358-ac3b-7701f3b7c473%20%40type%3Asession%20%40session.type%3Auser%20%40session.is_replay_available%3Atrue%20%40session.is_active%3Afalse%20%40session.time_spent%3A%3E%3D45000000000%20%40session.action.count%3A%3E%3D4&fromUser=false&refresh_mode=paused&from_ts=1773319860377&to_ts=1773406260377&live=false)
* [Scorecards](https://sonymusic-pde.datadoghq.com/software/scorecards?filter=%7B%22team%22%3A%5B%22abacus%22%5D%7D&groupBy=scorecard)

## 3. Business Metrics Dashboards
* [Overview/Accounts/Contracts/Terms](https://app.sigmacomputing.com/sony-music-entertainment/workbook/Abacus-Executive-Dashboard-6x1niJrHQxOB6UqHpGOBDm)
* [Adjustment Files](https://app.snowflake.com/sme/orchard/#/abacus-adjustments-d3Oud3J7B)
* [SAP Contract Syncing](https://app.snowflake.com/sme/orchard/w27SZHF1Q3RW)
* [ABA Chatbot for Analytics](https://app.snowflake.com/streamlit/sme/orchard/#/apps/dyhlxlc6qpd3mwyrboai)

## 4. Runbook

For now, refer to the following Sheets & Notion runbooks while we are working to migrate them over to this repo:

* [Accounting Run Runbook](https://docs.google.com/spreadsheets/d/1odrnco0cuCI41K3tKl6mAG4Bv_JJtroU67F-Ck-AgXA/edit?gid=468582905#gid=468582905)
* [Support Tasks Runbook](https://www.notion.so/Abacus-Support-Run-Book-eb20f125dadf4b36a571098eab54dda1)
* [Existing Outage Runbook](https://www.notion.so/Abacus-Outage-Support-12d97177520f80988a8bc2161ffcd2d5)