Journal / DevOps, Deployment, Infrastructure

DevOps, Deployment, Infrastructure

Database Backups: The Setup Most Teams Get Wrong

Database backups are the system that protects you from data loss caused by corruption, accidental deletion, hardware failure, ransomware, or human error. The default backup configuration on most managed databases is inadequate for production. The right setup requires deliberate choices about retention, cross account storage, point in time recovery, and tested restoration. The cost is small. The cost of getting it wrong is the kind of incident that ends companies.

What you actually need to know

  • The defaults are inadequate. Configure deliberately.
  • Backups live in a different account from the primary.
  • Point in time recovery enabled with a recovery window that matches your needs.
  • Quarterly restore tests.
  • Both physical and logical backups for production.

Setting

Right value

Point in time recovery window

Seven days minimum

Daily snapshot retention

Thirty days

Monthly snapshot retention

Twelve months

Backup storage location

Different account or region

Restore test cadence

Quarterly

Restore test environment

Clean isolated mirror of production

Encryption at rest

Always

Cross region replication

Recommended for production

The core argument

Database backups are the kind of infrastructure that founders think is solved when it is not. The managed database provider takes backups. The team assumes those backups are sufficient. The default configuration produces backups that are technically present but practically inadequate for the failures that actually happen.

The first inadequacy is location. Default backups often live in the same account as the primary database. A compromised credential or a ransomware attack that can reach the primary can also reach the backups. The data is gone. The cross account backup pattern eliminates this risk.

The second inadequacy is retention. The default might retain backups for seven days. Most teams need more. Compliance requirements often demand twelve months. The team configures retention to match the regulation, not the default.

The third inadequacy is testing. The backup that has never been restored is not a backup. The first time the team learns the backup process is during a real incident is the worst time. Quarterly restore tests verify the process works. The tests are mechanical and small.

The fix for all three is mechanical. Configure cross account backups. Set retention to match your compliance and business needs. Run restore tests on a cadence. None of it costs much. Skipping it is how companies lose data they never get back.

The right setup

Setting

Production value

Point in time recovery

Enabled, seven to thirty day window

Daily snapshot

Enabled, thirty day retention

Monthly snapshot

Enabled, twelve month retention

Backup account

Different from primary

Encryption

Required

Cross region copy

Recommended

Restore test

Quarterly

Restore documentation

Current and runnable

Logical backup

Periodic, for portability

Backup monitoring

Alarms on missing or failed backups

How much does this cost

Component

Monthly cost at moderate scale

Snapshot storage

25 to 200 USD

Cross region copy

Additional 25 to 200 USD

Logical backup pipeline

Modest

Restore test infrastructure

Hours of compute during the test

That is a modest line item against what it protects.

Features the backup setup must have

  • Point in time recovery enabled.
  • Daily and monthly snapshot retention configured.
  • Cross account or cross region backup storage.
  • Encryption at rest.
  • Monitoring on backup success or failure.
  • A runnable restore runbook.
  • Quarterly restore test results documented.
  • A clear owner of the backup system.

Expert opinion

The teams that have never tested a restore are usually one incident away from a catastrophic data loss they did not have to suffer. The fix is mechanical. The quarterly drill is hours of engineering time. Skip it, and the incident that finally arrives is the one you do not walk away from. The reasonable teams have drilled. The lucky teams have not had to find out.

Yashveer Singh, founder of Yashveer Labs

How this played out on a real project

A client SaaS suffered a database corruption from a faulty migration. They had backups. The team had never tested a restore. The recovery took seventy two hours. The team improvised the runbook during the incident. They lost six hours of customer data because the most recent clean point in time was older than expected.

After the incident we rebuilt the backup setup. Cross account storage. Tighter retention. Documented runbook. Quarterly restore tests.

The first test took six hours and surfaced three gaps. The team fixed them. The second test took two hours. The third test took ninety minutes. The team had built fluency in the process.

A second corruption six months later was contained within four hours. The customer impact was minimal. The drilled process worked. The investment in the backup setup paid back many times over.

For more on the related work, see backup and restore drills a compliance asset most teams skip and backup restore and drill practice a SaaS disaster recovery guide.

Common mistakes teams make

  1. Default backup configuration without auditing.
  2. Backups in the same account as the primary.
  3. Short retention that misses compliance requirements.
  4. No point in time recovery.
  5. No restore tests.
  6. No monitoring on backup success.
  7. No documented runbook.
  8. Single person knowledge of the backup system.

A one day audit

  1. Hour one and two. Inventory current backup configuration.
  2. Hour three and four. Compare against the right setup. Identify gaps.
  3. Hour five and six. Fix the easy gaps. Cross account storage. Retention. PITR.
  4. Hour seven and eight. Plan the first restore test for the next sprint.

For more on the related work, read backup and restore drills a compliance asset most teams skip and zero downtime database migrations a step by step guide. On the broader reliability side, chaos engineering at startup scale is the natural next read.

FAQ

Frequently asked

  • What is wrong with the default backup setup?
  • What is point in time recovery?
  • What is the right retention?
  • Where should backups live?
  • How do I know the backups work?
  • What about logical versus physical backups?
  • What is the worst backup configuration?

Author

Why you should skip the agency and hire me instead

Agencies markup engineering work by three to five times. Yashveer Singh, founder of Yashveer Labs. I do the work directly. No project manager, no account manager, no overhead. The engineer you talk to is the engineer who writes the code. That changes the math on price, speed, and quality at the same time. If that sounds like the shape of project you have, we should talk.

Start the conversation See the work DM on Instagram