Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Epic] Incremental repair #22472

Open
denesb opened this issue Jan 23, 2025 · 0 comments
Open

[Epic] Incremental repair #22472

denesb opened this issue Jan 23, 2025 · 0 comments

Comments

@denesb
Copy link
Contributor

denesb commented Jan 23, 2025

The idea of incremental repair is tied closely with tablets. The vision is that with tablets and the infrastructure to automatically schedule and execute repairs:

  • repair will be cheap and quick
  • repair will be scheduled automatically
  • repair will happen often

Tablets have a nominal size of 5GB, so repairing a single tablet should be reasonably quick. To make repairing a tablet even quicker, we can implement the incremental repair that C* implemented years ago. The idea is that at any given repair, we repair only the data which was written after the last repair. This way, the more often we repair, the cheaper and quicker it is.

Repairing often will allow us to garbage-collect tombstones more often and more aggressively. We can make changes to compaction strategies to make use of this fact.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants