Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initial AccountsDB implementation #53

Closed
17 of 20 tasks
0xNineteen opened this issue Dec 6, 2023 · 0 comments · Fixed by #42, #54, #56 or #58
Closed
17 of 20 tasks

Initial AccountsDB implementation #53

0xNineteen opened this issue Dec 6, 2023 · 0 comments · Fixed by #42, #54, #56 or #58
Assignees
Labels
enhancement New feature or request

Comments

@0xNineteen
Copy link
Contributor

0xNineteen commented Dec 6, 2023

need the implement the basic functionality of accounts-db

  • loading and indexing accounts from snapshot data
  • verifying data correctness
  • loading system accounts and sysvars

progress:

  • deserialize snapshot metadata (accounts-db: initial implementation #40)
  • load snapshot accounts (accounts-db: accounts files #42)
  • account indexing (accounts-db: loading, indexing, validating accounts #54)
  • loading sysvars (accounts-db: sysvar parsing #56)
  • support incremental snapshots (accounts-db: support incremental snapshots #58)
  • write accounts functionality
  • setup rust-client benchmarking
  • benchmark (reads, writes)
  • disk-based indexing
  • larger benchmarks (accounts stored on disk)
  • disk-based indexing benchmarks
  • improve disk-based indexing for reads
  • improve hashmap performance
  • improve snapshot loading
  • re-run benchmarks (and improve upon rust client)
  • more advanced benchmarks (multiple slot lists, larger initial accounts before benchmarking writes, ...)
  • improve snapshot reading (.tar.zstd format is slow right now)
  • improve memory allocations + fix leaks (current impl is inefficient right now + FBA sucks at free-ing memory)
  • add additional account cleaning (/reclaims/swapping states which come from the same slot)
  • snapshot downloads via gossip
@0xNineteen 0xNineteen added the enhancement New feature or request label Dec 6, 2023
@0xNineteen 0xNineteen added this to Sig Dec 6, 2023
@0xNineteen 0xNineteen self-assigned this Dec 6, 2023
@0xNineteen 0xNineteen linked a pull request Dec 6, 2023 that will close this issue
@0xNineteen 0xNineteen moved this to 🏗 In progress in Sig Dec 6, 2023
This was linked to pull requests Dec 6, 2023
@0xNineteen 0xNineteen changed the title Initial AccountsDB Implementation Initial AccountsDB implementation Dec 6, 2023
@0xNineteen 0xNineteen linked a pull request Dec 15, 2023 that will close this issue
@0xNineteen 0xNineteen removed this from Sig Feb 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment