Skip to content

perf: Speedup coins.Sort() when coins is of length 1#18875

Merged
julienrbrt merged 2 commits into
mainfrom
dev/speedup_coins_sort
Dec 23, 2023
Merged

perf: Speedup coins.Sort() when coins is of length 1#18875
julienrbrt merged 2 commits into
mainfrom
dev/speedup_coins_sort

Conversation

@ValarDragon
Copy link
Copy Markdown
Contributor

@ValarDragon ValarDragon commented Dec 22, 2023

Coins.Sort() performs a heap allocation, even though sort.Sort() is in place.

This is because the compiler is doing {something} called runtime.convTSlice which internally makes a copy of the entire slice.

We should ideally find a solution that avoids this malloc for every Coins.Sort() of all sizes, but just eliminating it for slices of length <= 1 is already a big win, as Sort's are used throughout the Add and Sub logic.

(At least its a 2 second CPU savings win in Osmosis epoch code)

Author Checklist

  • included the correct type prefix in the PR title
  • confirmed ! in the type prefix if API or client breaking change
  • targeted the correct branch (see PR Targeting)
  • provided a link to the relevant issue or specification
  • reviewed "Files changed" and left comments if necessary
  • included the necessary unit and integration tests
  • added a changelog entry to CHANGELOG.md
  • updated the relevant documentation or specification, including comments for documenting Go code
  • confirmed all CI checks have passed

Reviewers Checklist

All items are required. Please add a note if the item is not applicable and please add
your handle next to the items reviewed if you only reviewed selected items.

I have...

  • confirmed the correct type prefix in the PR title
  • confirmed all author checklist items have been addressed
  • reviewed state machine logic, API design and naming, documentation is accurate, tests and test coverage

Coins.Sort() performs a heap allocation, even though sort.Sort() is in place.

This is because the compiler is doing {something} called runtime.convTSlice which internally makes a copy of the entire slice.

We should ideally find a solution that avoids this malloc for every Coins.Sort() of all sizes, but just eliminating it for slices of length <= 1 is already a big win, as Sort's are used throughout the Add and Sub logic.
@ValarDragon ValarDragon requested a review from a team December 22, 2023 21:57
@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented Dec 22, 2023

Warning

Rate Limit Exceeded

@ValarDragon has exceeded the limit for the number of files or commits that can be reviewed per hour. Please wait 13 minutes and 59 seconds before requesting another review.

How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.
Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.
Please see our FAQ for further information.

Commits Files that changed from the base of the PR and between 805b630 and 9325098.

Walkthrough

The update optimizes the sorting process for coin collections. It introduces a conditional check to skip sorting when the collection contains one or zero elements, thereby saving computational resources by avoiding unnecessary operations on already sorted or singleton sets.

Changes

File Path Change Summary
types/coin.go Added check to skip sorting for sets with 1 or 0 elements

Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on X ?


Tips

Chat with CodeRabbit Bot (@coderabbitai)

  • You can directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>.
  • You can tag CodeRabbit on specific lines of code or entire files in the PR by tagging @coderabbitai in a comment. Examples:
  • You can tag @coderabbitai in a PR comment and ask questions about the PR and the codebase. Use quoted replies to pass the context for follow-up questions. Examples:
    • @coderabbitai render interesting statistics about this repository as a table.
    • @coderabbitai show all the console.log statements in this repository.
    • @coderabbitai generate unit tests for the src/utils.ts file.

CodeRabbit Commands (invoked as PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger a review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai help to get help.

Additionally, you can add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.

CodeRabbit Configration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • The JSON schema for the configuration file is available here.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/coderabbit-overrides.v2.json

CodeRabbit Discord Community

Join our Discord Community to get help, request features, and share feedback.

@github-actions

This comment has been minimized.

@ValarDragon
Copy link
Copy Markdown
Contributor Author

ValarDragon commented Dec 22, 2023

Pprof before for a load in osmosis that led to sorts size 1 coins:
image
After:
This call isn't even caught in the CPU profile

Copy link
Copy Markdown
Contributor

@facundomedica facundomedica left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ty!

@julienrbrt julienrbrt added this pull request to the merge queue Dec 23, 2023
Merged via the queue into main with commit bd04173 Dec 23, 2023
@julienrbrt julienrbrt deleted the dev/speedup_coins_sort branch December 23, 2023 10:16
mergify Bot pushed a commit that referenced this pull request Dec 23, 2023
(cherry picked from commit bd04173)

# Conflicts:
#	CHANGELOG.md
mergify Bot pushed a commit that referenced this pull request Dec 23, 2023
(cherry picked from commit bd04173)

# Conflicts:
#	CHANGELOG.md
julienrbrt added a commit that referenced this pull request Dec 23, 2023
#18877)

Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Co-authored-by: Julien Robert <julien@rbrt.fr>
julienrbrt added a commit that referenced this pull request Dec 23, 2023
#18878)

Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Co-authored-by: Julien Robert <julien@rbrt.fr>
MSalopek pushed a commit to informalsystems/cosmos-sdk that referenced this pull request Feb 27, 2024
…#18875) (cosmos#18878)

Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Co-authored-by: Julien Robert <julien@rbrt.fr>
@faddat faddat mentioned this pull request Mar 20, 2024
12 tasks
emidev98 pushed a commit to terra-money/cosmos-sdk that referenced this pull request Mar 21, 2024
…#18875) (cosmos#18878)

Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Co-authored-by: Julien Robert <julien@rbrt.fr>
@faddat faddat mentioned this pull request Nov 8, 2024
12 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants