Skip to content

Shard mypy_primer more#9443

Closed
AlexWaygood wants to merge 1 commit intopython:mainfrom
AlexWaygood:primer-shards
Closed

Shard mypy_primer more#9443
AlexWaygood wants to merge 1 commit intopython:mainfrom
AlexWaygood:primer-shards

Conversation

@AlexWaygood
Copy link
Copy Markdown
Member

Might help reduce the performance impact of #9433 on mypy_primer CI runs.

@AlexWaygood
Copy link
Copy Markdown
Member Author

Yeah, doesn't look like this helps

@AlexWaygood AlexWaygood closed this Jan 2, 2023
@AlexWaygood AlexWaygood deleted the primer-shards branch January 2, 2023 17:47
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Jan 2, 2023

According to mypy_primer, this change has no effect on the checked open source code. 🤖🎉

@AlexWaygood
Copy link
Copy Markdown
Member Author

AlexWaygood commented Jan 2, 2023

It looks like we had:

  1. A 6:01 shard
  2. An 8:18 shard
  3. A 5:45 shard
  4. A 6:23 shard
  5. A 17:02 shard(!!)
  6. A 5:35 shard

For shard 4, it took 8 minutes for each run of mypy checking manticore, far exceeding any of the other projects in that shard. No other project in shard 4 took >1 minute to be checked once by mypy.

Whether or not we decide to revert #9433, that's quite interesting! Cc. @hauntsaninja.

@hauntsaninja
Copy link
Copy Markdown
Collaborator

That is interesting. I took a closer look, should be a simple fix to improve perf on manticore.

hauntsaninja added a commit to hauntsaninja/mypy that referenced this pull request Jan 3, 2023
When checking manticore with `--check-untyped-defs`, this is a 4x total
speedup from master, from ~320s to ~80s.

I looked into this because of python/typeshed#9443 (comment)
hauntsaninja added a commit to python/mypy that referenced this pull request Jan 3, 2023
When checking manticore with `--check-untyped-defs`, this is a 4x total
speedup from master, from ~320s to ~80s (uncompiled).

I looked into this because of
python/typeshed#9443 (comment)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants