Skip to content

Commit ccf0ea2

Browse files
ftgreatftgreat
authored
Merge pull request #579 from MayDomine/master
Add two toolkit for training/inference
2 parents a26da31 + 04a718e commit ccf0ea2

File tree

331 files changed

+37339
-0
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

331 files changed

+37339
-0
lines changed

‎examples/BMTrain/.dockerignore‎

Lines changed: 147 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,147 @@
1+
**/__pycache__/
2+
**/*.py[cod]
3+
**/*$py.class
4+
5+
# C extensions
6+
**/*.so
7+
8+
# Distribution / packaging
9+
**/.Python
10+
**/build/
11+
**/develop-eggs/
12+
**/dist/
13+
**/downloads/
14+
**/eggs/
15+
**/.eggs/
16+
**/lib/
17+
**/lib64/
18+
**/parts/
19+
**/sdist/
20+
**/var/
21+
**/wheels/
22+
**/share/python-wheels/
23+
**/*.egg-info/
24+
**/.installed.cfg
25+
**/*.egg
26+
MANIFEST
27+
28+
# PyInstaller
29+
# Usually these files are written by a python script from a template
30+
# before PyInstaller builds the exe, so as to inject date/other infos into it.
31+
**/*.manifest
32+
**/*.spec
33+
34+
# Installer logs
35+
pip-log.txt
36+
pip-delete-this-directory.txt
37+
38+
# Unit test / coverage reports
39+
**/htmlcov/
40+
**/.tox/
41+
**/.nox/
42+
.coverage
43+
.coverage.*
44+
.cache
45+
nosetests.xml
46+
coverage.xml
47+
**/*.cover
48+
**/*.py,cover
49+
.hypothesis/
50+
.pytest_cache/
51+
cover/
52+
53+
# Translations
54+
*.mo
55+
*.pot
56+
57+
# Django stuff:
58+
*.log
59+
local_settings.py
60+
db.sqlite3
61+
db.sqlite3-journal
62+
63+
# Flask stuff:
64+
instance/
65+
.webassets-cache
66+
67+
# Scrapy stuff:
68+
.scrapy
69+
70+
# Sphinx documentation
71+
docs/_build/
72+
73+
# PyBuilder
74+
.pybuilder/
75+
target/
76+
77+
# Jupyter Notebook
78+
.ipynb_checkpoints
79+
80+
# IPython
81+
profile_default/
82+
ipython_config.py
83+
84+
# pyenv
85+
# For a library or package, you might want to ignore these files since the code is
86+
# intended to run in multiple environments; otherwise, check them in:
87+
# .python-version
88+
89+
# pipenv
90+
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
91+
# However, in case of collaboration, if having platform-specific dependencies or dependencies
92+
# having no cross-platform support, pipenv may install dependencies that don't work, or not
93+
# install all needed dependencies.
94+
#Pipfile.lock
95+
96+
# PEP 582; used by e.g. github.com/David-OConnor/pyflow
97+
__pypackages__/
98+
99+
# Celery stuff
100+
celerybeat-schedule
101+
celerybeat.pid
102+
103+
# SageMath parsed files
104+
*.sage.py
105+
106+
# Environments
107+
.env
108+
.venv
109+
env/
110+
venv/
111+
ENV/
112+
env.bak/
113+
venv.bak/
114+
115+
# Spyder project settings
116+
.spyderproject
117+
.spyproject
118+
119+
# Rope project settings
120+
.ropeproject
121+
122+
# mkdocs documentation
123+
/site
124+
125+
# mypy
126+
.mypy_cache/
127+
.dmypy.json
128+
dmypy.json
129+
130+
# Pyre type checker
131+
**/.pyre/
132+
133+
# pytype static type analyzer
134+
**/.pytype/
135+
136+
# Cython debug symbols
137+
cython_debug/
138+
139+
**/*.pt
140+
141+
**/*.npy
142+
143+
**/.DS_Store
144+
145+
**/log
146+
**/*.qdrep
147+
!bmtrain/dist

‎examples/BMTrain/.github/ISSUE_TEMPLATE/bug_report.yml‎

Lines changed: 79 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,79 @@
1+
2+
name: 🐞 Bug Report
3+
description: Report a bug/issue related to the PyTorch-based parallel model training toolkit
4+
title: "[BUG] <title>"
5+
labels: ["bug"]
6+
body:
7+
- type: checkboxes
8+
attributes:
9+
label: Is there an existing issue for this?
10+
description: Please search to see if an issue already exists for the bug you encountered.
11+
options:
12+
- label: I have searched the existing issues
13+
required: true
14+
- type: textarea
15+
attributes:
16+
label: Description of the Bug
17+
description: Provide a clear and concise description of what the bug is.
18+
validations:
19+
required: true
20+
- type: textarea
21+
attributes:
22+
label: Environment Information
23+
description: |
24+
Provide details about your environment.
25+
Example:
26+
- GCC version: 9.3.0
27+
- Torch version: 1.9.0
28+
- Linux system version: Ubuntu 20.04
29+
- CUDA version: 11.4
30+
- Torch's CUDA version (as per `torch.cuda.version()`): 11.3
31+
value: |
32+
- GCC version:
33+
- Torch version:
34+
- Linux system version:
35+
- CUDA version:
36+
- Torch's CUDA version (as per `torch.cuda.version()`):
37+
render: markdown
38+
validations:
39+
required: true
40+
- type: textarea
41+
attributes:
42+
label: To Reproduce
43+
description: Provide the steps and details to reproduce the behavior.
44+
placeholder: |
45+
1. Describe your environment setup, including any specific version requirements.
46+
2. Clearly state the steps you took to trigger the error, including the specific code you executed.
47+
3. Identify the file and line number where the error occurred, along with the full traceback of the error. Make sure to have `NCCL_DEBUG=INFO` and `CUDA_LAUNCH_BLOCKING=True` set to get accurate debug information.
48+
validations:
49+
required: true
50+
- type: textarea
51+
attributes:
52+
label: Expected Behavior
53+
description: Describe what you expected to happen when you executed the code.
54+
validations:
55+
required: true
56+
- type: textarea
57+
attributes:
58+
label: Screenshots
59+
description: If applicable, please add screenshots to help explain your problem.
60+
validations:
61+
required: false
62+
- type: textarea
63+
attributes:
64+
label: Additional Information
65+
description: |
66+
Provide any other relevant context or information about the problem here.
67+
Links? References? Anything that will give us more context about the issue you are encountering!
68+
Tip: You can attach images or log files by clicking this area to highlight it and then dragging files in.
69+
validations:
70+
required: false
71+
- type: checkboxes
72+
attributes:
73+
label: Confirmation
74+
description: Please confirm that you have reviewed all of the above requirements and verified the information provided before submitting this issue.
75+
options:
76+
- label: I have reviewed and verified all the information provided in this report.
77+
validations:
78+
required: true
79+

‎examples/BMTrain/.github/ISSUE_TEMPLATE/build_err.yml‎

Lines changed: 94 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,94 @@
1+
name: 🛠️ Build Error
2+
description: Report a build error for this project
3+
title: "[BUILD ERROR] <title>"
4+
labels: ["Build ERR"]
5+
body:
6+
- type: checkboxes
7+
id: prev_issue
8+
attributes:
9+
label: Is there an existing issue for this?
10+
description: Please search to see if an issue already exists for the build error you encountered.
11+
options:
12+
- label: I have searched the existing issues
13+
required: true
14+
- type: textarea
15+
attributes:
16+
label: Description of the Build Error
17+
description: Provide a clear and concise description of what the build error is.
18+
validations:
19+
required: true
20+
- type: textarea
21+
attributes:
22+
label: Expected Behavior
23+
description: Provide a clear and concise description of what you expected to happen.
24+
validations:
25+
required: true
26+
- type: textarea
27+
attributes:
28+
label: To Reproduce
29+
description: Describe the steps you took to trigger the build error. Include any commands you executed or files you modified.
30+
placeholder: |
31+
1. Go to '...'
32+
2. Click on '....'
33+
3. Scroll down to '....'
34+
4. See error
35+
validations:
36+
required: true
37+
- type: textarea
38+
attributes:
39+
label: Environment Information
40+
description: |
41+
Provide details about your environment.
42+
Example:
43+
- Operating System version: Ubuntu 20.04
44+
- GCC version: 9.3.0
45+
- Pybind version: 2.8.1
46+
- CUDA version: 11.4
47+
- NVIDIA NCCL CU11 version: 2.14.3
48+
- CMake version: 3.21.2
49+
- Pip version: 22.0.0
50+
value: |
51+
- Operating System version:
52+
- GCC version:
53+
- Pybind version:
54+
- CUDA version:
55+
- NVIDIA NCCL CU11 version:
56+
- CMake version:
57+
- Pip version:
58+
render: markdown
59+
validations:
60+
required: true
61+
- type: dropdown
62+
attributes:
63+
label: Installation Method
64+
description: Please indicate if the error occurred during source code installation or when using the pip install .whl method.
65+
options:
66+
- Source Code Installation
67+
- Pip Install .whl Method
68+
validations:
69+
required: true
70+
- type: textarea
71+
attributes:
72+
label: Full Error Traceback
73+
description: Provide the complete error traceback.
74+
validations:
75+
required: true
76+
- type: textarea
77+
attributes:
78+
label: Additional Information
79+
description: |
80+
Provide any other relevant context or information about the problem here.
81+
Links? References? Anything that will give us more context about the issue you are encountering!
82+
Tip: You can attach images or log files by clicking this area to highlight it and then dragging files in.
83+
validations:
84+
required: false
85+
- type: checkboxes
86+
id: confirm
87+
attributes:
88+
label: Confirmation
89+
description: Please confirm that you have reviewed all of the above requirements and verified the information provided before submitting this report.
90+
options:
91+
- label: I have reviewed and verified all the information provided in this report.
92+
validations:
93+
required: true
94+

‎examples/BMTrain/.github/ISSUE_TEMPLATE/features_request.yml‎

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
name: 🚀Feature Request
2+
description: Suggest an idea for this project
3+
title: "[Feature] <title>"
4+
labels: ["enhancement"]
5+
assignees: []
6+
body:
7+
- type: textarea
8+
attributes:
9+
label: Is your feature request related to a problem? Please describe.
10+
description: "A clear and concise description of what the problem is. Example: I'm always frustrated when..."
11+
validations:
12+
required: true
13+
- type: textarea
14+
attributes:
15+
label: Describe the solution you'd like
16+
description: "A clear and concise description of what you want to happen."
17+
validations:
18+
required: true
19+
- type: textarea
20+
attributes:
21+
label: Describe alternatives you've considered
22+
description: "A clear and concise description of any alternative solutions or features you've considered."
23+
validations:
24+
required: false
25+
- type: textarea
26+
attributes:
27+
label: Additional context
28+
description: "Add any other context or screenshots about the feature request here."
29+
validations:
30+
required: false

‎examples/BMTrain/.github/pull_request_template.md‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
## Pull Request Template
2+
3+
### Issue Reference
4+
Please mention the issue number if applicable, or write "N/A" if it's a new feature.
5+
6+
Issue #...
7+
8+
### Description
9+
Please describe your changes in detail. If it resolves an issue, please state how it resolves it.
10+
11+
### Type of Change
12+
- [ ] Bug fix (non-breaking change which fixes an issue)
13+
- [ ] New feature (non-breaking change which adds functionality)
14+
- [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
15+
- [ ] This change requires a documentation update
16+
17+
### How Has This Been Tested?
18+
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce.
19+
20+
### Checklist
21+
- [ ] I have read the [CONTRIBUTING](../../CONTRIBUTING.md) document.
22+
- [ ] My code follows the code style of this project.
23+
- [ ] My change requires a change to the documentation.
24+
- [ ] I have updated the documentation accordingly.
25+
- [ ] I have added tests to cover my changes.
26+
- [ ] All new and existing tests passed.
27+
28+
### Additional Information
29+
Any additional information, configuration, or data that might be necessary for the review.

0 commit comments

Comments
 (0)
⚡