Add config file support for constants and test control #4337
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/4337
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit d1b748f with merge base b7c8378 ( This comment was automatically generated by Dr. CI and updates every 15 minutes. |
facebook-github-bot
added
the
CLA Signed
|
This pull request was exported from Phabricator. Differential Revision: D60060188 |
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 25, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Differential Revision: https://internalfb.com/D60060188
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 26, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Differential Revision: https://internalfb.com/D60060188
jorgep31415
approved these changes
Jul 26, 2024
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 26, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Differential Revision: https://internalfb.com/D60060188
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 26, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Reviewed By: jorgep31415 Differential Revision: D60060188
Esteb37
force-pushed
the
export-D60060188
branch
from
1dcf6dc to
616ff44
Compare
|
This pull request was exported from Phabricator. Differential Revision: D60060188 |
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 29, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Differential Revision: https://internalfb.com/D60060188
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 29, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Reviewed By: jorgep31415 Differential Revision: D60060188
|
This pull request was exported from Phabricator. Differential Revision: D60060188 |
Esteb37
force-pushed
the
export-D60060188
branch
from
616ff44 to
a5d2cda
Compare
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 29, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Differential Revision: https://internalfb.com/D60060188
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 29, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Differential Revision: https://internalfb.com/D60060188
Summary: Pull Request resolved: pytorch#4336 This diff introduces a profiler that obtains the maximum and minimum bandwidth for reading unique addresses from 3D textures in each of its dimensions, using the following shader, where A is a 3D texture and B is a writeonly buffer. The calculation of the texel position will depend on the dimension that is being benchmarked x : pos = ivec3(offset, 0, 0) y : pos = ivec3(0, offset, 0) z : pos = ivec3(0, 0, offset) void main() { vec4 sum = vec4(0); const uint workgroup_width = local_group_size * niter * ${NUNROLL}; uint offset = (gl_WorkGroupID[0] * workgroup_width + gl_LocalInvocationID[0]) & addr_mask; int i = 0; for (; i < niter; ++i) { sum *= texelFetch(A, pos, 0); offset = (offset + local_group_size) & addr_mask; ... ... sum *= texelFetch(A, pos, 0); offset = (offset + local_group_size) & addr_mask; } vec4 zero = vec4(i>>31); B[gl_LocalInvocationID[0]] = sum + zero; } The address mask allows us to control how many unique addresses we are accessing. If the number of unique vectors we want to read is 3, the offset will jump between three unique addresses throughout the iterations, giving us the bandwidth for that specific size of data. If the size of the unique data read is larger than the work group size, then each run will have its own block of data to read, defined by the initial offset calculation, where the offset is obtained through the workgroup ID and the local invocation ID. Finally, we make sure to use the `sum` and `i ` variables so that the compiler's optimizer does not flatten the loops. For a Samsung S22, the bandwidth behaves like this for each of the dimensions. {F1767497386} Comparing the bandwidth for the X dimension to OpenCL, we can observe that, although the behavior is the same, Vulkan has an increased bandwidth for most access sizes. {F1767497972} Comparing to the bandwidth for buffers, we can observe that the bandwidth is similar to regular buffers, but still much smaller than UBOs at small access sizes. {F1767497707} Differential Revision: https://internalfb.com/D59980139
|
This pull request was exported from Phabricator. Differential Revision: D60060188 |
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 30, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Reviewed By: jorgep31415 Differential Revision: D60060188
Esteb37
force-pushed
the
export-D60060188
branch
from
a5d2cda to
b5e985e
Compare
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 30, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Differential Revision: https://internalfb.com/D60060188
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Reviewed By: jorgep31415 Differential Revision: D60060188
|
This pull request was exported from Phabricator. Differential Revision: D60060188 |
Esteb37
force-pushed
the
export-D60060188
branch
from
b5e985e to
d1b748f
Compare
Esteb37
pushed a commit
to Esteb37/executorch
that referenced
this pull request
Jul 30, 2024
Summary: Pull Request resolved: pytorch#4337 Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test. Reviewed By: jorgep31415 Differential Revision: D60060188
|
This pull request has been merged in 298b625. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary: Now that the tool is getting larger, a configuration file for defining which tests to run and which to skip, as well as specifying some values like thresholds and ranges, comes in handy. This diff adds support for a JSON config file with specifications for each test.
Differential Revision: D60060188