Benchmark: Micro benchmark - Add float datatype support and other refinements to GPU Stream

[WenqingLan1]

Refinements:

• Add support for float (fp32) execution and --data_type <float|double> CLI option for runtime type selection.
• Refactor CUDA kernels to use 128-bit vectorized accesses (double2 / float4) and move template kernel implementations into a header for cross-TU instantiation. (Required for CUDA template instantiation across compilation units.)
• Fix allocation buf size bug, args->size is buf size in bytes, not number of elements.
• Adjust execution/output to single visible GPU (device 0 via CUDA_VISIBLE_DEVICES) and update metric/tag formats (removing gpu_id) plus docs/examples/test log.
• Updated numa assignment from hard coded numa_alloc_onnode to numa_alloc_local to optimize memory allocation.
• Rename entry point file from gpu_stream_test.cpp to gpu_stream_main.cpp.

New config:

    gpu-stream:fp64:
      <<: *default_local_mode
      timeout: 600
      parameters:
        num_warm_up: 10
        num_loops: 40
        size: 1308622848
        data_type: double
    gpu-stream:fp64-correctness:
      <<: *default_local_mode
      timeout: 600
      parameters:
        num_warm_up: 0
        num_loops: 1
        size: 1048576
        data_type: double
        check_data: true
    gpu-stream:fp32:
      <<: *default_local_mode
      timeout: 600
      parameters:
        num_warm_up: 10
        num_loops: 40
        size: 654311424
        data_type: float
    gpu-stream:fp32-correctness:
      <<: *default_local_mode
      timeout: 600
      parameters:
        num_warm_up: 0
        num_loops: 1
        size: 1048576
        data_type: float
        check_data: true

New rule:

    gpu-stream:
      statistics:
        - mean
      categories: GPU-STREAM
      aggregate: True
      metrics:
        - gpu-stream:fp(?:32|64)/STREAM_.*_(?:bw|ratio):(\d+)

Example results:

"gpu-stream:fp32/STREAM_COPY_float_buffer_2617245696_block_256_bw:0": 1234, 
"gpu-stream:fp32/STREAM_COPY_float_buffer_2617245696_block_256_bw:1": 1234, 
"gpu-stream:fp32/STREAM_COPY_float_buffer_2617245696_block_256_bw:2": 1234, 
"gpu-stream:fp32/STREAM_COPY_float_buffer_2617245696_block_256_bw:3": 1234

Processed by rules:

| gpu-stream:fp32/STREAM_COPY_float_buffer_2617245696_block_256_bw | mean | 1234|

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 85.69%. Comparing base (3c95714) to head (620a9fa).

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #769   +/-   ##
=======================================
  Coverage   85.69%   85.69%           
=======================================
  Files         103      103           
  Lines        7890     7891    +1     
=======================================
+ Hits         6761     6762    +1     
  Misses       1129     1129           

Flag	Coverage Δ
cpu-python3.10-unit-test	70.42% <50.00%> (+<0.01%)	⬆️
cpu-python3.12-unit-test	70.42% <50.00%> (+<0.01%)	⬆️
cpu-python3.7-unit-test	69.85% <50.00%> (+<0.01%)	⬆️
cuda-unit-test	83.60% <100.00%> (+<0.01%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[Copilot]

Pull request overview

Updates the GPU STREAM microbenchmark to support runtime-selectable FP32/FP64 execution and improve GPU memory bandwidth utilization, while aligning SuperBench integration (CLI, output tags, docs, and tests) to the new behavior.

Changes:

• Add --data_type <float|double> to select FP32/FP64 at runtime and propagate it through the Python benchmark wrapper + unit tests.
• Refactor CUDA kernels to use 128-bit vectorized accesses (double2 / float4) and move template kernel implementations into a header for cross-TU instantiation.
• Adjust execution/output to single visible GPU (device 0 via CUDA_VISIBLE_DEVICES) and update metric/tag formats (removing gpu_id) plus docs/examples/test log.

Reviewed changes

Copilot reviewed 11 out of 13 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
tests/data/gpu_stream.log	Updates golden log output to include data type and new tag format (no gpu_id).
tests/benchmarks/micro_benchmarks/test_gpu_stream.py	Extends command-generation assertions to include --data_type (currently only covers double).
superbench/benchmarks/micro_benchmarks/gpu_stream/gpu_stream_utils.hpp	Removes NUMA/GPU iteration fields from args and adds Opts::data_type.
superbench/benchmarks/micro_benchmarks/gpu_stream/gpu_stream_utils.cpp	Adds CLI parsing/printing for --data_type.
superbench/benchmarks/micro_benchmarks/gpu_stream/gpu_stream_main.cpp	New entry point replacing the previous main file.
superbench/benchmarks/micro_benchmarks/gpu_stream/gpu_stream_kernels.hpp	Introduces vector-type mapping and templated kernel definitions (128-bit loads/stores).
superbench/benchmarks/micro_benchmarks/gpu_stream/gpu_stream_kernels.cu	Keeps a CUDA compilation unit and moves template implementations to the header.
superbench/benchmarks/micro_benchmarks/gpu_stream/gpu_stream.hpp	Expands bench-args variant to support float and double.
superbench/benchmarks/micro_benchmarks/gpu_stream/gpu_stream.cu	Uses local NUMA allocation, enforces 16B/thread sizing, launches templated vectorized kernels, updates tag format, and runs only CUDA device 0.
superbench/benchmarks/micro_benchmarks/gpu_stream/CMakeLists.txt	Switches target sources to the new gpu_stream_main.cpp.
superbench/benchmarks/micro_benchmarks/gpu_stream.py	Adds --data_type argument and forwards it to the binary.
examples/benchmarks/gpu_stream.py	Updates example invocation to include --data_type double.
docs/user-tutorial/benchmarks/micro-benchmarks.md	Updates gpu-stream metric patterns to include `(double

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 12 out of 14 changed files in this pull request and generated 2 comments.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 11 out of 13 changed files in this pull request and generated 4 comments.

Comments suppressed due to low confidence (1)

superbench/benchmarks/micro_benchmarks/gpu_stream/gpu_stream_utils.cpp:99

• ParseOpts intends to error out when required options are not provided, but size_specified is initialized to true, so missing --size will never be detected by the if (!size_specified || ...) check. Initialize it to false (like the other flags) or remove the required-argument check if defaults are intended.

    int getopt_ret = 0;
    int opt_idx = 0;
    bool size_specified = true;
    bool num_warm_up_specified = false;
    bool num_loops_specified = false;

    bool parse_err = false;
    while (true) {
        getopt_ret = getopt_long(argc, argv, "", options, &opt_idx);
        if (getopt_ret == -1) {
            if (!size_specified || !num_warm_up_specified || !num_loops_specified) {
                parse_err = true;
            }
            break;

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 11 out of 13 changed files in this pull request and generated 3 comments.

Comments suppressed due to low confidence (1)

superbench/benchmarks/micro_benchmarks/gpu_stream/gpu_stream_utils.cpp:99

• ParseOpts initializes size_specified=true, which makes --size effectively optional, but PrintUsage presents --size as required and the end-of-parse validation still checks size_specified. Either initialize size_specified=false to enforce explicit --size, or update the usage/validation logic to reflect that the default buffer size is acceptable.

    int getopt_ret = 0;
    int opt_idx = 0;
    bool size_specified = true;
    bool num_warm_up_specified = false;
    bool num_loops_specified = false;

    bool parse_err = false;
    while (true) {
        getopt_ret = getopt_long(argc, argv, "", options, &opt_idx);
        if (getopt_ret == -1) {
            if (!size_specified || !num_warm_up_specified || !num_loops_specified) {
                parse_err = true;
            }
            break;

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 11 out of 13 changed files in this pull request and generated no new comments.

Comments suppressed due to low confidence (1)

superbench/benchmarks/micro_benchmarks/gpu_stream/gpu_stream_utils.cpp:99

• ParseOpts sets size_specified to true initially, which makes the required-argument validation (if (!size_specified || ...)) ineffective for --size. Either initialize size_specified to false (to truly require --size) or remove size_specified from the required check if --size is intended to be optional via the default.

    bool size_specified = true;
    bool num_warm_up_specified = false;
    bool num_loops_specified = false;

    bool parse_err = false;
    while (true) {
        getopt_ret = getopt_long(argc, argv, "", options, &opt_idx);
        if (getopt_ret == -1) {
            if (!size_specified || !num_warm_up_specified || !num_loops_specified) {
                parse_err = true;
            }
            break;

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.