Shopping Cart

No products in the cart.

IEEE 2937-2022

$37.92

IEEE Standard for Performance Benchmarking for Artificial Intelligence Server Systems

Published By Publication Date Number of Pages
IEEE 2022
Guaranteed Safe Checkout
Category:

If you have any questions, feel free to reach out to our online customer service team by clicking on the bottom right corner. We’re here to assist you 24/7.
Email:[email protected]

New IEEE Standard – Active. Artificial intelligence (AI) computing differs from generic computing in terms of device formation, operators, and usage. AI server systems, including AI server, cluster, and high-performance computing (HPC) infrastructures are designed specifically for this purpose. The performance of these infrastructures is important to users not only on generic models but also on the ones for specific domains. Formal methods for the performance benchmarking for AI server systems are provided in this standard, including approaches for test, metrics, and measure. In addition, the technical requirements for benchmarking tools are discussed.

PDF Catalog

PDF Pages PDF Title
1 IEEE Std 2937-2022 Front cover
2 Title page
4 Important Notices and Disclaimers Concerning IEEE Standards Documents
8 Participants
10 Introduction
11 Contents
12 1. Overview
1.1 Scope
1.2 Word usage
2. Normative references
13 3. Definitions, acronyms, and abbreviations
3.1 Definitions
14 3.2 Acronyms and abbreviations
15 4. AI server system performance benchmarking framework
4.1 Overview
4.2 Modes of test
16 4.3 Information of a test
17 5. Training test
5.1 Overview
19 5.2 Scenarios
23 5.3 Metrics and measure approach
29 5.4 Requirement on toolkit
31 6. Inference test
6.1 Overview
32 6.2 Workload
33 6.3 Scenarios
36 6.4 Metrics and measure approach
43 6.5 Requirement on toolkit
45 Annex A (informative) Utilization ratio
46 Annex B (normative) Rules for the selection and use of power measurement devices
B.1 Power meter
47 B.2 BMC
50 Annex C (informative) Effective computing ability
C.1 Effective computing ability of training
C.2 Effective computing ability of inference
51 Annex D (informative) Extra computing jobs for “mixed” query arrival mode
D.1 File operation
D.2 Balanced binary tree search
52 Annex E (informative) Bibliography
54 Back cover
IEEE 2937-2022
$37.92