IEEE 2937-2022
$37.92
IEEE Standard for Performance Benchmarking for Artificial Intelligence Server Systems
Published By | Publication Date | Number of Pages |
IEEE | 2022 |
New IEEE Standard – Active. Artificial intelligence (AI) computing differs from generic computing in terms of device formation, operators, and usage. AI server systems, including AI server, cluster, and high-performance computing (HPC) infrastructures are designed specifically for this purpose. The performance of these infrastructures is important to users not only on generic models but also on the ones for specific domains. Formal methods for the performance benchmarking for AI server systems are provided in this standard, including approaches for test, metrics, and measure. In addition, the technical requirements for benchmarking tools are discussed.
PDF Catalog
PDF Pages | PDF Title |
---|---|
1 | IEEE Std 2937-2022 Front cover |
2 | Title page |
4 | Important Notices and Disclaimers Concerning IEEE Standards Documents |
8 | Participants |
10 | Introduction |
11 | Contents |
12 | 1. Overview 1.1 Scope 1.2 Word usage 2. Normative references |
13 | 3. Definitions, acronyms, and abbreviations 3.1 Definitions |
14 | 3.2 Acronyms and abbreviations |
15 | 4. AI server system performance benchmarking framework 4.1 Overview 4.2 Modes of test |
16 | 4.3 Information of a test |
17 | 5. Training test 5.1 Overview |
19 | 5.2 Scenarios |
23 | 5.3 Metrics and measure approach |
29 | 5.4 Requirement on toolkit |
31 | 6. Inference test 6.1 Overview |
32 | 6.2 Workload |
33 | 6.3 Scenarios |
36 | 6.4 Metrics and measure approach |
43 | 6.5 Requirement on toolkit |
45 | Annex A (informative) Utilization ratio |
46 | Annex B (normative) Rules for the selection and use of power measurement devices B.1 Power meter |
47 | B.2 BMC |
50 | Annex C (informative) Effective computing ability C.1 Effective computing ability of training C.2 Effective computing ability of inference |
51 | Annex D (informative) Extra computing jobs for “mixed” query arrival mode D.1 File operation D.2 Balanced binary tree search |
52 | Annex E (informative) Bibliography |
54 | Back cover |