@@ -14,32 +14,17 @@ Please see the [MLPerf Inference benchmark paper](https://arxiv.org/abs/1911.025
14
14
}
15
15
```
16
16
17
- ## MLPerf Inference master
18
- The master of this repository contains work in progress for the next official release. This is currently *** v0.7*** .
19
- It provides the benchmarks below.
20
-
21
- See the individual Readme files in the reference app for details.
22
-
23
-
24
- | model | reference app | framework | dataset |
25
- | ---- | ---- | ---- | ---- |
26
- | resnet50-v1.5 | [ vision/classification_and_detection] ( vision/classification_and_detection ) | tensorflow, pytorch, onnx | imagenet2012 |
27
- | ssd-mobilenet 300x300 | [ vision/classification_and_detection] ( vision/classification_and_detection ) | tensorflow, pytorch, onnx| coco resized to 300x300 |
28
- | ssd-resnet34 1200x1200 | [ vision/classification_and_detection] ( vision/classification_and_detection ) | tensorflow, pytorch, onnx | coco resized to 1200x1200|
29
- | bert | [ language/bert] ( language/bert ) | tensorflow, pytorch, onnx | squad-1.1 |
30
- | dlrm | [ recommendation/dlrm] ( recommendation/dlrm/pytorch ) | pytorch, tensorflow(?), onnx(?) | Criteo Terabyte |
31
- | 3d-unet | [ vision/medical_imageing/3d-unet] ( vision/medical_imageing/3d-unet ) | pytorch, tensorflow(?), onnx(?) | BraTS 2019 |
32
- | rnnt | [ speech_recognition/rnnt] ( speech_recognition/rnnt ) | pytorch | OpenSLR LibriSpeech Corpus |
33
-
34
-
35
- ## MLPerf Inference v0.5
17
+ ## MLPerf Inference v0.7 (submission 9/18/2020)
18
+ Use the r0.7 branch (``` git checkout r0.7 ``` ) if you want to submit or reproduce v0.7 results.
36
19
37
20
See the individual Readme files in the reference app for details.
38
21
39
22
| model | reference app | framework | dataset |
40
23
| ---- | ---- | ---- | ---- |
41
- | resnet50-v1.5 | [ v0.5/classification_and_detection] ( https://github.com/mlperf/inference/tree/r0.5/v0.5/classification_and_detection ) | tensorflow, pytorch, onnx | imagenet2012 |
42
- | mobilenet-v1 | [ v0.5/classification_and_detection] ( https://github.com/mlperf/inference/tree/r0.5/v0.5/classification_and_detection ) | tensorflow, pytorch, onnx | imagenet2012 |
43
- | ssd-mobilenet 300x300 | [ v0.5/classification_and_detection] ( https://github.com/mlperf/inference/tree/r0.5/v0.5/classification_and_detection ) | tensorflow, pytorch, onnx | coco resized to 300x300 |
44
- | ssd-resnet34 1200x1200 | [ v0.5/classification_and_detection] ( https://github.com/mlperf/inference/tree/r0.5/v0.5/classification_and_detection ) | tensorflow, pytorch, onnx | coco resized to 1200x1200 |
45
- | gnmt | [ v0.5/translation/gnmt/] ( https://github.com/mlperf/inference/tree/r0.5/v0.5/translation/gnmt/tensorflow ) | tensorflow, pytorch | See Readme |
24
+ | resnet50-v1.5 | [ vision/classification_and_detection] ( https://github.com/mlperf/inference/tree/r0.7/vision/classification_and_detection ) | tensorflow, pytorch, onnx | imagenet2012 |
25
+ | ssd-mobilenet 300x300 | [ vision/classification_and_detection] ( https://github.com/mlperf/inference/tree/r0.7/vision/classification_and_detection ) | tensorflow, pytorch, onnx| coco resized to 300x300 |
26
+ | ssd-resnet34 1200x1200 | [ vision/classification_and_detection] ( https://github.com/mlperf/inference/tree/r0.7/vision/classification_and_detection ) | tensorflow, pytorch, onnx | coco resized to 1200x1200|
27
+ | bert | [ language/bert] ( https://github.com/mlperf/inference/tree/r0.7/language/bert ) | tensorflow, pytorch, onnx | squad-1.1 |
28
+ | dlrm | [ recommendation/dlrm] ( https://github.com/mlperf/inference/tree/r0.7/recommendation/dlrm/pytorch ) | pytorch, tensorflow(?), onnx(?) | Criteo Terabyte |
29
+ | 3d-unet | [ vision/medical_imageing/3d-unet] ( https://github.com/mlperf/inference/tree/r0.7/vision/medical_imaging/3d-unet ) | pytorch, tensorflow(?), onnx(?) | BraTS 2019 |
30
+ | rnnt | [ speech_recognition/rnnt] ( https://github.com/mlperf/inference/tree/r0.7/speech_recognition/rnnt ) | pytorch | OpenSLR LibriSpeech Corpus |
0 commit comments