Merge pull request #63 from matthewc2003/mlperf-inference-results-scc24

scc107 MLPerf submission

Author: arjunsuresh

open/scc107/code/bert-99/README.md

@@ -0,0 +1 @@
+TBD

open/scc107/measurements/mlperf2-reference-cpu-pytorch_v2.5.0-default_config/README.md

@@ -0,0 +1,3 @@
+| Model   | Scenario   |   Accuracy |   Throughput | Latency (in ms)   |
+|---------|------------|------------|--------------|-------------------|
+| bert-99 | offline    |    90.8749 |        5.422 | -                 |

open/scc107/measurements/mlperf2-reference-cpu-pytorch_v2.5.0-default_config/bert-99/offline/README.md

@@ -0,0 +1,69 @@
+This experiment is generated using the [MLCommons Collective Mind automation framework (CM)](https://github.com/mlcommons/cm4mlops).
+
+*Check [CM MLPerf docs](https://docs.mlcommons.org/inference) for more details.*
+
+## Host platform
+
+* OS version: Linux-6.8.0-1016-gcp-x86_64-with-glibc2.35
+* CPU version: x86_64
+* Python version: 3.10.12 (main, Sep 11 2024, 15:47:36) [GCC 11.4.0]
+* MLCommons CM version: 3.2.7
+
+## CM Run Command
+
+See [CM installation guide](https://docs.mlcommons.org/inference/install/).
+
+```bash
+pip install -U cmind
+
+cm rm cache -f
+
+cm pull repo mlcommons@cm4mlops --checkout=77882c5c9b87459e1ae38c796f7a443506074cdd
+
+cm run script \
+	- \
+	- \
+	a \
+	d \
+	r \
+	. \
+	p \
+	y \
+	t \
+	h \
+	o \
+	n \
+	. \
+	n \
+	a \
+	m \
+	e \
+	= \
+	m \
+	l \
+	p \
+	e \
+	r \
+	f
+```
+*Note that if you want to use the [latest automation recipes](https://docs.mlcommons.org/inference) for MLPerf (CM scripts),
+ you should simply reload mlcommons@cm4mlops without checkout and clean CM cache as follows:*
+
+```bash
+cm rm repo mlcommons@cm4mlops
+cm pull repo mlcommons@cm4mlops
+cm rm cache -f
+
+```
+
+## Results
+
+Platform: mlperf2-reference-cpu-pytorch_v2.5.0-default_config
+
+Model Precision: fp32
+
+### Accuracy Results 
+`F1`: `90.87487`, Required accuracy for closed division `>= 89.96526`
+
+### Performance Results 
+`Samples per second`: `5.42229`