You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Introduced a new blog post detailing the latest updates from the llm-d community, including a call for participation in a performance benchmarks survey, the launch of a new YouTube channel, and ways to get involved with the project.
Signed-off-by: Pete Cheslock <[email protected]>
Hey everyone! We've been making great progress with the llm-d project, and I wanted to share some important updates and opportunities to get involved.
18
18
19
+
## Help Shape Our Performance Benchmarks
20
+
21
+
The SIG-Benchmarking team is working on documenting real-world use cases and establishing performance expectations for llm-d deployments. To make this as comprehensive as possible, we need your help!
22
+
23
+
This survey is being conducted by researchers within Red Hat AI to better understand how organizations are evaluating, deploying, and monitoring GenAI applications in production environments. Your responses will help inform open research, tooling improvements, and best practices for the broader AI community.
24
+
25
+
:::tip Share Your Use Case
26
+
We've created a [Use Case Survey Form](https://docs.google.com/forms/d/e/1FAIpQLSefWpxlGNMN0NAj_4TzVLfSwTCyAz0gndNtLwoS9mamg5DtXw/viewform) to gather information about your LLM workloads. This will help us:
27
+
- Document common deployment patterns
28
+
- Establish realistic performance baselines
29
+
- Identify optimization opportunities
30
+
- Guide future development priorities
31
+
:::
32
+
33
+
Your input is invaluable in helping us understand:
34
+
- What models you're deploying
35
+
- Your workload characteristics (input/output lengths, request patterns)
36
+
- Performance requirements and constraints
37
+
- Current challenges and pain points
38
+
39
+
The survey takes approximately 10 minutes to complete. All responses are confidential and will be used in aggregated, anonymized form only.
40
+
41
+
As a thank-you, you'll be entered into a raffle to win a pair of Apple AirPods Pro (2nd Gen) upon submission.
42
+
43
+
<!-- truncate -->
44
+
19
45
## New YouTube Channel
20
46
21
47
We're excited to announce our new YouTube channel! We've been recording our SIG meetings and creating tutorial content to help you get started with llm-d.
@@ -35,27 +61,6 @@ Subscribe to get notified when new videos are posted, presentations, demos, and
35
61
/>
36
62
</div>
37
63
38
-
39
-
<!-- truncate -->
40
-
41
-
## Help Shape Our Performance Benchmarks
42
-
43
-
The SIG-Benchmarking team is working on documenting real-world use cases and establishing performance expectations for llm-d deployments. To make this as comprehensive as possible, we need your help!
44
-
45
-
:::tip Share Your Use Case
46
-
We've created a [Use Case Survey Form](https://forms.gle/YOUR_FORM_ID) to gather information about your LLM workloads. This will help us:
47
-
- Document common deployment patterns
48
-
- Establish realistic performance baselines
49
-
- Identify optimization opportunities
50
-
- Guide future development priorities
51
-
:::
52
-
53
-
Your input is invaluable in helping us understand:
54
-
- What models you're deploying
55
-
- Your workload characteristics (input/output lengths, request patterns)
56
-
- Performance requirements and constraints
57
-
- Current challenges and pain points
58
-
59
64
## Reminder: Join Our Google Group to Access Project Docs
0 commit comments