filmov
tv
Handshake's Approach to Content Tagging with vLLM and Anyscale | Ray Summit 2024
Показать описание
Handshake has recently been exploring vLLM-based content tagging to enhance the job feed. At Ray Summit 2024, Kyle Gallatin and Nabil Ahmed from Handshake present Handshake's journey in implementing an internally hosted LLM on Anyscale to address their content tagging needs.
The speakers detail how LLM-based content tagging significantly improved their product's overall performance. They share insights into their specific methodology and workflow for deploying LLM services internally. The presentation also covers Handshake's development of an in-house tool designed to abstract LLM use cases and backends, addressing their rapidly growing LLM requirements. This session offers practical insights for companies looking to integrate LLM technologies into their product ecosystems, particularly for content optimization and management.
--
Interested in more?
--
🔗 Connect with us:
The speakers detail how LLM-based content tagging significantly improved their product's overall performance. They share insights into their specific methodology and workflow for deploying LLM services internally. The presentation also covers Handshake's development of an in-house tool designed to abstract LLM use cases and backends, addressing their rapidly growing LLM requirements. This session offers practical insights for companies looking to integrate LLM technologies into their product ecosystems, particularly for content optimization and management.
--
Interested in more?
--
🔗 Connect with us:
0:39:24
0:41:26
0:00:16
0:00:15
0:28:15
0:48:54
0:00:38
0:04:58
0:50:38
0:37:00
0:10:29
0:00:28
0:07:23
0:00:55
0:16:55
0:05:54
0:00:55
0:53:53
0:03:12
0:10:18
0:02:00
0:41:43
0:01:57
0:10:53