SambaNova
客户正转向 SambaNova 快速部署先进的 AI 能力以获得竞争优势。我们专为企业规模设计的 AI 平台是下一代 AI 计算的核心技术基础。我们为解锁数据中隐藏的宝贵商业洞察提供动力。
Designed for AI, the SambaNova RDU was built with a revolutionary dataflow architecture. This design makes the RDU significantly more efficient for these workloads than GPUs as it eliminates redundant calls to memory, which are an inherent limitation of how GPUs function. This built-in efficiency is one of the features that makes the RDU capable of much higher performance than GPUs in a fraction of the footprint.
在我们的架构之上,我们开发了一些平台,使公司和开发者能够充分利用RDU处理器和开源模型。
LangChainAI开发框架
SambaNova的SambaNova云平台是一个用于运行开源模型推断的平台
您可以在此处获得免费的SambaNovaCloud API密钥这里
SambaStudio
SambaNova的SambaStudio是一个功能丰富的图形用户界面平台,提供了在SambaNova DataScale系统中训练、部署和管理模型的功能。
安装与设置¶
安装集成包:
pip install langchain-sambanova
设置您的API密钥作为环境变量:
如果贵司是SambaNovaCloud用户:
export SAMBANOVA_API_KEY="your-sambanova-cloud-api-key-here"
如果阁下是SambaStudio用户
export SAMBASTUDIO_API_KEY="your-sambastudio-api-key-here"
聊天模型
from langchain_sambanova import ChatSambaNovaCloud
llm = ChatSambaNovaCloud(model="Meta-Llama-3.3-70B-Instruct", temperature=0.7)
llm.invoke("Tell me a joke about artificial intelligence.")
欲了解ChatSambaNovaCloud组件的更详细教程,请参见此笔记本
from langchain_sambanova import ChatSambaStudio
llm = ChatSambaStudio(model="Meta-Llama-3.3-70B-Instruct", temperature=0.7)
llm.invoke("Tell me a joke about artificial intelligence.")
要详细了解ChatSambaStudio组件,请参阅此笔记本
嵌入模型
from langchain_sambanova import SambaNovaCloudEmbeddings
embeddings = SambaNovaCloudEmbeddings(model="E5-Mistral-7B-Instruct")
embeddings.embed_query("What is the meaning of life?")
要详细了解SambaStudioEmbeddings组件,请参阅此笔记本
from langchain_sambanova import SambaStudioEmbeddings
embeddings = SambaStudioEmbeddings(model="e5-mistral-7b-instruct")
embeddings.embed_query("What is the meaning of life?")
要详细了解SambaStudioEmbeddings组件,请参阅此笔记本
API参考 langchain-sambanova