Skip to main content
Open In Colab在 GitHub 上打开

泰尔

Tair 是由Alibaba Cloud. 它提供丰富的数据模型和企业级功能,以支持您的实时在线场景,同时保持与开源的完全兼容性Redis.Tair此外,还推出了基于新的非易失性内存 (NVM) 存储介质的持久内存优化型实例。

此笔记本展示了如何使用与Tairvector 数据库。

您需要安装langchain-communitypip install -qU langchain-community使用此集成

要运行,您应该有一个Tair实例启动并运行。

from langchain_community.embeddings.fake import FakeEmbeddings
from langchain_community.vectorstores import Tair
from langchain_text_splitters import CharacterTextSplitter
from langchain_community.document_loaders import TextLoader

loader = TextLoader("../../how_to/state_of_the_union.txt")
documents = loader.load()
text_splitter = CharacterTextSplitter(chunk_size=1000, chunk_overlap=0)
docs = text_splitter.split_documents(documents)

embeddings = FakeEmbeddings(size=128)
API 参考:TextLoader

使用 Tair 的TAIR_URL环境变量

export TAIR_URL="redis://{username}:{password}@{tair_address}:{tair_port}"

或 keyword 参数tair_url.

然后将文档和嵌入内容存储到 Tair 中。

tair_url = "redis://localhost:6379"

# drop first if index already exists
Tair.drop_index(tair_url=tair_url)

vector_store = Tair.from_documents(docs, embeddings, tair_url=tair_url)

查询相似文档。

query = "What did the president say about Ketanji Brown Jackson"
docs = vector_store.similarity_search(query)
docs[0]

Tair Hybrid Search 索引构建

# drop first if index already exists
Tair.drop_index(tair_url=tair_url)

vector_store = Tair.from_documents(
docs, embeddings, tair_url=tair_url, index_params={"lexical_algorithm": "bm25"}
)

Tair 混合搜索

query = "What did the president say about Ketanji Brown Jackson"
# hybrid_ratio: 0.5 hybrid search, 0.9999 vector search, 0.0001 text search
kwargs = {"TEXT": query, "hybrid_ratio": 0.5}
docs = vector_store.similarity_search(query, **kwargs)
docs[0]