对python中的句子相似性排序

Question

我试图找到标记文档的句子和将结果保存在列表中的句子之间的相似性。我想根据相似性分数对结果进行排序。当我尝试根据相似性分数对输出进行分类时，会出现错误吗？

results=[]


#embedding all the documents and find the similarity between search text and all the tokenize sentences
for docs_sent_token in docs_sent_tokens:
   sentence_embeddings = model.encode(docs_sent_token)
   sim_score1 = cosine_sim(search_sentence_embeddings, sentence_embeddings)
   if sim_score1 > 0:
               results.append({
                   sim_score1,
                   docs_sent_token,
               })
   results.sort(key=lambda k : k['sim_score1'] , reverse=True)
print(results)

这是我遇到的错误。

TypeError: 'set' object is not subscriptable

可以使用字典解决此问题。

if sim_score1 > 0:
                results.append({
                    'Score':sim_score1,
                    'Token':docs_sent_token,
                })
    results.sort(key=lambda k : k['Score'] , reverse=True)
print(results)

但是，有什么可能的方法可以使用列表完成分类？我想以这种格式获得结果。

[{0.91, 'Sentence 1'}, {0.87, 'Sentence 2'}, {0.33, 'Sentence 3'}, {0.30, 'Sentence 4'},

Answer 1

set s没有索引或密钥来指示要排序的值。您可以创建元组 s或dict s的列表，对其进行排序，然后将其转换为set s稍后

results.append((
    sim_score1,
    docs_sent_token
))

# results = [(0.91, 'Sentence 1'), (0.33, 'Sentence 3'), (0.87, 'Sentence 2'), (0.30, 'Sentence 4')]
results.sort(key=lambda k: k[0], reverse=True)
results = [set(t) for t in results]

# or

results.append({
    'Score': sim_score1,
    'Token': docs_sent_token
})

# results = [{'Score': 0.91, 'Token': 'Sentence 1'}, {'Score': 0.33, 'Token': 'Sentence 3'}, {'Score': 0.87, 'Token': 'Sentence 2'}, {'Score': 0.30, 'Token': 'Sentence 4'}]
results.sort(key=lambda k: k['Score'], reverse=True)
results = [set(d.values()) for d in results]

print(results)

输出

[{0.91, 'Sentence 1'}, {0.87, 'Sentence 2'}, {0.33, 'Sentence 3'}, {0.3, 'Sentence 4'}]