AI is happening. The future is updating.information-content-model
The model is for use by the Onyx Enterprise Search system to identify whether a short text segment contains information that could be useful by itself to answer a RAG-type question. It is based on the SetFit approach, using sentence-transformers/paraphrase-mpnet-base-v2 as the Sentence Transformer embedding model. A trained LogisticRegression instance is used for classification. 1. Fine-tuning a Sentence Transformer with contrastive learning. 2. Training a classification head with features from the fine-tuned Sentence Transformer.
The model is for use by the Onyx Enterprise Search system to identify whether a short text segment contains information that could be useful by itself to answer a RAG-type question. It is based on the SetFit approach, using sentence-transformers/paraphrase-mpnet-base-v2 as the Sentence Transformer embedding model. A trained LogisticRegression instance is used for classification. 1. Fine-tuning a Sentence Transformer with contrastive learning. 2. Training a classification head with features from the fine-tuned Sentence Transformer.