Rdr Question_encoder Single Nq Base

soheeyang

rdr-question_encoder-single-nq-base

rdr-question_encoder-single-nq-base Reader-Distilled Retriever (RDR) Sohee Yang and Minjoon Seo, Is Retriever Merely an Approximator of Reader?, arXiv 2020 The paper proposes to distill the reader into the retriever so that the retriever absorbs the strength of the reader while keeping its own benefit. The model is a DPR retriever further finetuned using knowledge distillation from the DPR reader. Using this approach, the answer recall rate increases by a large margin, especially at small numbers of top-k. This model is the question encoder of RDR trained solely on Natural Questions (NQ) (single-nq). This model is trained by the authors and is the official checkpoint of RDR. Performance The following is the answer recall rate measured using PyTorch 1.4.0 and transformers 4.5.0. The values of DPR on the NQ dev set are taken from Table 1 of the paper of RDR. The values of DPR on the NQ test set are taken from the codebase of DPR. DPR-adv is the a new DPR model released in March 2021. It is trained on the original DPR NQ train set and its version where hard negatives are mined using DPR index itself using the previous NQ checkpoint. Please refer to the codebase of DPR for more details about DPR-adv-hn. How to Use RDR shares the same architecture with DPR. Therefore, It uses DPRQuestionEncoder as the model class. Using AutoModel does not properly detect whether the checkpoint is for DPRContextEncoder or DPRQuestionEncoder. Therefore, please specify the exact class to use the model.
feature-extraction

Pricing

Cost per run
$-
USD
Avg run time
-
Seconds
Hardware
-
Prediction

Creator Models

ModelCostRuns
Rdr Ctx_encoder Single Nq Base$?1,701
Rdr Question_encoder Single Trivia Base$?13
Dpr Question_encoder Single Trivia Base$?9
Rdr Ctx_encoder Single Trivia Base$?0
Dpr Ctx_encoder Single Trivia Base$?0

Similar Models

Try it!

You can use this area to play around with demo applications that incorporate the Rdr Question_encoder Single Nq Base model. These demos are maintained and hosted externally by third-party creators. If you see an error, message me on Twitter.

Currently, there are no demos available for this model.

Overview

Summary of this model and related resources.

PropertyValue
Creatorsoheeyang
Model NameRdr Question_encoder Single Nq Base
Description

rdr-question_encoder-single-nq-base Reader-Distilled Retrie...

Read more »
Tagsfeature-extraction
Model LinkView on HuggingFace
API SpecView on HuggingFace
Github LinkNo Github link provided
Paper LinkNo paper link provided

Popularity

How popular is this model, by number of runs? How popular is the creator, by the sum of all their runs?

PropertyValue
Runs1,864
Model Rank
Creator Rank

Cost

How much does it cost to run this model? How long, on average, does it take to complete a run?

PropertyValue
Cost per Run$-
Prediction Hardware-
Average Completion Time-