Get a weekly rundown of the latest AI models and research... subscribe! https://aimodels.substack.com/

Bluebert_pubmed_mimic_uncased_L 24_H 1024_A 16

bionlp

๐ŸŒ

BlueBert-Base, Uncased, PubMed and MIMIC-III Model description A BERT model pre-trained on PubMed abstracts and clinical notes (MIMIC-III). Intended uses & limitations Please see https://github.com/ncbi-nlp/bluebert Training data We provide preprocessed PubMed texts that were used to pre-train the BlueBERT models. The corpus contains ~4000M words extracted from the PubMed ASCII code version. Pre-trained model: https://huggingface.co/bert-large-uncased Training procedure lowercasing the text removing speical chars \x00-\x7F tokenizing the text using the NLTK Treebank tokenizer Below is a code snippet for more details. BibTeX entry and citation info Acknowledgments This work was supported by the Intramural Research Programs of the National Institutes of Health, National Library of Medicine and Clinical Center. This work was supported by the National Library of Medicine of the National Institutes of Health under award number 4R00LM013001-01. We are also grateful to the authors of BERT and ELMo to make the data and codes publicly available. We would like to thank Dr Sun Kim for processing the PubMed texts. Disclaimer This tool shows the results of research conducted in the Computational Biology Branch, NCBI. The information produced on this website is not intended for direct diagnostic use or medical decision-making without review and oversight by a clinical professional. Individuals should not change their health behavior solely on the basis of information produced on this website. NIH does not independently verify the validity or utility of the information produced by this tool. If you have questions about the information produced on this website, please see a health care professional. More information about NCBI's disclaimer policy is available.

Pricing

Cost per run
$-
USD
Avg run time
-
Seconds
Hardware
-
Prediction

Creator Models

ModelCostRuns
Bluebert_pubmed_uncased_L 24_H 1024_A 16$?1,194
Bluebert_pubmed_mimic_uncased_L 12_H 768_A 12$?8,310
Bluebert_pubmed_uncased_L 12_H 768_A 12$?968

Similar Models

Model
No similar models found

Try it!

You can use this area to play around with demo applications that incorporate the Bluebert_pubmed_mimic_uncased_L 24_H 1024_A 16 model. These demos are maintained and hosted externally by third-party creators. If you see an error, message me on Twitter.

Currently, there are no demos available for this model.

Overview

Summary of this model and related resources.

PropertyValue
Creatorbionlp
Model NameBluebert_pubmed_mimic_uncased_L 24_H 1024_A 16
Description

BlueBert-Base, Uncased, PubMed and MIMIC-III Mo...

Read more ยป
Tags
Model LinkView on HuggingFace
API SpecView on HuggingFace
Github LinkNo Github link provided
Paper LinkNo paper link provided

Popularity

How popular is this model, by number of runs? How popular is the creator, by the sum of all their runs?

PropertyValue
Runs4,771
Model Rank
Creator Rank

Cost

How much does it cost to run this model? How long, on average, does it take to complete a run?

PropertyValue
Cost per Run$-
Prediction Hardware-
Average Completion Time-