Get a weekly rundown of the latest AI models and research... subscribe!

Bluebert_pubmed_mimic_uncased_L 24_H 1024_A 16



BlueBert-Base, Uncased, PubMed and MIMIC-III Model description A BERT model pre-trained on PubMed abstracts and clinical notes (MIMIC-III). Intended uses & limitations Please see Training data We provide preprocessed PubMed texts that were used to pre-train the BlueBERT models. The corpus contains ~4000M words extracted from the PubMed ASCII code version. Pre-trained model: Training procedure lowercasing the text removing speical chars \x00-\x7F tokenizing the text using the NLTK Treebank tokenizer Below is a code snippet for more details. BibTeX entry and citation info Acknowledgments This work was supported by the Intramural Research Programs of the National Institutes of Health, National Library of Medicine and Clinical Center. This work was supported by the National Library of Medicine of the National Institutes of Health under award number 4R00LM013001-01. We are also grateful to the authors of BERT and ELMo to make the data and codes publicly available. We would like to thank Dr Sun Kim for processing the PubMed texts. Disclaimer This tool shows the results of research conducted in the Computational Biology Branch, NCBI. The information produced on this website is not intended for direct diagnostic use or medical decision-making without review and oversight by a clinical professional. Individuals should not change their health behavior solely on the basis of information produced on this website. NIH does not independently verify the validity or utility of the information produced by this tool. If you have questions about the information produced on this website, please see a health care professional. More information about NCBI's disclaimer policy is available.


Cost per run
Avg run time

Creator Models

Bluebert_pubmed_uncased_L 24_H 1024_A 16$?1,194
Bluebert_pubmed_mimic_uncased_L 12_H 768_A 12$?8,310
Bluebert_pubmed_uncased_L 12_H 768_A 12$?968

Similar Models

No similar models found

Try it!

You can use this area to play around with demo applications that incorporate the Bluebert_pubmed_mimic_uncased_L 24_H 1024_A 16 model. These demos are maintained and hosted externally by third-party creators. If you see an error, message me on Twitter.

Currently, there are no demos available for this model.


Summary of this model and related resources.

Model NameBluebert_pubmed_mimic_uncased_L 24_H 1024_A 16

BlueBert-Base, Uncased, PubMed and MIMIC-III Mo...

Model LinkView on HuggingFace
API SpecView on HuggingFace
Github LinkNo Github link provided
Paper LinkNo paper link provided


How popular is this model, by number of runs? How popular is the creator, by the sum of all their runs?

Model Rank
Creator Rank


How much does it cost to run this model? How long, on average, does it take to complete a run?

Cost per Run$-
Prediction Hardware-
Average Completion Time-