I am looking to convert this model which was trained in Megatron to be able to load in huggingface BERT model directly. Any quick ideas are welcome! GatorTron-OG | NVIDIA NGC GatorTron-OG is a Megatron BERT model trained on pre-trained on de-identified clinical notes from the University…

Converting NeMo megatron model to Huggingface bert model in pytorch

krish14388 February 13, 2023, 2:16pm 1

I am looking to convert this model which was trained in Megatron to be able to load in huggingface BERT model directly. Any quick ideas are welcome!

Topic		Replies	Views
Converting Nvidia models for Hugging Face Beginners	1	457	November 2, 2023
Fused Kernel Operations Intermediate	0	565	July 26, 2022
Is Google's official BERT model and huggingface BERT model different or same? Beginners	1	1166	March 9, 2022
Discrepancy in Model Inference: Local vs. Hugging Face Model Hub 🤗Transformers	1	773	December 27, 2023
Trainer class optimization for transformer models Models	0	411	January 8, 2022