I am looking to convert this model which was trained in Megatron to be able to load in huggingface BERT model directly. Any quick ideas are welcome! GatorTron-OG | NVIDIA NGC GatorTron-OG is a Megatron BERT model trained on pre-trained on de-identified clinical notes from the University…

Converting NeMo megatron model to Huggingface bert model in pytorch

krish14388 February 13, 2023, 2:16pm 1

I am looking to convert this model which was trained in Megatron to be able to load in huggingface BERT model directly. Any quick ideas are welcome!

Topic		Replies	Views
Converting Nvidia models for Hugging Face Beginners	1	364	November 2, 2023
Fused Kernel Operations Intermediate	0	430	July 26, 2022
Discrepancy in Model Inference: Local vs. Hugging Face Model Hub 🤗Transformers	1	531	December 27, 2023
Trainer class optimization for transformer models Models	0	352	January 8, 2022
Batch Transform with Custom Infrastructure Amazon SageMaker	0	197	August 1, 2023