I am wondering if there is a way to import custom HuggingFace Models in EMR and leverage PySpark.
I am trying to use the PatentSBERTa Model in EMR with PySpark and was wondering if anyone has been able to run it with SparkNLP. Alternatively, is there a way to import custom HuggingFace models in EMR to use with PySpark. Currently SparkNLP doesn’t support PatentSBERTa.
Any help would be really appreciated! Thank you!!