Can someone give me an example into using summarizationEvalutor into my code
I have a dataset that contains the text and summary and
have the following model
from transformers import BertTokenizer, AutoModelForSeq2SeqLM, pipeline
from arabert.preprocess import ArabertPreprocessor
model_name=“malmarjeh/mbert2mbert-arabic-text-summarization”
preprocessor = ArabertPreprocessor(model_name=“”)
tokenizer = BertTokenizer.from_pretrained(model_name)
model = AutoModelForSeq2SeqLM.from_pretrained(model_name)
pipeline = pipeline(“text2text-generation”,model=model,tokenizer=tokenizer)
text = "السلام عليكم كيف الحال اليوم "
text = preprocessor.preprocess(text)
How to compute rouge1 in all my data ! and thanks in advance!