Which version of Transformers and Tensorflow were used in the script below?

iamkaustubhb1999 · January 4, 2023, 2:54pm

I see this is a 3 year old script , so can someone let me know which version of Transformers and Ternsorflow were used in the script below?

github.com

huggingface/tflite-android-transformers/blob/master/models_generation/gpt2.py

import tensorflow as tf
from transformers import TFGPT2LMHeadModel

model = TFGPT2LMHeadModel.from_pretrained('gpt2') # or 'distilgpt2'

input_spec = tf.TensorSpec([1, 64], tf.int32)
model._set_inputs(input_spec, training=False)

print(model.inputs)
print(model.outputs)

converter = tf.lite.TFLiteConverter.from_keras_model(model)

# For FP16 quantization:
# converter.optimizations = [tf.lite.Optimize.DEFAULT]
# converter.target_spec.supported_types = [tf.float16]

tflite_model = converter.convert()

open("gpt2-64.tflite", "wb").write(tflite_model)

Thanks

Topic		Replies	Views
Transformer for TF 1.15.0? 🤗Transformers	2	1346	February 18, 2022
GPT2 with TensorFlow? 🤗Transformers	1	330	November 14, 2020
How can we test Transformer Models after converting it to TFLite format Beginners	9	2881	March 26, 2024
How to load finetuned model in TF Beginners	2	357	September 28, 2020
[Tensorflow Export] How to export a fine tuned GPT2 model to a tensorflow model file? Beginners	1	411	January 15, 2021

Which version of Transformers and Tensorflow were used in the script below?

Related Topics