I’m trying to convert a modified bert embedding back to text.
I’m shooting for a pipeline like the following:
- Bert Base Uncased
- Add noise to output tensor
- Attempt to reconstruct original text
I’m somewhat lost on step 5. I have a perturbed torch tensor but how do I convert that back to a sentence? I’m guessing with some logit layer that using the same vocabulary as the tokenizer?
Thanks in advance!