Gpt-neo 27 and 13

When I run on my CPU everything is fine, but when I run on my GPU, I get garbage. Is this the correct syntax?

generator = pipeline('text-generation', model='EleutherAI/gpt-neo-2.7B', device=1)