Hey everyone!
My friend and I, are in our final year of university studying Computer Science and we built a model using Bart and T5 to generate comments for the AITA subreddit, trained on all the posts in AITA from 2013.
As part of the model evaluation, we created a survey to help us determine if the AI-generated responses are distinguishable from the model-generated comments.
Here is the link to the survey: https://forms.gle/zx7ShNyNDFSCaHXS9
The survey should take no longer than 10 minutes to complete. It contains 5 posts from the AITA subreddit, with 3 comments, for each post you are asked to rank the comments from best to worst. After which, you are asked to guess which comment is a human comment.
At the end of the survey, you will get feedback on your ability to guess human responses.
Your feedback is valuable and will contribute to our research.
A huge thank you in advance for your time and support!
We are planning to release the dataset of Reddit posts scraped from the subreddit and the models in the future, after we submit the model and it is assessed by the university.