Getting models to output structured JSON

I want to get the result in JSON format.

dataset
[
{“instruction”:“Create 5 best course titles for”,“input”:“To equip first-year college students with essential time management skills and strategies tailored to the unique challenges they face in this new academic environment.”,“output”:“[{"title":"Mastering College: Essential Time Management Strategies for First-Year Students"},{"title":"Freshman Success: Navigating New Academic Waters through Efficient Time Management"},{"title":"Time Mastery 101: Empowering Freshmen for Academic Achievement"},{"title":"College Thrive: Time Management Solutions for First-Year Challenges"},{"title":"Smart Start: Time Management Techniques for Academic Success in Your First Year"}]”},
{“instruction”:“Create 5 best course titles for”,“input”:“To equip learners with advanced Python programming skills and techniques essential for proficiently conducting data analysis, interpretation, and visualization in diverse data science applications.”,“output”:“[{"title":"Advanced Python Mastery for Data Analysis and Visualization"},{"title":"Python Excellence: Data Interpretation and Analytic Techniques"},{"title":"Mastering Python: Techniques for High-Level Data Science Applications"},{"title":"Pro Python Analytics: Deep Dive into Data Analysis and Visualization"},{"title":"Python Data Science Pro: Advanced Strategies for Data Interpretation and Visualization"}]”},
{“instruction”:“Create 5 best course titles for”,“input”:“to empower participants with no prior experience with comprehensive knowledge and practical skills in web development, enabling them to build modern, responsive, and dynamic websites and applications.”,“output”:“[{"title":"Web Development Foundations: Crafting Responsive and Dynamic Websites from Scratch"},{"title":"Zero to Hero: Comprehensive Web Development for Beginners"},{"title":"Practical Web Creation: A Beginners Guide to Modern and Responsive Web Development"},{"title":"Intro to Dynamic Web Development: Empowering Novices to Build Modern Web Applications"},{"title":"Essential Web Skills: A Complete Guide for Creating Responsive and Dynamic Websites for Beginners"}]”}
]

After training the above dataset using trl, I would like to have the following results.

Prompt : Create 5 best course titles for teach students with profound knowledge and advanced technical skills in machine learning and artificial intelligence, enabling them to develop innovative solutions for complex problems in various domains.

Output:
[
{“title”:“Mastering College: Essential Time Management Strategies for First-Year Students”},
{“title”:“Freshman Success: Navigating New Academic Waters through Efficient Time Management”},
{“title”:“Time Mastery 101: Empowering Freshmen for Academic Achievement”},
{“title”:“College Thrive: Time Management Solutions for First-Year Challenges”},
{“title”:“Smart Start: Time Management Techniques for Academic Success in Your First Year”}
]

Appreciate any suggestions and useful links

existing LLMs can generate such data in the Instruct mode; Google to learn more!