DPO Converter

Instructions:

1. Prepare a CSV or Excel file with columns: prompt, preferred_output, and non_preferred_output.
2. Drag and drop your file into the area below.
3. Once processed, a download link for the DPO-formatted data.jsonl file will appear.