Hi,
The easiest is to do it as explained in this guide: Convert Transformers to ONNX with Hugging Face Optimum. You can use torch.onnx.export, which is more low-level than Optimum.
Feel free to open an issue on the Optimum repository to add support for RT-DETR.