Request for Guide/Material on DPO Alignment for Phi3.5-Vision Model

[ladanisavan]

Hi,

Thank you for your incredible work and for sharing it!

I was wondering if there is any guide or material available on how to perform DPO alignment on the Phi 3.5-Vision model?
Any resources or pointers would be greatly appreciated.

Thanks!