direct-preference-optimization 12 large-language-models 5 supervised-finetuning 5 llm 4 pytorch 3 natural-language-processing 3 transformers 3 deep-learning 3 lora 2 artificial-intelligence 2 trl 2 huggingface 2 reinforcement-learning 2 alignment 2 dpo 2 llms 2 llm-training 1 machine-learning 1 python 1 reinforcement-learning-from-human-feedback 1 alignment-strategies 1 bioinformatics 1 chest-xrays 1 medical-image-analysis 1 preference-learning 1 radiology-report-generation 1 transformer 1 finetuning-llms 1 in-context-learning 1 reproducibility 1 scientometrics 1 aaai2025 1 dense-video-captioning 1 long-video-understanding 1 multimodal-large-language-models 1 large-language-model 1 llm-steering 1 mech-interp 1 phi-4 1 phi-4-mini 1 phi4 1 phi4-mini 1 pivotal-token-search 1 pivotal-tokens 1 reasoning-agent 1 reasoning-language-models 1 reasoning-models 1 sae 1 sparse-autoencoder 1 steering-vector 1 tokens 1 llm-inference 1 human-feedback 1 paraphrase-generation 1 paraphrase-type-generation 1 dataset-generation 1 survey 1 redteam 1 review 1