tpo-alignment
/

Mistral-7B-TPO-40k

Model card Files Files and versions

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

This is a model released from the preprint: Triple Preference Optimization: Achieving Better Alignment using a Single Step Optimization. Please refer to our repository for more details.

Downloads last month: 2

Safetensors

Model size

7B params

Tensor type

F32

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for tpo-alignment/Mistral-7B-TPO-40k

Triple Preference Optimization: Achieving Better Alignment with Less Data in a Single Step Optimization

Paper • 2405.16681 • Published May 26, 2024 • 1