Steps Gallery

• DeitaFiltering

  ---

  Filter dataset rows using DEITA filtering strategy.

  DeitaFiltering

• PushToHub

  ---

  Push data to a Hugging Face Hub dataset.

  PushToHub

• PreferenceToArgilla

  ---

  Creates a preference dataset in Argilla.

  PreferenceToArgilla

• TextGenerationToArgilla

  ---

  Creates a text generation dataset in Argilla.

  TextGenerationToArgilla

• CombineColumns

  ---

  Combines columns from a list of StepInput.

  CombineColumns

• ExpandColumns

  ---

  Expand columns that contain lists into multiple rows.

  ExpandColumns

• ConversationTemplate

  ---

  Generate a conversation template from an instruction and a response.

  ConversationTemplate

• FormatTextGenerationDPO

  ---

  Format the output of your LLMs for Direct Preference Optimization (DPO).

  FormatTextGenerationDPO

• FormatChatGenerationDPO

  ---

  Format the output of a combination of a ChatGeneration + a preference task such as

  FormatChatGenerationDPO

• FormatTextGenerationSFT

  ---

  Format the output of a TextGeneration task for Supervised Fine-Tuning (SFT).

  FormatTextGenerationSFT

• FormatChatGenerationSFT

  ---

  Format the output of a ChatGeneration task for Supervised Fine-Tuning (SFT) following the

  FormatChatGenerationSFT

• KeepColumns

  ---

  Keeps selected columns in the dataset.

  KeepColumns

• LoadDataFromDicts

  ---

  Loads a dataset from a list of dictionaries.

  LoadDataFromDicts

• LoadDataFromHub

  ---

  Loads a dataset from the Hugging Face Hub.

  LoadDataFromHub

• LoadHubDataset

  ---

  LoadHubDataset

• LoadDataFromFileSystem

  ---

  Loads a dataset from a file in your filesystem.

  LoadDataFromFileSystem

• LoadDataFromDisk

  ---

  Load a dataset that was previously saved to disk.

  LoadDataFromDisk