Skip to content
GitLab

[Cleanup] Deleting more unused methods, mainly from *utils files

Merged Administrator requested to merge susan/clean_oct15_unused1 into main

Created by: suchenzang

From file_utils, removed:

  • filename_to_url
  • read_set_from_file
  • get_file_extension

From file_io, removed:

  • save_json
  • load_json
  • load_jsonl

Remove tokenizer file and move the single method of tokenize_line into top level utils.py.

From top level utils.py, removed:

  • round_safe
  • eval_str_list
  • deprecation_warning
  • post_process_prediction
  • load_embedding
  • FileContentsAction class
  • get/set_incremental_state
  • parse_embedding