FineData

community

AI & ML interests

We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)

Recent Activity

guipenedo new activity 1 day ago

HuggingFaceFW/finepdfs:Were the original PDFs saved?

guipenedo new activity 2 days ago

HuggingFaceFW/finepdfs:您好，中文，在data下哪个文件夹下

guipenedo updated a dataset 2 days ago

HuggingFaceFW/finepdfs

View all activity

HuggingFaceFW 's models 30

HuggingFaceFW/fineweb-edu-classifier

Text Classification • 0.1B • Updated Nov 17, 2024 • 15.4k • • 193

HuggingFaceFW/Datasets-Metrics-Viewer-Data

Updated Sep 2, 2024

HuggingFaceFW/ablation-model-fineweb-edu

Text Generation • 2B • Updated Jun 11, 2024 • 1.13k • 16

HuggingFaceFW/ablation-exp-filter-custom-all_filters-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 7 • 1

HuggingFaceFW/ablation-exp-filter-custom-line_char_duplicated_0.01-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 6 • 2

HuggingFaceFW/ablation-exp-filter-custom-line_ratio_0.67-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 6

HuggingFaceFW/ablation-exp-filter-custom-lines_punct_0.12-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 8 • 3

HuggingFaceFW/ablation-exp-filter-baseline_c4-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 7 • 2

HuggingFaceFW/ablation-exp-filter-baseline_cc-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 8 • 4

HuggingFaceFW/ablation-exp-filter-c4-word_lengths-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 8 • 2

HuggingFaceFW/ablation-exp-filter-c4-tpunct-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 6 • 1

HuggingFaceFW/ablation-exp-filter-c4-curly_bracket-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 6

HuggingFaceFW/ablation-exp-filter-c4-all-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 5

HuggingFaceFW/ablation-exp-filter-c4-all_except_tpunct-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 7

HuggingFaceFW/ablation-exp-textext-wet-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 5

HuggingFaceFW/ablation-exp-textext-warc_trafilatura-28BT

Text Generation • 2B • Updated Jun 4, 2024 • 6

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_line-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 6

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_3line-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 6

HuggingFaceFW/ablation-exp-fw-base_filt-ind_mh-c4_filters-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 7

HuggingFaceFW/ablation-exp-dedup-ind_mh-global_line_minwords-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 9

HuggingFaceFW/ablation-exp-dedup-independent_minhash-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 6

HuggingFaceFW/ablation-exp-fw-base_filtering-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 6

HuggingFaceFW/ablation-exp-dedup-global_minhash-350BT

Text Generation • 2B • Updated Jun 4, 2024 • 7

HuggingFaceFW/ablation-model-redpajama2

Text Generation • 2B • Updated May 5, 2024 • 6

HuggingFaceFW/ablation-model-the-pile

Text Generation • 2B • Updated Apr 25, 2024 • 8 • 1

HuggingFaceFW/ablation-model-slimpajama

Text Generation • 2B • Updated Apr 25, 2024 • 6 • 2

HuggingFaceFW/ablation-model-dolma-v1_6

Text Generation • 2B • Updated Apr 25, 2024 • 7 • 2

HuggingFaceFW/ablation-model-c4

Text Generation • 2B • Updated Apr 25, 2024 • 9 • 4

HuggingFaceFW/ablation-model-refinedweb

Text Generation • 2B • Updated Apr 25, 2024 • 6 • 3

HuggingFaceFW/ablation-model-fineweb-v1

Text Generation • 2B • Updated Apr 25, 2024 • 32 • 14