FineWeb

Released by Huggingface. I found out about this through Karpathy’s general intro to LLM video.

https://huggingface.co/spaces/HuggingFaceFW/blogpost-fineweb-v1