Sign In

Latest Articles

324 articles · Fresh posts aggregated from independent blogs across the directory.

LLil'LogLil'Log·Jul 7, 2024

Extrinsic Hallucinations in LLMs

Hallucination in large language models usually refers to the model generating unfaithful, fabricated, inconsistent, or nonsensical content. As a term, hallucination has been somewhat generalized to cases when the model makes mistakes. Here, I would like to na…

lilianweng.github.ioRead article
LLil'LogLil'Log·Apr 12, 2024

Diffusion Models for Video Generation

Diffusion models have demonstrated strong results on image synthesis in past years. Now the research community has started working on a harder task—using it for video generation. The task itself is a superset of the image case, since an image is a video of 1…

lilianweng.github.ioRead article
LLil'LogLil'Log·Feb 5, 2024

Thinking about High-Quality Human Data

[Special thank you to Ian Kivlichan for many useful pointers (E.g. the 100+ year old Nature paper “Vox populi”) and nice feedback. 🙏 ] High-quality data is the fuel for modern data deep learning model training. Most of the task-specific labeled data comes fr…

lilianweng.github.ioRead article

Page 13 of 18 · 324 articles