Weights & Biases LLM-Evaluator Hackathon - Hackathon Judge
Being a human judge at the Weights & Biases LLM-as-a-Judge Hackathon
324 articles · Fresh posts aggregated from independent blogs across the directory.
Being a human judge at the Weights & Biases LLM-as-a-Judge Hackathon
FastAPI, FastHTML, Next.js, SvelteKit, and thoughts on how coding assistants influence builders' choices.
Use cases, techniques, alignment, finetuning, and critiques against LLM-evaluators.
Hallucination in large language models usually refers to the model generating unfaithful, fabricated, inconsistent, or nonsensical content. As a term, hallucination has been somewhat generalized to cases when the model makes mistakes. Here, I would like to na…
What to interview for, how to structure the phone screen, interview loop, and debrief, and a few tips.
Special double-feature closing keynote from the 6 authors of the hit O'Reilly article on Applied LLMs.
Challenges and lessons from deploying LLM experiences: evals, scalability, guardrails.
Structured input/output, prefilling, n-shots prompting, chain-of-thought, reducing hallucinations, etc.
From the tactical nuts & bolts to the operational day-to-day to the long-term business strategy.
Diffusion models have demonstrated strong results on image synthesis in past years. Now the research community has started working on a harder task—using it for video generation. The task itself is a superset of the image case, since an image is a video of 1…
Building an AI coach with speech-to-text, text-to-speech, an LLM, and a virtual number.
Evals for classification, summarization, translation, copyright regurgitation, and toxicity.
How unit testing machine learning code differs from typical software practices
Overcoming the bottleneck of human annotations in instruction-tuning, preference-tuning, and pretraining.
[Special thank you to Ian Kivlichan for many useful pointers (E.g. the 100+ year old Nature paper “Vox populi”) and nice feedback. 🙏 ] High-quality data is the fuel for modern data deep learning model training. Most of the task-specific labeled data comes fr…
Some fundamental papers and a one-sentence summary for each; start your own paper club!
An expanded charter, lots of writing and speaking, and finally learning to snowboard.
Sending helpful & engaging pushes, filtering annoying pushes, and finding the frequency sweet spot.