Sign In

Latest Articles

324 articles · Fresh posts aggregated from independent blogs across the directory.

Eethan的技术博客ethan的技术博客·Jan 7, 2023

写在28岁的中点

Dear Ethan: 又到了充满期待的新的一年,过去的一年你过得还好吗?在往年的年终总结中,你会对即将到来的一年许下满满的期待。很明显,去年的你又是欠下满满债务的你。选择在你28岁的中点写一封信给自己,这更私人,但也更贴近你的内心。 命途多舛,何以不甘 又一年的时间,你经历了不同的事情,遇到了不同的人,了解了不同的故事,现在轮到你说一说自己的故事了。也许都听过关于西西弗斯的故事,他的一生就是不断将巨石推到山顶,又不得不经受巨石滚落,再将石头推向山顶,这样一个荒诞的周而复始的故事。这也许,也是我们每一个人所需要经…

blog.ethan-ai.cnRead article
Eethan的技术博客ethan的技术博客·Jan 1, 2023

读《程序员修炼之道》

务实的哲学 团队信任对于创造力和协作至关重要,关键时刻信任的破坏几乎无法修复 提供选择,别找借口– 小黄鸭编程 破窗理论– 不要因为一些危急的事情,造成附加伤害,尽可能控制软件的熵 人们都觉得,加入一个推进中的成功项目更容易一些(煮石头汤的故事) 永远审视项目,不要做温水青蛙,先养成仔细观察周围环境的习惯,然后再项目中这样做 知识和经验是你最重要的资产,但是它们是时效资产,学习新事物的能力是你最重要的战略资产。 知识组合: 定期投资–安排一个固定的时间和地点学习 每年学习一门新语言 每月读一本技术书 读非技术书…

blog.ethan-ai.cnRead article
HHello World: Re-ActHello World: Re-Act·Oct 30, 2022

Joyqi 在 COSCon'22 的演讲:Answer 开源背后的故事

2022 年 10 月 30 日,我的技术合伙人,开源问答社区软件 Answer 项目联合创始人 Joyqi 受邀在 COSCon'22 中国开源年会进行了主题分享,介绍了他对 Answer 项目的思考。以下是分享内容的文字记录版本。 Hi,大家好,我是来自 SegmentFault 的 Joyqi。很高兴这次有机会能在中国开源年会跟大家一起分享。 SegmentFault 是一个以问答形式为主体

gaoyang.devRead article
The Illustrated Stable Diffusion
JJay AlammarJay Alammar·Oct 4, 2022

The Illustrated Stable Diffusion

Translations: Chinese, Vietnamese. (V2 Nov 2022: Updated images for more precise description of forward diffusion. A few more images in this version) AI image generation is the most recent AI capability blowing people’s minds (mine included). The ability to c…

jalammar.github.ioRead article
LLil'LogLil'Log·Sep 8, 2022

Some Math behind Neural Tangent Kernel

Neural networks are well known to be over-parameterized and can often easily fit data with near-zero training loss with decent generalization performance on test dataset. Although all these parameters are initialized at random, the optimization process can co…

lilianweng.github.ioRead article
LLil'LogLil'Log·Jun 9, 2022

Generalized Visual Language Models

Processing images to generate text, such as image captioning and visual question-answering, has been studied for years. Traditionally such systems rely on an object detection network as a vision encoder to capture visual features and then produce text via a t…

lilianweng.github.ioRead article

致思否社区开发者:归零进一

这是一篇我技术合伙人 joyqi 为 ONES 收购 SegmentFault 社区撰写的文章,原文刊发在此,这篇文章也表达了一些他 10 年创业生涯的一些小小的感想,全文摘录如下。 各位 SegmentFault 思否社区的小伙伴们,相信大家已经从多个渠道了解到 SegmentFault 将加入 ONES 的消息。而今年正好也是 SegmentFault 社区创立的10周年,有趣的是“10”这个

gaoyang.devRead article
LLil'LogLil'Log·Apr 15, 2022

Learning with not Enough Data Part 3: Data Generation

Here comes the Part 3 on learning with not enough data (Previous: Part 1 and Part 2). Let’s consider two approaches for generating synthetic data for training. Augmented data. Given a set of existing training samples, we can apply a variety of augmentation, d…

lilianweng.github.ioRead article
LLil'LogLil'Log·Feb 20, 2022

Learning with not Enough Data Part 2: Active Learning

This is part 2 of what to do when facing a limited amount of labeled data for supervised learning tasks. This time we will get some amount of human labeling work involved, but within a budget limit, and therefore we need to be smart when selecting which sampl…

lilianweng.github.ioRead article
The Illustrated Retrieval Transformer
JJay AlammarJay Alammar·Jan 3, 2022

The Illustrated Retrieval Transformer

Discussion: Discussion Thread for comments, corrections, or any feedback. Translations: Korean, Russian Summary: The latest batch of language models can be much smaller yet achieve GPT-3 like performance by being able to query a database or search the web for…

jalammar.github.ioRead article
LLil'LogLil'Log·Jul 11, 2021

What are Diffusion Models?

[Updated on 2021-09-19: Highly recommend this blog post on score-based generative modeling by Yang Song (author of several key papers in the references)]. [Updated on 2022-08-27: Added classifier-free guidance, GLIDE, unCLIP and Imagen. [Updated on 2022-08-31…

lilianweng.github.ioRead article
LLil'LogLil'Log·May 31, 2021

Contrastive Representation Learning

The goal of contrastive representation learning is to learn such an embedding space in which similar sample pairs stay close to each other while dissimilar ones are far apart. Contrastive learning can be applied to both supervised and unsupervised settings. W…

lilianweng.github.ioRead article
Explainable AI Cheat Sheet
JJay AlammarJay Alammar·May 4, 2021

Explainable AI Cheat Sheet

Introducing the Explainable AI Cheat Sheet, your high-level guide to the set of tools and methods that helps humans understand AI/ML models and their predictions. I introduce the cheat sheet in this brief video:

jalammar.github.ioRead article
LLil'LogLil'Log·Mar 21, 2021

Reducing Toxicity in Language Models

Large pretrained language models are trained over a sizable collection of online data. They unavoidably acquire certain toxic behavior and biases from the Internet. Pretrained language models are very powerful and have shown great success in many NLP tasks. H…

lilianweng.github.ioRead article

Page 15 of 18 · 324 articles