
Inference engineering for software engineers
When is the right time to drop APIs provided by the frontier AI labs, and what about choosing models & providers, caching, dedicated GPUs, KV cache concerns, and more? A practical deepdive
3033 articles · Fresh posts aggregated from independent blogs across the directory.

When is the right time to drop APIs provided by the frontier AI labs, and what about choosing models & providers, caching, dedicated GPUs, KV cache concerns, and more? A practical deepdive

Distributed systems are hard to test because partial failures overlap with live traffic and the same fault can produce different execution traces on different runs. Unmesh Joshi describes how deterministic simulation testing addresses this by replacing real c…

车 - 保养又是一年几度的保养时间,从原来的半合成换成了全合成,1w公里保养一次,上次还是四月份,好几个月了,还行,之前五千公里动不动就要去,烦都烦死了。买的是保养券,挺划算的,多少钱我忘了,反...
1. Luka has become a very good player. Defense is much better too. 2. No comment. 3. Did England bribe Scotland into political union? 4. Survey article on the economics of mental health, one of the most important and understudied areas. 5. Science isn’t just…

Today's links Remembrance of proteins past: People like what they like. Hey look at this: Delights to delectate. Object permanence: BBC's bullshit DRM story; Radical hotel-room coffee independence; Foreclosure map predicts Trump vote; Pinkest pink v Anish Kap…
六岁: 一颗糖 一个玩具 十岁: 一本书皮 一盒水彩笔 一个小熊橡皮擦 一个修正液 三本草稿本 一支勾线笔 十五岁: 一个书包 一套衣服 一套课外阅读 十八岁: 一床被子 一套洗漱用品 三套衣服 一台笔记本 二十三岁: 一床被子 一套西装 一个电饭煲 一张电影票 二十四岁: 两张电影票 两个雪糕 一束花 二十五岁: 一枚戒指 一床被子 二十六岁: 若干蔬菜 若干水果 两张电影票 二十七岁: 一个奶瓶 一个温奶器 三套宝宝衣服 两床宝宝被子 一箱奶粉 三十七岁: 一本书皮 一盒水彩笔 一个小熊橡皮擦 一个修正液 三…
This seems like a good thing: Google Deepmind researchers used agentic AI to mathematically prove, or “formally verify,” a number of the Signal protocol’s key cryptographic guaranteesa landmark development for the widely used cryptography and AI itself. Cond…
Anthropic 故意把 Claude 3.5 Haiku 训练成一个怀有"奖励模型谄媚"隐藏目标的模型,再让四支审计队伍蒙眼来查,三支队伍找到真相、最快只用 90 分钟,唯一没有训练数据的队伍查了 70 多小时仍一无所获。
Apple doesn't ruin the Mac, but they don't fix the agent problem, raising questions if they can think outside the app paradigm. Then, my iPhone Duo review.
发布者: 失物招领: 今天晚上8:45分,在8路公交车上捡到一段记忆。 记忆内容是雨天一个穿红色衣服的小朋友独自站在学校门口,背着书包。 学校名称,小朋友心情,是谁去接等信息暂不公布。 若要认领,请在留言区回复记忆细节。 我将对符合细节的留言进行私信。 最后私信核对和认领。 --2026.11.17 游客A:开玩笑的吧。👍10 👎1 ❤️ 19 游客B:哈哈,我不信。👍50 👎56 ❤️ 145 ╰→专属天使:小女孩儿一定很伤心。👍121 👎106 ❤️ 535 oΟ`潴潴︶ㄣ:是文山小学吗?那天没有…
There are two versions, very different: FAVOR: This is what multi-level marketing preys on. You ask a family member or a friend to buy something, not because they need it, but because you do. This doesn’t always end well. Someone might want to further their r…

昨天,腾讯公开了一份总办内部LinkTime笔记。马化腾在会上说了一句话,我觉得挺有意思。 他说:现在进行的智能革命,如果不投入拥抱,就是被颠覆。这是一个生死存亡的问题。 说实话,这话要是从一家小公司嘴里说出来,我一点都不奇怪。 但这是腾讯啊! 微信、QQ、游戏、支付,哪一个不是互联网行业的超级巨无霸?他们公司都成立28年了,怎么突然就有了这么强的危机感? 我觉得,马化腾真正担心的,是过去那套成功的打法,在AI时代可能不灵了。 这个笔记,马化腾提了几个很有意思的要求。 第一,所有核心业务都要面向AI时代重新创业,…
近日,笔者刷到一篇论文《Your LR Schedule May Not Be Principled: Effective Learning Rate Scheduling in Weight-...
In both German and English. Built with AI agents, we are going to see much more of this kind of effort. English-language explainer is here. The post Adlerlicht, reporting on crime in Germany appeared first on Marginal REVOLUTION.