Nas 的天空 - 第54页 - 点亮思维火花，畅享数字世界

Mac Mac 夜神android模拟器配置桥接

配置桥接，可以实现Mac本机与android模拟器同一个IP段，我主要是用于Mac本机通过android模拟器作为代理上网使用。

Nas的天空

点亮思维火花，畅享数字世界

用户数

文章数

531

评论数

阅读量

194466

实战避坑：双卡RTX 4090基于vLLM部署DeepSeek-R1蒸馏版与流式网关优化

针对DeepSeek-R1长思考链导致的显存爆炸与高并发超时痛点，本文详解如何在双卡RTX 4090物理机上利用vLLM完成DeepSeek-R1-Distill-Qwen-32B生产级部署。涵盖无NVLink下的NCCL通信调优、前缀缓存（APC）加速、以及用FastAPI编写具备断连熔断机制的流式代理，实测吞吐提升3倍。

打通本地LLM落地最后一公里：FastAPI + vLLM 流式网关生产级踩坑与调优实录

本地部署大模型时，很多团队都卡在流式输出（SSE）接入业务系统的阶段。本文记录作者在双卡 RTX 4090 节点上用 FastAPI + vLLM 搭建生产级代理网关时踩过的三个深坑：Nginx 缓冲导致打字机卡死、前端断连引发 GPU“幽灵推理”，以及高并发下的显存爆仓。附带完整网关源码与性能调优参数。

NAS打造私有化代码检索与知识库：vLLM + Qdrant + Embedding轻量落地指南

很多极客都在NAS上折腾本地大模型，但直接上70B甚至大参数MoE不仅把显存撑爆，实际开发中响应还巨慢。本文分享如何利用闲置NAS的算力与存储，通过Docker组合部署vLLM推理引擎、BGE向量嵌入模型以及Qdrant向量数据库，搭建一套高吞吐、极低延迟的本地私有化代码检索与知识库系统，解决高并发调用时的显存溢出与排队延迟痛点。

单卡4090跑满吞吐：vLLM与SGLang部署DeepSeek蒸馏模型调优与避坑实战

针对单卡RTX 4090/A10部署DeepSeek-R1蒸馏模型时常见的并发显存暴死、TTFT延迟过高问题，本文基于第一手压测数据，深度拆解vLLM与SGLang在KV Cache管理、量化与RadixAttention上的实操差异，提供可直接落地的配置方案与避坑指南。

用 FastAPI 搭建生产级大模型流式网关：连接池、背压与防泄漏实战

在自建 AI 应用或聚合外部 LLM API 时，很多开发者用几行 FastAPI 代码转发 SSE 流，上线即遭遇连接池耗尽、显存空转与内存泄漏。本文深入拆解 Python 异步流式代理的核心坑点，分享连接池调优、客户端断开的主动背压中断机制，以及抗住高并发长连接的生产级配置。

Latest Comments

macau18 link alternatif Thanks for any other fantastic article. Where else may anyone get that type of information in such an ideal method of writing? I have a presentation subsequent week, and I am at the look for such information.

all about casino comped cruises Hi, i read your blog from time to time and i own a similar one and i was just curious if you get a lot of spam comments? If so how do you reduce it, any plugin or anything you can recommend? I get so much lately it's driving me insane so any help is very much appreciated.

medical boric powder I'm not sure why but this site is loading very slow for me. Is anyone else having this issue or is it a problem on my end? I'll check back later and see if the problem still exists.

best leather conditioner I have been surfing on-line more than three hours nowadays, yet I never found any attention-grabbing article like yours. It is lovely price sufficient for me. In my view, if all web owners and bloggers made excellent content material as you did, the net can be much more useful than ever before.

projector screen hyderabad Ꭺt Nissi Offife Systems, we specialize іn providing top-of-thе-line projectors, interactive panels, аnd comprehensive hone theater solutions tߋ transform ｙouг vierwing experience.

using gain in audio mix Your method of explaining the whole thing in this article is really good, all be capable of effortlessly understand it, Thanks a lot.

artistas femeninas de música techno Simply wish to say your article is as astonishing. The clarity in your post is just spectacular and i could assume you are an expert on this subject. Well with your permission let me to grab your RSS feed to keep updated with forthcoming post. Thanks a million and please keep up the enjoyable work.