Nas 的天空 - 第56页 - 点亮思维火花，畅享数字世界

Mac Mac 夜神android模拟器配置桥接

配置桥接，可以实现Mac本机与android模拟器同一个IP段，我主要是用于Mac本机通过android模拟器作为代理上网使用。

Nas的天空

点亮思维火花，畅享数字世界

用户数

文章数

551

评论数

阅读量

200392

FastAPI 构建生产级 LLM 流式代理：解决连接泄漏、假死与断连背压

在用 FastAPI 搭建 LLM 聚合网关或转发流式响应（SSE）时，常会遭遇连接池耗尽、客户端提前断开导致后台空转、Nginx 缓冲吃掉首字延迟等暗坑。本文记录从事故排查到架构重构的完整过程，提供带断连检测与连接复用的工业级代码方案。

告别 Ollama 并发瓶颈：单卡 4090 基于 SGLang 极致榨干 DeepSeek-R1 吞吐踩坑实录

很多同学在私有化部署开源大模型时第一反应是 Ollama，但在并发多轮长文本或多 Agent 协作场景下，Ollama 的吞吐和排队延迟极易雪崩。本文记录我将单卡 4090 机器上的模型推理后端从 Ollama 迁移到 SGLang 的全过程，详解 RadixAttention 缓存复用、Docker 部署配置、Nginx SSE 流式防缓冲，以及真实高并发压测指标。

单卡榨干并发极限：vLLM与SGLang本地推理实战与流式网关压测避坑指南

拒绝理论空谈，记录在单张RTX 4090/A10D显卡上部署Qwen2.5与DeepSeek蒸馏模型的工程实操。深度对比vLLM与SGLang在高并发流式推理下的吞吐与TTFT表现，提供完整的Nginx SSE流式反向代理配置、显存碎片排障及并发压测脚本。

Mac 压榨 Apple Silicon 统一内存：从 Ollama 迁移到 llama-server 构建高并发本地 LLM 网关

本文记录了一台 64G 内存的 M3 Max Mac 从 Ollama 迁移到原生 llama-server 的调优历程。深入剖析 Apple Silicon 统一内存的显存分配机制，通过破解 wired_mem_limit 突破显存阈值，结合 KV Cache 量化、连续批处理（Continuous Batching）与多 Slot 并发配置，实现长上下文与多 Agent 并发场景下的推理吞吐翻倍。

告别Ollama单卡瓶颈：基于vLLM+Ray的本地双卡大模型推理集群低成本搭建与调优实战

单张消费级显卡跑大模型经常爆显存？本文记录在Ubuntu自建算力节点上，使用vLLM配合Ray实现多卡张量并行（TP）与PagedAttention优化的高并发部署方案。涵盖显存碎片优化、流式SSE代理中转、生产级Docker Compose配置与真实压测排坑指南，助你打造极低延迟的自建LLM服务。

Latest Comments

macau18 link alternatif Thanks for any other fantastic article. Where else may anyone get that type of information in such an ideal method of writing? I have a presentation subsequent week, and I am at the look for such information.

all about casino comped cruises Hi, i read your blog from time to time and i own a similar one and i was just curious if you get a lot of spam comments? If so how do you reduce it, any plugin or anything you can recommend? I get so much lately it's driving me insane so any help is very much appreciated.

medical boric powder I'm not sure why but this site is loading very slow for me. Is anyone else having this issue or is it a problem on my end? I'll check back later and see if the problem still exists.

best leather conditioner I have been surfing on-line more than three hours nowadays, yet I never found any attention-grabbing article like yours. It is lovely price sufficient for me. In my view, if all web owners and bloggers made excellent content material as you did, the net can be much more useful than ever before.

projector screen hyderabad Ꭺt Nissi Offife Systems, we specialize іn providing top-of-thе-line projectors, interactive panels, аnd comprehensive hone theater solutions tߋ transform ｙouг vierwing experience.

using gain in audio mix Your method of explaining the whole thing in this article is really good, all be capable of effortlessly understand it, Thanks a lot.

artistas femeninas de música techno Simply wish to say your article is as astonishing. The clarity in your post is just spectacular and i could assume you are an expert on this subject. Well with your permission let me to grab your RSS feed to keep updated with forthcoming post. Thanks a million and please keep up the enjoyable work.