Live Updates > Live Update Details
2025-08-01 13:52:59
[Deepseek affiliate publishes patent for large language model deployment method] Tianyancha App shows that the patent for "A large language model deployment method and system" applied for by Deepseek affiliate Hangzhou Deepseek Artificial Intelligence Basic Technology Research Co., Ltd. was recently published. The abstract shows that the invention relates to the field of artificial intelligence. The beneficial effect is that the pre-filling stage and the decoding stage are deployed on machines with high-performance computing power and large memory respectively, balancing the load tasks, achieving maximum hardware utilization, reducing idle computing power, reducing overall latency, improving throughput, and enhancing the scalability and fault tolerance of the system.
