Posts from AI labs, universities, the tech press by region, engineering teams and newsletters.
104 sites: labs, universities, news by region, engineering blogs and newsletters.
vLLM's prefill-decode disaggregation splits LLM inference across engine instances but must transfer the KV cache between them. This post introduces a push-based NIXL connector that moves transfer coordination off the critical path, delivering up to 3x better TTFT and 30% better…
Read moreMulti-turn agentic workloads reprocess growing conversation context each turn, driving up latency. See how bi-directional KV cache transfer lets prefill and decode nodes reuse previously computed context across turns, cutting time to first token by up to 1.6x for Qwen3-32B and…
Read moreGenerative Recommenders (GenRecs) represent a paradigm shift from scoring every ad to reasoning about ad content and user preferences together in order to predict the best outcome for advertisers. Leveraging the world knowledge built into LLMs makes ad matching more intelligent…
Read moreFrom magazine.cs.cmu.edu
Read moreAround 80 pages on WhatsApp’s website exposed instructions that were designed for its chatbot, including “WHAT NOT TO SAY.” Meta says a bug caused the issue.
Read moreL&T Technology Services reported $120 million in annualised Engineering Intelligence revenue as EBIT margins rose to 16.3% in Q2 FY27.
Read more
