Skip to content

Th

Business coverage of technology, AI and cryptocurrency

Last update

Search results for «LLM Inference»

12 posts

21 October 4

  1. llm-d 1.0 Released by IBM, Red Hat and Google for Production Distributed Inference

    IBM, Red Hat and Google released llm-d 1.0 on October 20, 2026, adding production features for distributed LLM inference across clouds and on-prem environments.

    3 min

  2. DeepSeek DeepInfer Open Source Release Cuts LLM Inference Costs

    DeepSeek released its DeepInfer inference framework under Apache 2.0 on October 20, 2026, targeting lower costs for large-scale LLM serving.

    2 min

  3. MiniMax M3.1 Flash Launches with 70% Lower Agentic AI Costs

    MiniMax released its M3.1 Flash model on October 19, 2026, claiming major gains in speed and efficiency for agentic AI applications at flat API rates of $0.15 input and $0.60 output per million tokens.

    3 min

  4. TorchTPU Open Source Release Brings Native PyTorch Support to Google Cloud TPUs

    Google and Meta open-sourced TorchTPU on October 20, 2026, delivering a native PyTorch backend for Cloud TPUs that supports eager execution and torch.compile.

    3 min

4 November 1

  1. Mistral Large 4 Open Weights Released for 1-Trillion-Parameter Le Chonk Model

    Mistral AI released open weights for its 1-trillion-parameter Mistral Large 4 model on October 29, 2026, enabling self-hosted coding agents and multimodal applications.

    3 min

31 October 1

  1. Mistral Le Chonk Open-Weight Model Targets Cybersecurity and Coding Tasks

    Mistral AI released its 1-trillion-parameter Le Chonk model on October 29, 2026, with open weights focused on defensive cybersecurity and agentic coding performance.

    3 min

29 October 1

  1. Google Cloud AI platform Unveils Ironwood TPU for Enterprise Inference

    Google Cloud launched Ironwood, its seventh-generation TPU, delivering substantial inference cost reductions and performance gains for enterprise AI deployments.

    3 min

27 October 1

  1. TypeSafe AI Raises $870 Million Series A at $7.5 Billion Valuation

    TypeSafe AI secured $870 million in Series A funding on October 9, 2026, reaching a $7.5 billion valuation just weeks after its seed round.

    3 min

19 October 1

  1. Meta Muse Spark Open 816B Model Released for Coding and Agentic Tasks

    Meta released Muse Spark Open, an 816-billion-parameter open-weight multimodal model designed for complex coding and agentic tasks, on October 15, 2026.

    3 min

17 October 2

  1. Reflection AI Beam 501B Open-Weight Model Targets Coding and Agentic Tasks

    Reflection AI released its first open-weight model Beam on October 5, 2026. The 501.3B-parameter sparse MoE model focuses on coding and long-horizon agent workloads.

    3 min

  2. Ant Group Ling Model Open Weights Enable 560B MoE Deployment on Four GPUs

    Ant Group’s inclusionAI published open weights for Ling-3.1-Flash, a 560 billion parameter MoE model under MIT license, on Hugging Face in mid-October 2026.

    3 min

16 October 1

  1. Celo Buy Marketplace Launches Enabling AI Agents to Pay for 700+ Services in Stablecoins

    Celo Core Co. launched the Buy marketplace on October 13, 2026, allowing AI agents to autonomously purchase over 700 compute, data, and API services using stablecoins on the Celo network.

    3 min