Skip to content

Th

Business coverage of technology, AI and cryptocurrency

Last update

Search results for «LLM Serving»

11 posts

21 October 2

  1. llm-d 1.0 Released by IBM, Red Hat and Google for Production Distributed Inference

    IBM, Red Hat and Google released llm-d 1.0 on October 20, 2026, adding production features for distributed LLM inference across clouds and on-prem environments.

    3 min

  2. DeepSeek DeepInfer Open Source Release Cuts LLM Inference Costs

    DeepSeek released its DeepInfer inference framework under Apache 2.0 on October 20, 2026, targeting lower costs for large-scale LLM serving.

    2 min

19 October 1

  1. AWS Bedrock Enterprise LLM Expansions Target Regulated Industries with New Compliance Features

    AWS continues to strengthen Bedrock with additional frontier models, managed agents, and regional compliance options suited to regulated sectors.

    2 min

4 November 1

  1. Mistral Large 4 Open Weights Released for 1-Trillion-Parameter Le Chonk Model

    Mistral AI released open weights for its 1-trillion-parameter Mistral Large 4 model on October 29, 2026, enabling self-hosted coding agents and multimodal applications.

    3 min

31 October 1

  1. Mistral Le Chonk Open-Weight Model Targets Cybersecurity and Coding Tasks

    Mistral AI released its 1-trillion-parameter Le Chonk model on October 29, 2026, with open weights focused on defensive cybersecurity and agentic coding performance.

    3 min

29 October 1

  1. Google Cloud AI platform Unveils Ironwood TPU for Enterprise Inference

    Google Cloud launched Ironwood, its seventh-generation TPU, delivering substantial inference cost reductions and performance gains for enterprise AI deployments.

    3 min

27 October 1

  1. TypeSafe AI Raises $870 Million Series A at $7.5 Billion Valuation

    TypeSafe AI secured $870 million in Series A funding on October 9, 2026, reaching a $7.5 billion valuation just weeks after its seed round.

    3 min

18 October 1

  1. Cohere Series D Raises $500 Million at $6.8 Billion Valuation

    Toronto-based Cohere closed a $500 million round in August 2025 at a $6.8 billion valuation, with an additional $100 million extension later that year.

    2 min

17 October 2

  1. Ant Group Ling Model Open Weights Enable 560B MoE Deployment on Four GPUs

    Ant Group’s inclusionAI published open weights for Ling-3.1-Flash, a 560 billion parameter MoE model under MIT license, on Hugging Face in mid-October 2026.

    3 min

  2. Vitalik Buterin AI privacy stack adds Tor, zkAPI and local prompt rewriting

    Vitalik Buterin released an open-source privacy wrapper for his personal AI agent on October 16, 2026. The package routes traffic through Tor, uses zero-knowledge payments and rewrites prompts locally before external model calls.

    3 min

16 October 1

  1. Celo Buy Marketplace Launches Enabling AI Agents to Pay for 700+ Services in Stablecoins

    Celo Core Co. launched the Buy marketplace on October 13, 2026, allowing AI agents to autonomously purchase over 700 compute, data, and API services using stablecoins on the Celo network.

    3 min