Skip to content

Th

Business coverage of technology, AI and cryptocurrency

Last update

Search results for «LLM Infrastructure»

11 posts

21 October 3

  1. llm-d 1.0 Released by IBM, Red Hat and Google for Production Distributed Inference

    IBM, Red Hat and Google released llm-d 1.0 on October 20, 2026, adding production features for distributed LLM inference across clouds and on-prem environments.

    3 min

  2. DeepSeek DeepInfer Open Source Release Cuts LLM Inference Costs

    DeepSeek released its DeepInfer inference framework under Apache 2.0 on October 20, 2026, targeting lower costs for large-scale LLM serving.

    2 min

  3. TorchTPU Open Source Release Brings Native PyTorch Support to Google Cloud TPUs

    Google and Meta open-sourced TorchTPU on October 20, 2026, delivering a native PyTorch backend for Cloud TPUs that supports eager execution and torch.compile.

    3 min

19 October 2

  1. AWS Bedrock Enterprise LLM Expansions Target Regulated Industries with New Compliance Features

    AWS continues to strengthen Bedrock with additional frontier models, managed agents, and regional compliance options suited to regulated sectors.

    2 min

  2. Meta Muse Spark Open 816B Model Released for Coding and Agentic Tasks

    Meta released Muse Spark Open, an 816-billion-parameter open-weight multimodal model designed for complex coding and agentic tasks, on October 15, 2026.

    3 min

4 November 1

  1. Mistral Large 4 Open Weights Released for 1-Trillion-Parameter Le Chonk Model

    Mistral AI released open weights for its 1-trillion-parameter Mistral Large 4 model on October 29, 2026, enabling self-hosted coding agents and multimodal applications.

    3 min

31 October 1

  1. Mistral Le Chonk Open-Weight Model Targets Cybersecurity and Coding Tasks

    Mistral AI released its 1-trillion-parameter Le Chonk model on October 29, 2026, with open weights focused on defensive cybersecurity and agentic coding performance.

    3 min

29 October 1

  1. Google Cloud AI platform Unveils Ironwood TPU for Enterprise Inference

    Google Cloud launched Ironwood, its seventh-generation TPU, delivering substantial inference cost reductions and performance gains for enterprise AI deployments.

    3 min

27 October 1

  1. TypeSafe AI Raises $870 Million Series A at $7.5 Billion Valuation

    TypeSafe AI secured $870 million in Series A funding on October 9, 2026, reaching a $7.5 billion valuation just weeks after its seed round.

    3 min

18 October 1

  1. Cohere Series D Raises $500 Million at $6.8 Billion Valuation

    Toronto-based Cohere closed a $500 million round in August 2025 at a $6.8 billion valuation, with an additional $100 million extension later that year.

    2 min

17 October 1

  1. Vitalik Buterin AI privacy stack adds Tor, zkAPI and local prompt rewriting

    Vitalik Buterin released an open-source privacy wrapper for his personal AI agent on October 16, 2026. The package routes traffic through Tor, uses zero-knowledge payments and rewrites prompts locally before external model calls.

    3 min