How to Reduce LLM Inference Costs
Why it matters: Cut your LLM bill without gutting quality: quantization, batching, routing and distillation that slash inference costs by 50 to 90 percent.
Distillation
Auto Added by WPeMatico
US accuses China of “industrial-scale” AI theft. China says it’s “slander.”
The US is preparing to crack down on China’s allegedly “industrial-scale theft of American artificial intelligence labs’ intellectual property,” the Financial Times reported Thursday. Since the launch of DeepSeek—a Chinese model that OpenAI claimed was trained using outputs from its models—other AI firms have accused global rivals of using a method called distillation to steal
US accuses China of “industrial-scale” AI theft. China says it’s “slander.” Read More »
Anthropic: Claude faces ‘industrial-scale’ AI model distillation
Anthropic has detailed three “industrial-scale” AI model distillation campaigns by overseas labs designed to extract abilities from Claude. These competitors generated over 16 million exchanges using approximately 24,000 deceptive accounts. Their goal was to acquire proprietary logic to improve their competing platforms. The extraction technique, known as distillation, involves training a weaker system on the
Anthropic: Claude faces ‘industrial-scale’ AI model distillation Read More »
Attackers prompted Gemini over 100,000 times while trying to clone it, Google says
On Thursday, Google announced that “commercially motivated” actors have attempted to clone knowledge from its Gemini AI chatbot by simply prompting it. One adversarial session reportedly prompted the model more than 100,000 times across various non-English languages, collecting responses ostensibly to train a cheaper copycat. Google published the findings in what amounts to a quarterly
Attackers prompted Gemini over 100,000 times while trying to clone it, Google says Read More »