Turns out when you build your entire business on copyright infringement, a. it’s easy to steal your business and b. you have no recourse when someone does.
The open availability of cutting-edge models creates a multiplier effect, enabling startups, researchers, and developers to build upon sophisticated AI technology without massive capital expenditure. This has accelerated China’s AI capabilities at a pace that has shocked Western observers.
Didn’t a Google engineer put out a white paper about this around the time Facebook’s original LLM weights leaked? They compared the rate of development of corporate AI groups to the open source community and found there was no possible way the corporate model could keep up if there were even a small investment in the open development model. The open source community was solving in weeks open problems the big companies couldn’t solve in years. I guess China was paying attention.
China “open sources” a lot of their technologies. They treat it as a form of competition, we’ll show you how to do x but you show us how to do u and whoever is better at both wins out, there’s a lot of short videos on how BYD taught other Chinese EV manufacturers and even Ford how their automated manufacturing plants work. The end result, everything becomes a highly optimized process. Glad to see they’re also adopting this framework with open sourcing AI development.
This is also a reason why there’s a hugeee cultural clash with US IP theft.
Open source is the only way forward with AI.
Sometimes I am happy to be able to say that I am not surprised by a piece of news and for once it does not mean in a political terror/economic destruction/environmental eradication way.
eventually we’ll all be able to have an open source AI that runs fine on a phone or any average device and we’ll have our privacy, and the big corps will lose their grip and hopefully collapse
I read a lot of tech bros saying what they did is easy because they used (illegally?) the chatgpt API for part of their model training. But it seems this kind of performance actually means better engineering, doesn’t it?
I’m glad a different country is able to challenge top USA tech, but I wish EU could do it together too. For now it seems we’re mostly able to duplicate American products with added GDPR compliance.This is what Open AI wants you to think. Because Open AI is burning money at an unprecedented rate and still raising money. If DeepSeek is able to do what they do if a fraction of the money, the VCs and Microsoft will begin asking questions.
They are already asking questions. DeepSeek was a wake up call. NVIDIA stock dropped like a stone right after the announcement.
Okay, can somebody who knows about this stuff please explain what the hell a “token per second” means?
A bit like a syllable when you are talking about text based responses. 20 tokens a second is faster than most people could read the output so that’s sufficient for a real time feeling “chat”.
Deepseek is an absolutely massive model, it’s not the one people will be running. Rather, look at qwen/qwq, gemma and a number of other smaller ones
No, people who want something approaching chatgpt but local want to run at least deepseek V3 32B.
Qwen at least fares much worse for my usage as do deepseek V3 under 32B.
The hell is v3 32b. Are you talking about a distill
They probably confused the R1 Qwen distill with something else. Afaik there is no 32b model from DeepSeek directly.
