Rendered at 10:06:20 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
flowerlad 11 hours ago [-]
It seems every DeepSeek paper/patent has a huge number of authors, and this one is no exception. They couldn't even fit everyone on the page, there are 31 others not shown. This could be an asset protection strategy (i.e., human assets). Imagine if there were only 3 authors. Those authors may get hired away by competitors. If you list every employee on every paper then competitors don't know who to lure away.
Why is this the top comment? Many of the comments, as well as this one, have no relation to content and only mention a triviality
antonvs 4 hours ago [-]
It’s top comment because it’s anti-Chinese.
ahurmazda 10 hours ago [-]
Just look for the “corresponding author”
eru 5 hours ago [-]
The unfortunate intern who had to upload to arxiv?
otherme123 3 hours ago [-]
Corresponding author is the head of the group, usually the one who coordinates the study, the one who knows everyone else. Is the "if you have any question about anything in this paper, contact me" person, even years after publication.
nextaccountic 7 hours ago [-]
> there are 31 others not shown
just click the link and it will show the others, this seems to be a limitation/UI feature of arxiv. The paper itself contains the full list
CSSer 7 hours ago [-]
I think they just meant that it's so many other people that they don't reasonably fit in the UI
anvuong 9 hours ago [-]
Lmao with the conspiracy. Large scale experimental research is always like this, many papers in experimental physics have pages of authors.
txhwind 9 hours ago [-]
Competitors will try to touch everyone on the list.
alightsoul 8 hours ago [-]
Maybe aquihire like Nvidia with groq?
Onavo 5 hours ago [-]
I miss the YOLO (CNN computer vision model) days where one dude can publish a paper, completely disregard academic conventions, and yet push the field forward by leap and bounds.
altmanaltman 8 hours ago [-]
Yeah what possible company can try to lure 100 people... Just for reference, Linkedin has 17,000+ full time employees.
ycui7 10 hours ago [-]
click the link, or read the PDF.
all authors are listed. there is no conspiracy to hide authorship.
arxiv simply want to keep the page short not too long.
vblanco 13 hours ago [-]
380.000 concurrent sandboxes on 160 Epyc based server nodes. Crazy stuff
dangoodmanUT 12 hours ago [-]
that's only 12 sandboxes per core
aabhay 12 hours ago [-]
Um, how is that not impressive
nijave 9 hours ago [-]
A place I worked back around 2020 was running a Grafana instance per customer that got embedded on the web dashboard. We had 110 pods per GKE (kubernetes on gcp) 4 CPU node because that was a network imposed pod limit at the time. The nodes were usually idle--could have shoved a lot more on if not for the IP limit.
I think around that time Grafana changed their license tho so you couldn't host OSS Grafana as part of your service.
r_lee 11 hours ago [-]
if it's agentic stuff, they likely aren't hammering a core constantly and they will maybe sit idle quite often between model requests, so it makes sense. I do wonder how much memory they allocate to each one though.
it's just very efficient use of shared cores that is required to make these kinds of workloads cost efficient
eru 5 hours ago [-]
If they sit mostly idle, you can swap out a lot of the memory to SSD, I guess.
m3kw9 8 hours ago [-]
how is it impressive?
piterrro 4 hours ago [-]
12 sandboxes per code is insane, I wonder how many of these sandboxes are idle at a time. Depending on the tasks assigned the resource requirements are different. Compare an agent doing pdf conversion and one responding to a simple question. One is cpu bound the other is mostly network wait.
This is an interesting problem from infra perspective since you cannot predict the workload. On a bigger scale you may get away with forecasts.
Im waiting for tech that elastically allocates cpu/mem without restarting a container.
Yes and it needs to be load bearing. It’s not a claim that its seams are.
yipinwong 11 hours ago [-]
The topic isn't as interesting as how 131 authors communicated to get this out.
stefan_ 10 hours ago [-]
I don't understand why half the comments here are about the author list, this is very common practice in e.g. large-scale physics experiments and biology, and every new GPT release from OpenAI equally had papers with tons of authors
hodgehog11 10 hours ago [-]
Agreed, I'm very confused as well. It's like no-one here has been paying attention to research papers.
Or they are just rushing to say anything, and it's much easier to comment on that than the content of the paper.
zekrioca 4 hours ago [-]
Some people don’t want to recognize the important work that went into this.
10 hours ago [-]
embedding-shape 11 hours ago [-]
Is it possible they're doing a research lab "socialism style" and everyone gets equal credit for just being a part of the lab, regardless of actual input into the specific papers? If they're innovating in computer, maybe they're not so afraid of innovating in social/academic structures as well?
tonmoy 11 hours ago [-]
This is common practice in Biology labs in the west I think
moritzwarhier 8 hours ago [-]
Maybe there are even reasonable justifications for it, instead of yelling about "socialism".
embedding-shape 8 hours ago [-]
Sorry, didn't mean it like "yelling", I'm quite a fan of socialism and don't see it as any negative. I didn't think anything in my comment was negative.
nextaccountic 7 hours ago [-]
It's negative in the sense it suggest some authors didn't contribute (or contribute little0 to the research, and were perhaps just warm bodies that happened to be present at a certain location
alightsoul 8 hours ago [-]
The west does it too in experimental papers. This is not a socialism thing.
otherme123 3 hours ago [-]
I am author in two author papers, but also in 200 author papers. Nothing wrong with it. In our field they are studies among a dozen centers, where each center has to do something and the results are pooled to some central hub. If I do a relatively easy data prep before sending to the hub, I go among the authors, it is just the way it works. A huge work that is spreaded thinly, or else can't be done unless you ask people to work without attributio. That might work once or twice, but not more, if you are the person who ask for favours but returns nothing.
antonvs 3 hours ago [-]
This is your brain on propaganda.
jerrygenser 10 hours ago [-]
I wonder if they are signalling that if they can do this for training, then they can create an style agent swarm to hack anyone with 380k concurrent agents.
redat00 12 hours ago [-]
So.. serverless ?
redat00 12 hours ago [-]
Still very impressive! Love how it's done!
tipiirai 12 hours ago [-]
Can you give a brief for what this is and why it is impressive?
redat00 11 hours ago [-]
It just describes the platform they built for scheduling workloads, and running those workloads. After a second thought it is not that impressive and probably doesn't deserve any kind of hype. It's the same kind of setup AWS is running for Lambda, as well as anyone else basically running SLURM clusters out there.
Still giving them credit because creating such as scheduler/platform from scratch is quite complex, and I know that they probably struggled a lot to get it right.
calebkaiser 6 hours ago [-]
That's not quite right. A recurring trend in ML is figuring out how to get an elastic interface for the the particular quirks of ML workloads (source: I worked on an open source one years ago for inference). Recently, there's been a lot of interest in doing this for agent workloads. Google recently released something called ax that is similar in spirit. The core of it is this: https://github.com/agent-substrate/substrate
At a high level, agent sandboxes have peculiar needs. Agents are really bursty, but also long lived. You need low latency suspend/resume calls. Checkpointing and recovery have some particular considerations. And naive approaches are often really wasteful, but over optimizing without harming durability, isolation, or consistency in performance can get tricky.
This is the new hot infra topic for agent swarms, for the time being. Whether that's impressive or not is up to the reader I guess, but it's a pretty involved project nonetheless.
redat00 29 minutes ago [-]
I've overlooked too much the optimization in the workload that get dispatched and just looked at the scheduling part. Thanks for the explanation!
zekrioca 4 hours ago [-]
The person simplified the paper with such a misunderstanding that I thought 10x before rebutting. They clearly didn’t read anything of the paper. Thanks for the clarification.
r_lee 10 hours ago [-]
I'd say it's cool that they're openly writing about it and how they run their workloads. shows a nice window into how these things are actually deployed at scale.
it also shows how much density you can get easily from a single core if you wanted to replicate this
peter_d_sherman 6 hours ago [-]
>"Within one scale unit, the platform spans nearly 160 CPU nodes with 30K cores and ∼250 TB of DRAM. It manages petabytes of layers and images. On a typical day, a single scale unit serves about 3 M sandbox instances, with peak concurrency reaching ∼380K and a creation rate exceeding 5,000 instances per second."
Impressive numbers!
Whoever would have thought (in prior years) that in 2026 AI Agents (not people or corporations, at least not directly) seem to be (or seem to be rapidly becoming) the biggest consumers of cloud computing resources...
Anyway, a very interesting paper and environment!
swingboy 14 hours ago [-]
Is there a lab more innovative than DeepSeek? Imagine if they had the same compute resources that Anthropic and OpenAI have.
ProphetOfParado 14 hours ago [-]
Food for thought: Constraints are the source of creativity.
conception 14 hours ago [-]
Yeah if they had the resources of an OpenAI or anthropic they’d be OpenAI or Anthropic. Scrappy underdogs have to be nimble and innovative.
mirekrusin 13 hours ago [-]
They are as “underdog” as Linux is to Windows.
ianm218 11 hours ago [-]
Not really, they are underdogs in the true sense of the word.
rozim 13 hours ago [-]
Possibly relevant: 突破技术壁垒, "break the technical barricade" -> overcome an obstacle through innovation (in this case, sub SOTA GPUs at least).
Native Chinese speakers to confirm....
michaellee8 13 hours ago [-]
your translation is correct, I would say Chinese labs may be able to figure out the current capability of latest frontier models in 3-6 months, but then Anthropic and OpenAI may have already been ASI in that time already. China's main problem is still lack of (good) chips, and that is a hardware issue that is unlikely to be solved for a while. and more effort for efficiency means less effort for actual capability improvements. we have already seen what anthropic can do if they focus on efficiency with opus 5.5
zekrioca 3 hours ago [-]
This isn’t a law.
7734128 2 hours ago [-]
Bell Labs would be a good counter example. All the resources in the world and no demands.
impulser_ 14 hours ago [-]
Short term they might have less compute, but long term they will most definitely have more compute. They don't have to worry about energy, they don't have to worry about people blocking them building data centers the only thing stopping them is there no Chinese manufacturer that can produce a chip as good as Nvidia but I would bet that solved in a year or so.
tucnak 11 hours ago [-]
They don't have to worry about people blocking DC construction in the US either. All new AI datacenters are designated "dual-use" so the federal government is already letting local councils know to fuck off.
8note 8 hours ago [-]
they can also put them in better places, vs trying to arbitrage expensive electricity costs and various US corruption thats built more around paying people off than getting things done
impulser_ 8 hours ago [-]
Yeah, but that brings up another problem that China doesn't have. Their federal government is always on the same page. The US federal government changes every two years and it doesn't seem like one side is going to be allowing building of AI data centers anymore and in fact might just ban AI in general.
ford 7 hours ago [-]
It's hard enough to build them in the US that multiple companies are unironically spending 10s of millions of dollars to try to build them in space
Which cynics could say is marketing hype, but I tend to believe it's extremely difficult to build anything land/energy intensive in the modern United States
klrefg 2 hours ago [-]
Or some people have more money than sense. Building data centers on earth is trivial compared to getting the same amount of compute to space.
sgammon 4 hours ago [-]
This is literally just a scheduler over firecracker man what
SmartestUnknown 13 hours ago [-]
Just because other companies don't write papers about what they do doesn't mean they aren't innovative...
broodbucket 12 hours ago [-]
I'm actually the most innovative, I've written thousands of papers advancing the state of human knowledge. They're just in my basement and I don't show anyone.
doc_ick 13 hours ago [-]
Sure, but we’ll never know what they do or if it is innovate because we won’t know what they do.
azinman2 5 hours ago [-]
Well we do know the results. They’ve been at the frontier constantly, including developing the entire field and set of capabilities. In the beginning every OpenAI paper was basically a landmark.
doc_ick 4 hours ago [-]
They were at the frontier early since they allegedly “stole” the internets data first. Now they’re just lame ducks trying to ensure they stay at the top by legislation and ensuring open source doesn’t get its say. Also OpenAI trying to adopt any other product (legal tooling, healthcare, latex replacement, etc…).
azinman2 4 hours ago [-]
They were at the frontier because they invented many of the techniques. Google already had the internet’s data well beforehand. Anthropic and OpenAI are still at the frontier today, independent of legislation.
doc_ick 4 hours ago [-]
Oh no I agree, they were among the first to be popular in the llm frontier with their techniques. Today they are only holding on to the frontier because of that lead.
They want the legislature to keep their lead from other competitors.
4 hours ago [-]
ijidak 13 hours ago [-]
"Necessity is the mother of invention."
Not sure they'd be the same without the constraints.
aidiscoverywire 4 hours ago [-]
[flagged]
5 hours ago [-]
Wren_ops 7 hours ago [-]
[dead]
Vaslo 12 hours ago [-]
That number of authors though
doc_ick 13 hours ago [-]
Will admit that I haven’t read it yet, just saw the crazy number of authors and think this may compete for one of the papers with the most authors.
justinnk 12 hours ago [-]
This one [0] about the Higgs boson is hard to beat. Pages 25-32 are just full of around 5150 „authors“, pages 33-37 are their affilliations.
Even without that particularly special case, high-energy physics collaborations have long since broken the idea of authors. There are now many collaborations with hundreds of authors publishing regularly and quite a few that are into the thousands.
mentalgear 11 hours ago [-]
I like it, represents science's general 'standing on the shoulders of our precedents' far more realistic then the 'genius solo' PR mythos.
doc_ick 4 hours ago [-]
Where is the balance between this and citations? Authors implies said person provided additions to get the work done.
DiogenesKynikos 4 hours ago [-]
With projects like the LHC, there really are thousands of people involved in "getting the work done."
elashri 11 hours ago [-]
I think the number is ~2930 authors according to the CDS [1] which is comparable to the corresponding CMS paper which has about ~2900 authors [2]
just click the link and it will show the others, this seems to be a limitation/UI feature of arxiv. The paper itself contains the full list
all authors are listed. there is no conspiracy to hide authorship.
arxiv simply want to keep the page short not too long.
I think around that time Grafana changed their license tho so you couldn't host OSS Grafana as part of your service.
it's just very efficient use of shared cores that is required to make these kinds of workloads cost efficient
This is an interesting problem from infra perspective since you cannot predict the workload. On a bigger scale you may get away with forecasts.
Im waiting for tech that elastically allocates cpu/mem without restarting a container.
Or they are just rushing to say anything, and it's much easier to comment on that than the content of the paper.
Still giving them credit because creating such as scheduler/platform from scratch is quite complex, and I know that they probably struggled a lot to get it right.
At a high level, agent sandboxes have peculiar needs. Agents are really bursty, but also long lived. You need low latency suspend/resume calls. Checkpointing and recovery have some particular considerations. And naive approaches are often really wasteful, but over optimizing without harming durability, isolation, or consistency in performance can get tricky.
This is the new hot infra topic for agent swarms, for the time being. Whether that's impressive or not is up to the reader I guess, but it's a pretty involved project nonetheless.
it also shows how much density you can get easily from a single core if you wanted to replicate this
Impressive numbers!
Whoever would have thought (in prior years) that in 2026 AI Agents (not people or corporations, at least not directly) seem to be (or seem to be rapidly becoming) the biggest consumers of cloud computing resources...
Anyway, a very interesting paper and environment!
Native Chinese speakers to confirm....
Which cynics could say is marketing hype, but I tend to believe it's extremely difficult to build anything land/energy intensive in the modern United States
They want the legislature to keep their lead from other competitors.
Not sure they'd be the same without the constraints.
[0] https://arxiv.org/abs/1207.7214
[1] https://cds.cern.ch/record/1471031
[2] https://impact.ornl.gov/en/publications/observation-of-a-new...