Imagine you're a food critic, but you can't take the dish home. You walk into the restaurant, eat at the table, write your review — but the recipe and the plate never leave the kitchen. That's the core mechanism of LUCQUE: the largest annotated real-world lung cancer screening dataset publicly accessible for AI evaluation, hosted on a platform (PARADIM) where your code goes to the data instead of the data coming to you. The committed claim: LUCQUE is the largest accessible, comprehensively annotated real-world low-dose CT lung cancer screening dataset, and it fills a gap that has been quietly crippling the field — fragmented public datasets with inconsistent annotations and missing clinical metadata have made it nearly impossible to independently compare AI tools for lung cancer screening on a level playing field. The 1,678 baseline LDCT studies come with voxel-level expert segmentations of 1,776 pulmonary nodules and 60 cysts, plus Lung-RADS classifications and participant demographics. This isn't a methods paper. It's infrastructure. Where does LUCQUE sit on the ladder? The existing public benchmarks are NLST (which is large but not annotated at voxel level for nodule segmentation in a unified, accessible way), LIDC-IDRI (1,018 scans, older, smaller, but with multi-reader annotations), and a scattering of smaller sets. LUCQUE's 1,678 studies with unified Lung-RADS annotations and voxel-level segmentations represent a genuine step up in scale and annotation consistency for the screening-specific use case. But it's important to be honest: LIDC-IDRI has multi-reader annotations (multiple radiologists per nodule), which LUCQUE's abstract doesn't claim. And NLST's raw size dwarfs LUCQUE. The real edge is the combination of annotation quality, clinical metadata, Lung-RADS, and accessibility — not raw scan count alone. Architecturally, this is a data-infrastructure contribution, not an algorithmic one. The key design choice is the model-to-data paradigm via PARADIM: user code is shipped to the platform and executed on-premise, so the DICOM data never leaves the host. This is the privacy-preserving federated-evaluation family — conceptually adjacent to what OpenFL, Flower, or NVIDIA FLARE do for federated learning, but applied here to benchmarking rather than training. The compute property the method leans on is centralized hosting with sandboxed execution, which trades download convenience for regulatory compliance and long-term data stewardship. Integrity is a mixed bag. On the plus side: the dataset is derived from a real-world screening program, not a simulation or synthetic pipeline. Expert-derived segmentations with Lung-RADS grading are a strong annotation standard. On the minus side: there's no mention of inter-reader agreement metrics, no independent external audit of the annotations, and the model-to-data access model means outside researchers can't fully inspect the data for edge-case biases or annotation errors the way they can with a downloadable dataset. The privacy gain is real, but it introduces a new kind of opacity. Code availability and platform access details are referenced but specifics on reproducibility guarantees (versioning, deterministic execution environments) aren't detailed in the abstract. The milestone question for lung screening AI benchmarks is clear: the field needs a single, canonical, multi-thousand-scan annotated benchmark with unified clinical metadata that AI tools are routinely evaluated against — the ImageNet moment for lung screening. LUCQUE at 1,678 scans is the best candidate today, but the abstract notes 'currently comprises,' implying growth. The threshold that changes the game is roughly 5,000+ annotated scans with longitudinal follow-up (not just baseline), which would enable meaningful evaluation of screening-interval prediction and cancer-outcome models, not just nodule detection. The obvious experiment not run: benchmarking existing AI tools (e.g., commercially deployed CAD systems, published detection models) on LUCQUE and reporting comparative results. The authors built the track but didn't race the cars. The honest read is (c) — they're saving it, or inviting the community to do it. A dataset paper's job is the dataset; the benchmarking paper is the natural sequel. But without at least one baseline model run, we can't yet verify that the dataset is practically usable for the comparisons it promises.
The analogy
You're a food critic who can't take the dish home. You walk into the restaurant kitchen, taste everything at the table, write your review — but the recipe and plate never leave the building. LUCQUE is a lung screening dataset where your AI model travels to the data, not the other way around. The mechanism is sandboxed evaluation: code goes in, results come out, raw patient data stays put.
Restaurant critic
Critic enters the kitchen, tastes on-site, writes the review — the dish never leaves the building
Model-to-data eval
Researcher ships code to PARADIM platform, runs on-premise, gets results — DICOM data never leaves the host
Honest assessment
LUCQUE is a genuine infrastructure contribution that fills a real gap: the lung screening AI field needed a large, consistently annotated, clinically complete public benchmark and didn't have one. The model-to-data access model is a bet on the future of privacy-preserving evaluation that may prove prescient — or may slow adoption if researchers find the sandbox too restrictive. The critical missing piece is that no AI model has been run on the dataset yet, so its practical utility is asserted but unproven. This matters most to medical imaging AI researchers building or evaluating lung nodule detection and screening triage tools, and to regulators interested in how to build auditable AI benchmarks under privacy constraints.
What Is CLAIMS?
60
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
4/5
Ladder
3/5
Architecture
3/5
Integrity
2/5
Milestone
3/5
Successor
3/5
What is this paper actually committing to?
Infrastructure first, not algorithmic. Largest accessible annotated real-world LCS dataset with voxel-level segmentations and Lung-RADS. A genuine gap-fill for a field plagued by fragmented benchmarks.
The field fight
Should clinical AI benchmarks be downloadable open datasets or privacy-preserving sandboxed platforms?
Side A
Downloadable datasets maximize reproducibility, auditability, and community iteration speed
Held by: LIDC-IDRI, NLST data access, Grand Challenge open tracks
Side B
Model-to-data sandboxes are the only sustainable path for real-world clinical data under privacy regulation
Held by: PARADIM, Federated evaluation proponents, this paper
Milestone tracker
Unlocks: Cancer-outcome prediction benchmarking — moving from nodule detection to clinically meaningful screening AI evaluation
Current
1,678
annotated scans
LUCQUE baseline
Next
5,000
annotated scans
Longitudinal outcome evaluation
~2-4 years if Québec screening pipeline continues feeding PARADIM
Verified Facts (7)
LUCQUE currently comprises 1,678 LDCT baseline studies from 1,678 participants
A total of 1,776 pulmonary nodules and 60 cysts were annotated
Median (interquartile range) nodule volume of 89 (56, 159) mm³
Median (interquartile range) cyst volume of 1,384 (589, 3,793) mm³
Most studies were classified as Lung-RADS 2
Dataset is hosted on PARADIM with model-to-data access approach
User code is executed on the platform such that data remains on premise
Practical Implications (4)
Lung screening AI developers now have a larger, more consistently annotated benchmark than LIDC-IDRI for nodule detection and characterization evaluation
The model-to-data paradigm offers a template for other jurisdictions building privacy-compliant clinical AI benchmarks
Commercial CAD vendors could face more standardized, independent evaluation if LUCQUE gains community adoption
Researchers must adapt workflows to sandboxed execution — no local data exploration or custom preprocessing pipelines outside PARADIM
More latest news
Read all