Two Ways to Read a Disassembly Manual: Rule-Based NLP vs. LLMs for Turning Prose Into Machine Instructions

Conference paper compares a classical NLP pipeline against generative AI for extracting structured disassembly steps from manuals. Early-stage, narrow scope, but targets a real SME bottleneck.

Imagine you hire two new employees to read IKEA assembly instructions and type them into a spreadsheet. One is a meticulous rule-follower who uses a highlighter and a checklist — they parse every sentence looking for verbs like 'remove,' 'unscrew,' and 'detach,' then slot each action into a rigid template. The other is a creative generalist who reads the whole page, intuits the structure, and fills out the spreadsheet in one pass — sometimes brilliantly, sometimes with confident hallucinations. This paper pits those two employees against each other on real disassembly manuals. The committed claim: we can automatically convert unstructured disassembly manual text into structured, machine-readable instructions using either a rule-based NLP pipeline or an LLM-based generative framework, and we compare their performance head-to-head. This is not a first-of-kind result — information extraction from technical manuals is a well-trodden path — but applying it specifically to disassembly instructions for circular-economy automation is a focused niche contribution. The rule-based NLP framework relies on classical techniques: tokenization, part-of-speech tagging, dependency parsing, and hand-crafted extraction rules targeting action verbs and their arguments (tool, component, fastener). The generative AI framework uses large language models — likely prompted with few-shot examples — to produce the same structured output from raw text. The architecture choice here is less about algorithmic novelty and more about comparing two well-understood paradigms on a domain-specific task. The paper sits squarely in the applied information extraction family, not pushing any frontier in either NLP or generative AI. The integrity picture is limited by what we can see from the abstract alone. The authors tested on real-world disassembly manuals, which is a plus over synthetic data. But there's no mention of standardized benchmarks, public datasets, sample sizes, or precision/recall numbers in the abstract. The evaluation appears to be internal — same team builds and grades both systems. The conference venue (CIRP Conference on Intelligent Computation in Manufacturing Engineering) is a respected manufacturing-engineering forum, not an NLP venue, which means peer review focuses on domain relevance rather than methodological rigor in language processing. The milestone question is straightforward: how many disassembly steps per manual can be extracted with, say, 90%+ F1 before a human must intervene? The abstract doesn't give us that number. For this to matter to SMEs, the pipeline needs to handle diverse product categories, multi-step dependencies, and ambiguous instructions — none of which are addressed here. The gap between 'we can parse a manual' and 'a robot can follow the output' remains large. The obvious next experiment is scaling to diverse product families and testing whether the extracted instructions can actually drive a downstream disassembly planner or robotic system. The authors likely didn't run this because this is a data-foundation paper — they're building the extraction layer first. Fair enough, but it means the work stops exactly where the hard engineering begins. The honest read: this is stage (a), scoping the extraction problem, with the integration test saved for a follow-on.