
Read the paper
LAaDT-DSS: decision support for non-experts on rooftop PV, incentive and grid simulations under Turkish tariff rules
on Zenodo
YIELD LIES WITHIN
+3.6%
CHANGED
-41%
ANSWER CHANGED
+41%
Imagine you built a meticulous spreadsheet that models whether solar panels pay off on your roof — energy yield, battery economics, grid limits, government incentives, the works. It's accurate, but only you can drive it. Now imagine you hire a receptionist who speaks the customer's language and knows which buttons to press on the spreadsheet, but never touches the math. That's the core mechanism here: an LLM as dispatch layer, calling simulation tools rather than computing anything itself. The committed claim is systems integration, not algorithmic novelty. LAaDT-DSS bundles three questions — household ROI, optimal state incentive design, and feeder-level grid constraint checking — into one simulation core accessible via a 3D CesiumJS map or a natural-language chat interface. The LLM (connected through tool-calling) translates user intent into simulation API calls. Every one of the system's 125 parameters is explicitly tagged as 'sourced' or 'estimated,' which is a refreshingly honest piece of epistemic hygiene you rarely see in applied-AI papers. The validation numbers are real but narrow. PV yield predictions land within ±3.6% of two independent tools (PVsyst and PVGIS) at equal loss assumptions. That's credible for engineering-grade estimates. The more interesting finding is the uncertainty analysis: across 2,048 Monte Carlo draws of estimated parameters, the PV-only investment recommendation flipped in only 1 of 2,048 cases. But add a battery, and the answer changed in 31–41% of draws — a stark demonstration that battery economics under Turkish tariffs are knife-edge uncertain, not that the tool is broken. The architecture is straightforward and deliberately so. A simulation engine (Python, CityGML building data, Turkish tariff rule implementation) sits behind an API. A CesiumJS 3D front-end lets users click buildings. An LLM chat interface uses tool-calling to invoke the same API. The paper leans on the OpenAI function-calling pattern — the LLM generates structured tool calls, the system executes them, results flow back. No fine-tuning, no RAG, no retrieval — just prompt engineering and a well-defined tool schema. Four scripted chat scenarios ran end-to-end. That's it. The integrity picture is mixed. On the positive side: code, scripts, and results are publicly released on Zenodo, and the ±3.6% cross-validation against independent tools is a meaningful external check. On the negative side: no user study was conducted, the four chat scenarios are scripted (not adversarial), and there's no comparison against other decision-support tools for rooftop PV. The Monte Carlo uncertainty analysis is the strongest methodological contribution — it's honest about where the tool's recommendations are robust and where they're not. The paper's value is practical, not theoretical. Turkey's net metering and feed-in tariff rules are complex enough that most households can't evaluate rooftop PV without professional help. A tool that wraps those rules into a click-or-ask interface has clear utility — if the LLM dispatch layer is reliable, which four scripted scenarios can't demonstrate. The 51-page length reflects thoroughness of documentation, not depth of algorithmic contribution. This is an engineering artifact with an honest validation section, not a research breakthrough. The obvious gap is the missing user study. The entire motivation is accessibility for non-experts, but no non-expert was tested. The four scripted chat scenarios prove the plumbing works, not that real users can get correct answers from ambiguous questions. This is either (a) the user study is planned for the next paper, or (b) the author is a solo developer who built the system and wanted to publish the engineering work before recruiting participants. Given the solo authorship and the 51-page documentation effort, option (b) reads as the honest explanation.
The analogy
You built a precise but complicated spreadsheet that tells you whether solar panels pay off on your roof. Rather than teaching every homeowner Excel, you hire a receptionist who speaks their language and knows which cells to fill in — but never touches the formulas. The receptionist is the LLM; the spreadsheet is the simulation engine.
Receptionist
Translates customer questions into the right spreadsheet cells and reads back the answer, never modifying the formulas
LLM dispatch
Translates natural-language queries into simulation API tool calls and returns the results, never computing physics or economics itself
Honest assessment
This is a well-documented engineering artifact, not a research breakthrough. The PV physics validation is credible (±3.6% vs independent tools), and the Monte Carlo uncertainty analysis is the standout contribution — revealing that battery recommendations are genuinely unstable under parameter uncertainty. But the core pitch (non-expert accessibility via LLM) is entirely unvalidated by actual non-experts. Solo-author work that deserves credit for honesty and code release, but needs a real user study before the accessibility claim carries weight.
What Is CLAIMS?
57
/ 100
BedrockNews applies a structured analytical framework called CLAIMS to academic papers and technical research releases.
How CLAIMS worksClaim
2/5
Ladder
3/5
Architecture
3/5
Integrity
3/5
Milestone
2/5
Successor
4/5
What is this paper actually committing to?
Systems integration, not algorithmic novelty. Bundles three PV questions into one LLM-dispatched simulation for Turkish tariffs. Useful engineering but the LLM-as-tool-caller pattern is well-established elsewhere.
The field fight
Should LLMs compute domain answers directly or dispatch to validated simulation tools?
Side A
LLMs can learn enough physics/economics to answer directly with fine-tuning or in-context reasoning
Held by: Various LLM-for-science papers, ChatGPT direct-answer workflows
Side B
LLMs should only translate intent into tool calls; validated simulators do the math
Held by: Tool-augmented LLM papers, this paper, Gorilla, ToolFormer lineage
Milestone tracker
Unlocks: Validation that LLM dispatch actually helps non-experts make correct rooftop PV decisions under real ambiguity
Current
4
scripted scenarios
this paper
Next
30+
real users
meaningful user study
~1-2 years if collaborators or funding secured
Verified Facts (6)
PV yield lies within ±3.6% of two independent tools at equal losses
125-entry parameter registry, each marked as sourced or estimated
Across 2,048 draws of estimated inputs, the answer for PV alone held in all but one; with a battery, it changed in 31-41% of the draws
Four scripted chat scenarios ran end to end; no user study was run
51 pages, 10 figures
Code, scripts and results: https://doi.org/10.5281/zenodo.24338714
Practical Implications (4)
Turkish households could use this to get a first-pass answer on rooftop PV ROI without hiring a consultant, IF the LLM dispatch layer proves reliable with real users
The 31-41% battery recommendation flip rate under parameter uncertainty is a concrete warning: battery storage decisions under current Turkish tariffs are not robust to input assumptions
The 125-parameter sourced/estimated tagging pattern is a reusable design idea for any simulation tool — forces transparency about what's known vs assumed
Municipal planners could use the grid feeder simulation to screen neighborhoods before approving rooftop PV installations en masse
More latest news
Read all