User prefers rule-based mappings to heuristic model for home control
6Sep 18 5:13 PM · 7d ago · 3 comments · 1 source · development 6 of 7
A developer noted preference for deterministic phrase-to-action mappings over the model's heuristic approach, citing an example where "warm the house" was misinterpreted as a lighting brightness command rather than a thermostat adjustment.
“I'd rather have 30 megabytes of phrases mapped to the perfect and correct control changes in a home, rather than a heuristic built around 30 megabytes.”
This is a solid improvement over Needle 2, which I tried using for a tool-calling interface to a Runescape database site. Unfortunately it's still not quite capable enough for my target compared to FunctionGemma. Model Correct tool shape Exact arguments ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ ━━━━━━━━━━━━━━━━━━━━ ━━━━━━━━━━━━━━━━━ FunctionGemma fine-tune…
A very cool project, but of course not perfect. I'd rather have 30 megabytes of phrases mapped to the perfect and correct control changes in a home, rather than a heuristic built around 30 megabytes. I tried to "warm the house" (increase the temperature of the thermostat), but the model actually turned the lights to a "warm brightness" -…