Even if we can get things running, there is no easy way to fix a bug. There is not a line of code to fix. Instead, you are left with hallucinations where the model goes off the rails and delivers inaccurate results.
There seems to be no easy way to create reliability. You want something that is as reliable as regular software and that seems impossible just by modifying prompts or adding new data.