Diagnostic Center API, I would like my AI agent to be able to assist me in error tracing

carl.westman_8110

Hi there!

I've had to work with the Diagnostic Center lately and it's been a hassle to copy paste messages from the GUI to my AI agent.

I've tried to find ways for my agent to get access directly to all logs and error messages but it does not seem to be natively in the API?

Do you have any workaround or would it be possible to add this to the API? :) I think a lot of information is missed when I manually have to give it to my agent when fault tracing.

Cheers
Carl

stevedennis

Hi @carl.westman_8110 ,

I think we'd recommend a work-around of just asking us for help :)

Based on other customers who've tried to use AI to help with ProGet issues, I think you'll be spending too much time spinning your wheels. The AI guidance is almost always wrong, because the pattern-matching stack traces that were scraped from Stack Overflow are to fix coding errors. That, and we fix errors really fast, so even if it scraped an answer, it probably was an old version.

Sometimes it makes matters worse; we saw AI guide one user to do all these strange database changes (connection string, adding indexes, etc) -- when the underlying issue was totally unrelated.

The information in the Diagnostic Center serves two purposes:

For end-users (i.e. you) to spot obvious error conditions due to misconfiguration, network errors, etc.
For engineers (i.e. us) to troubleshoot, identify bugs, etc. resulting from problems you can't figure out

It is not to proactively check for health, etc. It's only to troubleshoot known issues. And if the issue is not obvious to you, then we can help answer. Our goal is to make this as obvious as possible.

Thanks,
Steve

carl.westman_8110

Hi @stevedennis, I understand your point but I don't think it would hurt anyone in providing more through the API, both when it comes to logs and control/settings.

One of the areas in which I think Proget is lacking compared to other similar solutions is precisely the control and information/log readout from the application itself in programmatic ways using for example the API. Having to fetch logs and do settings only in the GUI through point and click makes it hard to do versioning and reviews of settings as code.

As an example of AI usefulness, this post I did last week, which resulted in a real bug, PG-3399 was all work of my Opus 5.5 agent. I did not even write the forum post, it was all AI and it resulted in finding a real problem.

https://forums.inedo.com/topic/5850/pypi-connector-to-azure-artifacts-returns-401-same-url-and-pat-work-with-curl?_=1792409820070

I understand your fear of customers doing weird stuff due to incorrect feedback from AI.

But then let me rephrase the question without AI in the picture, I would like more control of the application through API, both settings and diagnostics readout :) it would not hurt, it would only make Proget the stronger choice on the market :) I think the uprising of API first applications talks for itself.

stevedennis

Hi @carl.westman_8110 ,

Thanks for the clarification!

And just as an FYI (not a complaint at all), for that specific post... we'd really only need the stack trace. The technical details.... they were.... well, as you said, you used AI

Sometimes it can be hard for us to tell who/what writes it, but it's almost always more productive for us to get (1) copy/paste of the message from diagnostic center and, ideally, the (2) steps to cause the error.

Don't get me wrong -- we super-appreciate users who take the efforts to try to troubleshoot bugs/errors, but since they can't change ProGet's code it feels like a waste of their time. Even if their review is correct, we still have to independently reproduce/verify/test it.

Anyway we're definitely open to more endpoints or more specific feedback on enduser messages or configuration screens, etc... but we consider those on a case-by-case basis (e.g. like a new command in pgutil for example).

As an FYI ... there is a separate topic on Configuration as Code, discussed over here:
https://forums.inedo.com/topic/5644/proget-configuration-as-code-iac

Thanks,
Steve