Unable to GET from connector "nuget.org"; using cached copy.

parthu.reddy

Hi Team

Recently we got too many of these warnings. Can we know when this occurs.

Thanks
Parthu

stevedennis

This basically means that ProGet was unable to communicate with nuget.org for one reason or another. More specifically... ProGet didn't receive a timely response.

Usually it's a temporary outage or network issue, and will hopefully go away and not cause any issues.

Thanks,
Steve

parthu.reddy

Hi Steve

Thanks for the info. A question, normally proget fetches from connector if a package is not available locally right. In this case is it trying to download new package and has timeout or some network issue? If that's the case what can it fetch from cached copy?

Is it possible to know what it's requesting for.

Thanks
Parthu

stevedennis

Hi @parthu-reddy,

If you (the NuGet client) requests the NewtonSoft.Json-13.0.0 package, and ProGet already has that package cached , then ProGet will return the package without ever contacting NuGet.org.

However, the NuGet client will also request a list "all versions of NewtonSoft.Json when doing a package restore. I don't know why, that's just what it does.

In this case, ProGet will contact the connector (NuGet.org) and aggregate the remote/local results. If the connector is unreachable (as in the case above), ProGet will log a warning and instead return a list of "all (cached) versions of NewtonSoft.Json`... which will be probably all that's needed.

This is likely why no one has complained/noticed and jobs aren't failing.

Thanks,
Steve

parthu.reddy

Hi @stevedennis

Just need some more info. What is the configured time for timeout. Are you maintaining any connection pool for number of connections to nuget.

Thanks
Parthu

stevedennis

Hi @parthu-reddy ,

The default Timeout is 10 seconds, but you can configure it on each connector.

There is no "connection pool" for NuGet -- these are just normal HTTP connections like your browser or any other web api.

Thanks,
Steve

parthu.reddy

Hi @stevedennis

Thanks for the info.

Another question, where is this metadata-caching stored? On the proget server or in DB?

Why I'm asking is, if we add new server to cluster, does this cause increase in requests to nuget.org if the caching is done on server locally?

Does this metadata caching feature reduce the queries to fetch versions that you mentioned?

And can I get links to this caching. Does this

Thanks
Parthu

atripp

Hi @parthu-reddy ,

These are stored in the database and if you click "status" you can see the cached queries.

Does this metadata caching feature reduce the queries to fetch versions that you mentioned?

Yes, instead of going to NuGet.org, the database will be queried.

HOWEVER, this may actually reduce performance; NuGet.org is a static file system running on Azure Blob storage, and it might be quicker to download the query from Azure than to query your SQL Database.

You'd really need to expirement and see which is faster / more load.

Thanks,
Alana