Welcome to the Inedo Forums! Check out the Forums Guide for help getting started.

If you are experiencing any issues with the forum software, please visit the Contact Form on our website and let us know!

An error duing cargo build



  • An error occurred processing a GET request to http://proget.example.com/cargo/public-cargo/crates/fragile/2.0.1/download: Exception while reading from stream
    
    Npgsql.NpgsqlException (0x80004005): Exception while reading from stream
     ---> System.TimeoutException: Timeout during reading attempt
       at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult()
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Inedo.ProGet.Data.PostgresDatabaseContext.PostgresBatchCommand.ExecuteReader() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Data\PostgresDatabaseContext.cs:line 309
       at Inedo.Data.DatabaseContext.ExecuteInternal(String storedProcName, GenericDbParameter[] parameters, DatabaseCommandReturnType returnType)
       at Inedo.ProGet.Data.DB.Context.PgvdVulnerabilities_GetVulnerabilitiesForPackage(Nullable`1 PackageName_Id) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\obj\Release\net8.0\linux-x64\InedoLib.Analyzers\InedoLib.Analyzers.DatabaseContextGenerator\DB.g.cs:line 3947
       at Inedo.ProGet.Vulnerabilities.VulnerabilityMan.GetVulnerabilitiesForPackageName(PackageNameId packageNameId) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Vulnerabilities\VulnerabilityMan.cs:line 158
       at Inedo.ProGet.Vulnerabilities.VulnerabilityMan.GetVulnerabilitiesForPackageVersion(PackageVersionId packageVersionId) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Vulnerabilities\VulnerabilityMan.cs:line 167
       at Inedo.ProGet.Policies.ComplianceMan.AnalyzePackageInternalAsync(IPackageFeed feed, IPackageMetadata package, Boolean alwaysReanalyze, Func`2 getLocalLatestPatchVersion, ILogSink log, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 110
       at Inedo.ProGet.Policies.ComplianceMan.GetDownloadBlockReasonAsync(IPackageFeed feed, IPackageMetadata package, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 31
       at Inedo.ProGet.Feeds.PackageFeed`5.DownloadPackageAsync(TPackage package, IPackageDownloadContext context, OpenPackageOptions options, PackageInstallContext installContext, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Feeds\PackageFeed.PackageGet.cs:line 249
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoIndexHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoIndexHandler.cs:line 53
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoFeedHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoFeedHandler.cs:line 107
       at Inedo.ProGet.WebApplication.FeedEndpoints.CanonicalFeedHandler`1.Inedo.Web.IHttpAsyncHandler.ProcessRequestAsync(AhHttpContext context) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\CanonicalFeedHandler.cs:line 85
    
    ::Web Error on 22/01/2026 08:14:07::
    


  • This is another error:

        Updating `proget` index
    warning: spurious network error (10 tries remaining): [28] Timeout was reached (Operation too slow. Less than 10 bytes/sec transferred the last 30 seconds)
    warning: spurious network error (10 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (9 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (8 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (7 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (6 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (5 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (4 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (3 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (2 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (1 try remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    error: failed to get `aws-lc-sys` as a dependency of package `aws-lc-rs v1.14.1`
        ... which satisfies dependency `aws-lc-rs = "^1.14"` (locked to 1.14.1) of package `rustls v0.23.35`
        ... which satisfies dependency `rustls = "^0.23.27"` (locked to 0.23.35) of package `tokio-rustls v0.26.4`
        ... which satisfies dependency `tokio-rustls = "^0.26.0"` (locked to 0.26.4) of package `rumqttc v0.25.0`
        ... which satisfies dependency `rumqttc = "^0.25"` (locked to 0.25.0) of package `mycrate v0.0.0 (/mycrate)`
    Caused by:
      failed to query replaced source registry `crates-io`
    Caused by:
      download of aw/s-/aws-lc-sys failed
    Caused by:
      failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
      body:
      {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
     
    
    An error occurred processing a GET request to http://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys: The given key 'version' was not present in the dictionary.
    
    System.Collections.Generic.KeyNotFoundException: The given key 'version' was not present in the dictionary.
       at Inedo.ProGet.Feeds.Cargo.CargoMetadata.<.ctor>g__getDependency|3_4(KeyValuePair`2 dependency) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Feeds\Cargo\CargoMetadata.cs:line 152
       at System.Linq.Enumerable.SelectManySingleSelectorIterator`2.MoveNext()
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoIndexHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoIndexHandler.cs:line 106
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoIndexHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoIndexHandler.cs:line 89
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoFeedHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoFeedHandler.cs:line 107
       at Inedo.ProGet.WebApplication.FeedEndpoints.CanonicalFeedHandler`1.Inedo.Web.IHttpAsyncHandler.ProcessRequestAsync(AhHttpContext context) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\CanonicalFeedHandler.cs:line 85
    
    ::Web Error on 16/01/2026 13:02:14::
    


  • We found more. We are using version 2025.18 (build 13). This all happened together:
    1st:

    An error occurred processing a GET request to http://proget.example.com/cargo/public-cargo/crates/cfg-if/1.0.4/download: Internal Npgsql bug: unexpected value 0 of enum BackendMessageCode. Please file a bug.
    
    System.InvalidOperationException: Internal Npgsql bug: unexpected value 0 of enum BackendMessageCode. Please file a bug.
       at Npgsql.ThrowHelper.ThrowInvalidOperationException(String message)
       at Npgsql.Internal.NpgsqlConnector.ParseServerMessage(NpgsqlReadBuffer buf, BackendMessageCode code, Int32 len, Boolean isPrependedMessage, Boolean handleCallbacks)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult()
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteNonQuery(Boolean async, CancellationToken cancellationToken)
       at Inedo.ProGet.Data.PostgresDatabaseContext.CreateConnection() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Data\PostgresDatabaseContext.cs:line 71
       at Inedo.Data.DatabaseContext.ExecuteInternal(String storedProcName, GenericDbParameter[] parameters, DatabaseCommandReturnType returnType)
       at Inedo.Data.DatabaseContext.ExecuteNonQuery(String storedProcName, GenericDbParameter[] parameters)
       at Inedo.ProGet.Data.DB.Context.PackageVersionIds_GetOrCreatePackageVersionId(Nullable`1 PackageName_Id, String Package_Version, String Qualifier_Text, Nullable`1 CreateId_Indicator, Nullable`1 PackageVersion_Id) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\obj\Release\net8.0\linux-x64\InedoLib.Analyzers\InedoLib.Analyzers.DatabaseContextGenerator\DB.g.cs:line 3769
       at Inedo.ProGet.Policies.ComplianceMan.AnalyzePackageInternalAsync(IPackageFeed feed, IPackageMetadata package, Boolean alwaysReanalyze, Func`2 getLocalLatestPatchVersion, ILogSink log, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 62
       at Inedo.ProGet.Policies.ComplianceMan.GetDownloadBlockReasonAsync(IPackageFeed feed, IPackageMetadata package, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 31
       at Inedo.ProGet.Feeds.PackageFeed`5.DownloadPackageAsync(TPackage package, IPackageDownloadContext context, OpenPackageOptions options, PackageInstallContext installContext, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Feeds\PackageFeed.PackageGet.cs:line 249
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoIndexHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoIndexHandler.cs:line 53
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoFeedHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoFeedHandler.cs:line 107
       at Inedo.ProGet.WebApplication.FeedEndpoints.CanonicalFeedHandler`1.Inedo.Web.IHttpAsyncHandler.ProcessRequestAsync(AhHttpContext context) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\CanonicalFeedHandler.cs:line 85
    
    ::Web Error on 26/01/2026 10:13:22::
    

    2nd:

    An error occurred processing a GET request to http://proget.example.com/cargo/public-cargo/crates/cfg-if/1.0.4/download: Internal Npgsql bug: unexpected value 0 of enum BackendMessageCode. Please file a bug.
    
    System.InvalidOperationException: Internal Npgsql bug: unexpected value 0 of enum BackendMessageCode. Please file a bug.
       at Npgsql.ThrowHelper.ThrowInvalidOperationException(String message)
       at Npgsql.Internal.NpgsqlConnector.ParseServerMessage(NpgsqlReadBuffer buf, BackendMessageCode code, Int32 len, Boolean isPrependedMessage, Boolean handleCallbacks)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult()
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteNonQuery(Boolean async, CancellationToken cancellationToken)
       at Inedo.ProGet.Data.PostgresDatabaseContext.CreateConnection() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Data\PostgresDatabaseContext.cs:line 71
       at Inedo.Data.DatabaseContext.ExecuteInternal(String storedProcName, GenericDbParameter[] parameters, DatabaseCommandReturnType returnType)
       at Inedo.Data.DatabaseContext.ExecuteNonQuery(String storedProcName, GenericDbParameter[] parameters)
       at Inedo.ProGet.Data.DB.Context.PackageVersionIds_GetOrCreatePackageVersionId(Nullable`1 PackageName_Id, String Package_Version, String Qualifier_Text, Nullable`1 CreateId_Indicator, Nullable`1 PackageVersion_Id) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\obj\Release\net8.0\linux-x64\InedoLib.Analyzers\InedoLib.Analyzers.DatabaseContextGenerator\DB.g.cs:line 3769
       at Inedo.ProGet.Policies.ComplianceMan.AnalyzePackageInternalAsync(IPackageFeed feed, IPackageMetadata package, Boolean alwaysReanalyze, Func`2 getLocalLatestPatchVersion, ILogSink log, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 62
       at Inedo.ProGet.Policies.ComplianceMan.GetDownloadBlockReasonAsync(IPackageFeed feed, IPackageMetadata package, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 31
       at Inedo.ProGet.Feeds.PackageFeed`5.DownloadPackageAsync(TPackage package, IPackageDownloadContext context, OpenPackageOptions options, PackageInstallContext installContext, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Feeds\PackageFeed.PackageGet.cs:line 249
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoIndexHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoIndexHandler.cs:line 53
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoFeedHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoFeedHandler.cs:line 107
       at Inedo.ProGet.WebApplication.FeedEndpoints.CanonicalFeedHandler`1.Inedo.Web.IHttpAsyncHandler.ProcessRequestAsync(AhHttpContext context) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\CanonicalFeedHandler.cs:line 85
    
    ::Web Error on 26/01/2026 10:13:22::
    

    3rd:

    An error occurred processing a GET request to http://proget.example.com/cargo/public-cargo/crates/chrono/0.4.42/download: Exception while reading from stream
    
    Npgsql.NpgsqlException (0x80004005): Exception while reading from stream
     ---> System.TimeoutException: Timeout during reading attempt
       at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult()
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Inedo.ProGet.Data.PostgresDatabaseContext.PostgresBatchCommand.ExecuteReader() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Data\PostgresDatabaseContext.cs:line 309
       at Inedo.Data.DatabaseContext.ExecuteInternal(String storedProcName, GenericDbParameter[] parameters, DatabaseCommandReturnType returnType)
       at Inedo.ProGet.Data.DB.Context.Licenses_GetAllLicenseData() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\obj\Release\net8.0\linux-x64\InedoLib.Analyzers\InedoLib.Analyzers.DatabaseContextGenerator\DB.g.cs:line 3311
       at Inedo.ProGet.Licenses.LicenseMan.LicLookups..ctor() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Licenses\LicenseMan.cs:line 291
       at Inedo.ProGet.Licenses.LicenseMan.LicLookups.Create() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Licenses\LicenseMan.cs:line 327
       at Inedo.LazyCached`1.GetValue()
       at Inedo.ProGet.Licenses.LicenseMan.FindLicenseFromPurl(PackageVersionId pUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Licenses\LicenseMan.cs:line 60
       at Inedo.ProGet.Licenses.LicenseMan.FindLicensesAsync(PackageVersionId purl, PackageLicenseDeclaration licenseDeclaration, GetFileWithinPackageHandler getFileHandler, CancellationToken cancellationToken)+MoveNext() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Licenses\LicenseMan.cs:line 94
       at Inedo.ProGet.Licenses.LicenseMan.FindLicensesAsync(PackageVersionId purl, PackageLicenseDeclaration licenseDeclaration, GetFileWithinPackageHandler getFileHandler, CancellationToken cancellationToken)+System.Threading.Tasks.Sources.IValueTaskSource<System.Boolean>.GetResult()
       at System.Linq.AsyncEnumerable.<ToListAsync>g__Core|424_0[TSource](IAsyncEnumerable`1 source, CancellationToken cancellationToken) in /_/Ix.NET/Source/System.Linq.Async/System/Linq/Operators/ToList.cs:line 36
       at System.Linq.AsyncEnumerable.<ToListAsync>g__Core|424_0[TSource](IAsyncEnumerable`1 source, CancellationToken cancellationToken)
       at Inedo.ProGet.Policies.ComplianceMan.AnalyzePackageInternalAsync(IPackageFeed feed, IPackageMetadata package, Boolean alwaysReanalyze, Func`2 getLocalLatestPatchVersion, ILogSink log, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 96
       at Inedo.ProGet.Policies.ComplianceMan.GetDownloadBlockReasonAsync(IPackageFeed feed, IPackageMetadata package, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 31
       at Inedo.ProGet.Feeds.PackageFeed`5.DownloadPackageAsync(TPackage package, IPackageDownloadContext context, OpenPackageOptions options, PackageInstallContext installContext, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Feeds\PackageFeed.PackageGet.cs:line 249
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoIndexHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoIndexHandler.cs:line 53
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoFeedHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoFeedHandler.cs:line 107
       at Inedo.ProGet.WebApplication.FeedEndpoints.CanonicalFeedHandler`1.Inedo.Web.IHttpAsyncHandler.ProcessRequestAsync(AhHttpContext context) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\CanonicalFeedHandler.cs:line 85
    
    ::Web Error on 26/01/2026 10:13:44::
    

    4th:

    An error occurred processing a GET request to http://proget.example.com/cargo/public-cargo/crates/ipnet/2.11.0/download: Internal Npgsql bug: unexpected value 0 of enum BackendMessageCode. Please file a bug.
    
    System.InvalidOperationException: Internal Npgsql bug: unexpected value 0 of enum BackendMessageCode. Please file a bug.
       at Npgsql.ThrowHelper.ThrowInvalidOperationException(String message)
       at Npgsql.Internal.NpgsqlConnector.ParseServerMessage(NpgsqlReadBuffer buf, BackendMessageCode code, Int32 len, Boolean isPrependedMessage, Boolean handleCallbacks)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult()
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteNonQuery(Boolean async, CancellationToken cancellationToken)
       at Inedo.ProGet.Data.PostgresDatabaseContext.CreateConnection() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Data\PostgresDatabaseContext.cs:line 71
       at Inedo.Data.DatabaseContext.ExecuteInternal(String storedProcName, GenericDbParameter[] parameters, DatabaseCommandReturnType returnType)
       at Inedo.Data.DatabaseContext.ExecuteNonQuery(String storedProcName, GenericDbParameter[] parameters)
       at Inedo.ProGet.Data.DB.Context.PackageNameIds_GetOrCreatePackageNameId(String PackageType_Name, String PackageGroup_Name, String Package_Name, Nullable`1 CreateId_Indicator, Nullable`1 PackageName_Id) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\obj\Release\net8.0\linux-x64\InedoLib.Analyzers\InedoLib.Analyzers.DatabaseContextGenerator\DB.g.cs:line 3663
       at Inedo.ProGet.PackageNameId.EnsureDatabaseId(Context db) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\PackageNameId.cs:line 74
       at Inedo.ProGet.Policies.ComplianceMan.AnalyzePackageInternalAsync(IPackageFeed feed, IPackageMetadata package, Boolean alwaysReanalyze, Func`2 getLocalLatestPatchVersion, ILogSink log, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 62
       at Inedo.ProGet.Policies.ComplianceMan.GetDownloadBlockReasonAsync(IPackageFeed feed, IPackageMetadata package, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 31
       at Inedo.ProGet.Feeds.PackageFeed`5.DownloadPackageAsync(TPackage package, IPackageDownloadContext context, OpenPackageOptions options, PackageInstallContext installContext, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Feeds\PackageFeed.PackageGet.cs:line 249
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoIndexHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoIndexHandler.cs:line 53
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoFeedHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoFeedHandler.cs:line 107
       at Inedo.ProGet.WebApplication.FeedEndpoints.CanonicalFeedHandler`1.Inedo.Web.IHttpAsyncHandler.ProcessRequestAsync(AhHttpContext context) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\CanonicalFeedHandler.cs:line 85
    
    ::Web Error on 26/01/2026 10:13:53::
    

    5th:

    An error occurred processing a GET request to http://proget.example.com/cargo/public-cargo/crates/scopeguard/1.2.0/download: Internal Npgsql bug: unexpected value 0 of enum BackendMessageCode. Please file a bug.
    
    System.InvalidOperationException: Internal Npgsql bug: unexpected value 0 of enum BackendMessageCode. Please file a bug.
       at Npgsql.ThrowHelper.ThrowInvalidOperationException(String message)
       at Npgsql.Internal.NpgsqlConnector.ParseServerMessage(NpgsqlReadBuffer buf, BackendMessageCode code, Int32 len, Boolean isPrependedMessage, Boolean handleCallbacks)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult()
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteNonQuery(Boolean async, CancellationToken cancellationToken)
       at Inedo.ProGet.Data.PostgresDatabaseContext.CreateConnection() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Data\PostgresDatabaseContext.cs:line 71
       at Inedo.Data.DatabaseContext.ExecuteInternal(String storedProcName, GenericDbParameter[] parameters, DatabaseCommandReturnType returnType)
       at Inedo.Data.StrongDataReader.Read[TRow](Func`1 getReader, Boolean disposeReader)+MoveNext()
       at System.Linq.Enumerable.TryGetFirst[TSource](IEnumerable`1 source, Boolean& found)
       at Inedo.ProGet.WebApplication.FeedEndpoints.CanonicalFeedHandler`1.GetFeedRequestArguments(AhHttpContext context) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\CanonicalFeedHandler.cs:line 45
       at Inedo.ProGet.WebApplication.FeedEndpoints.CanonicalFeedHandler`1.Inedo.Web.IHttpAsyncHandler.ProcessRequestAsync(AhHttpContext context)
    
    ::Web Error on 26/01/2026 10:13:53::
    

    6th:

    An error occurred processing a GET request to http://proget.example.com/cargo/public-cargo/crates/rusttype/0.9.3/download: Exception while reading from stream
    
    Npgsql.NpgsqlException (0x80004005): Exception while reading from stream
     ---> System.TimeoutException: Timeout during reading attempt
       at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong|55_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.Internal.NpgsqlConnector.ReadMessageLong(Boolean async, DataRowLoadingMode dataRowLoadingMode, Boolean readingNotifications, Boolean isReadingPrependedMessage)
       at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult(Boolean async, Boolean isConsuming, CancellationToken cancellationToken)
       at Npgsql.NpgsqlDataReader.NextResult()
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteReader(Boolean async, CommandBehavior behavior, CancellationToken cancellationToken)
       at Npgsql.NpgsqlCommand.ExecuteNonQuery(Boolean async, CancellationToken cancellationToken)
       at Inedo.ProGet.Data.PostgresDatabaseContext.CreateConnection() in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Data\PostgresDatabaseContext.cs:line 71
       at Inedo.Data.DatabaseContext.ExecuteInternal(String storedProcName, GenericDbParameter[] parameters, DatabaseCommandReturnType returnType)
       at Inedo.ProGet.Data.DB.Context.PgvdVulnerabilities_GetVulnerabilitiesForPackage(Nullable`1 PackageName_Id) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\obj\Release\net8.0\linux-x64\InedoLib.Analyzers\InedoLib.Analyzers.DatabaseContextGenerator\DB.g.cs:line 3947
       at Inedo.ProGet.Vulnerabilities.VulnerabilityMan.GetVulnerabilitiesForPackageName(PackageNameId packageNameId) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Vulnerabilities\VulnerabilityMan.cs:line 158
       at Inedo.ProGet.Vulnerabilities.VulnerabilityMan.GetVulnerabilitiesForPackageVersion(PackageVersionId packageVersionId) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Vulnerabilities\VulnerabilityMan.cs:line 167
       at Inedo.ProGet.Policies.ComplianceMan.AnalyzePackageInternalAsync(IPackageFeed feed, IPackageMetadata package, Boolean alwaysReanalyze, Func`2 getLocalLatestPatchVersion, ILogSink log, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 110
       at Inedo.ProGet.Policies.ComplianceMan.GetDownloadBlockReasonAsync(IPackageFeed feed, IPackageMetadata package, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Policies\ComplianceMan.cs:line 31
       at Inedo.ProGet.Feeds.PackageFeed`5.DownloadPackageAsync(TPackage package, IPackageDownloadContext context, OpenPackageOptions options, PackageInstallContext installContext, CancellationToken cancellationToken) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Feeds\PackageFeed.PackageGet.cs:line 249
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoIndexHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoIndexHandler.cs:line 53
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoFeedHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoFeedHandler.cs:line 107
       at Inedo.ProGet.WebApplication.FeedEndpoints.CanonicalFeedHandler`1.Inedo.Web.IHttpAsyncHandler.ProcessRequestAsync(AhHttpContext context) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\CanonicalFeedHandler.cs:line 85
    
    ::Web Error on 26/01/2026 10:14:25::
    

  • inedo-engineer

    Hi @caspacokku_2900 ,

    I'm afraid these errors aren't related to Cargo, but are indicating some kind of system/network error. In some cases, there's a unexpected/broken network configuration between the ProGet application and the underlying database (PostgreSQL).

    In other cases, it appears to be related to connections to cargo's public repository.

    So bottom line, this is an environment-specific issue. Can you tell us a bit about your configuration? How about a Paste of Admin > System Information?

    Thanks,
    Alana



  • Oh. that's concerning. We do have more connectors like npm, docker and python and all those are fine. It's only cargo that we have had problems with, that generate tons of errors.

    Our system is baseline debian 13. Using docker to run ProGet.

    Connection String: 
    Web UI Version: 2025.18 (Build 13)
    Database Schema Version: 25.0.18.13
    SQL Server Version: PostgreSQL 17.7 (Debian 17.7-3.pgdg12+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 12.2.0-14+deb12u1) 12.2.0, 64-bit
    db_owner: True
    Database Name: proget
    Database Collation: C (UTF8)
    Database Recovery Model: Default (1)
    Database Read Committed Snapshot: True
    Database Auto Update Stats: True
    

  • inedo-engineer

    Hi @caspacokku_2900 ,

    Yeah it's pretty weird. The errors are all over the place - not like in a specific database query or anything like that. This also isn't a sign of server-overload that we've seen.

    It's as if internal network connectivity is somehow breaking within a container? Or there's "something else" wrong with the internal PostgreSQL server? These are all "deep system" level errors in basically operating-system level code (drivers, etc).

    We've seen this with another user with really weird errors, but no idea on how to reproduce it. Maybe it's an "error reporting an error".

    As for the feed... there's nothing special about cargo vs other feeds from an API/usage standpoint. If anything, npm hammers the server a lot harder with its 1000+ package restores. And this has nothing to do with connectors.

    Unfortunately we don't have a lot to go on:

    • how about increasing hardware
    • can you try a different physical server
    • could it somehow be the underlying operating system?
    • any patterns as to when this is happening (lots of traffic etc)

    Any clues or consistency would help.

    Thanks,
    Alana



  • @atripp Hi.

    So my team has clarified a bit. We get these Exception while reading from stream and Internal Npgsql bug: unexpected value 0 of enum BackendMessageCode when the Connector Crate Caching is disabled, because if it's ON, we get this error, so to workaround this issue they disabled the caching:

        Updating `proget` index
    warning: spurious network error (10 tries remaining): [28] Timeout was reached (Operation too slow. Less than 10 bytes/sec transferred the last 30 seconds)
    warning: spurious network error (10 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (9 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (8 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (7 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (6 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (5 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (4 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (3 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (2 tries remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    warning: spurious network error (1 try remaining): failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
    body:
    {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    error: failed to get `aws-lc-sys` as a dependency of package `aws-lc-rs v1.14.1`
        ... which satisfies dependency `aws-lc-rs = "^1.14"` (locked to 1.14.1) of package `rustls v0.23.35`
        ... which satisfies dependency `rustls = "^0.23.27"` (locked to 0.23.35) of package `tokio-rustls v0.26.4`
        ... which satisfies dependency `tokio-rustls = "^0.26.0"` (locked to 0.26.4) of package `rumqttc v0.25.0`
        ... which satisfies dependency `rumqttc = "^0.25"` (locked to 0.25.0) of package `mycrate v0.0.0 (/mycrate)`
    Caused by:
      failed to query replaced source registry `crates-io`
    Caused by:
      download of aw/s-/aws-lc-sys failed
    Caused by:
      failed to get successful HTTP response from `https://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys` (172.16.1.3), got 500
      body:
      {"errors":[{"detail":"The given key \u0027version\u0027 was not present in the dictionary.\r\nSystem.Collections.Generic.KeyNotFoundException: The given key \u0027version\u0027 was not present in the dictionary.\n   at Inedo.ProGet.Feeds.Cargo.CargoMetadata.\u003C.ctor\u003Eg__getDependency|3_4(KeyValuePair\u00602 dependency) in C:\\Users\\builds\\AppData\\Local\\Temp\\InedoAgent\\BuildMaster\\192.168.44.60\\Temp\\_E627894\\Src\\src\\ProGet\\Feeds\\Cargo\\CargoMetadata.cs:line 152\n   at System.Linq.Enumer…
    
    An error occurred processing a GET request to http://proget.example.com/cargo/public-cargo/aw/s-/aws-lc-sys: The given key 'version' was not present in the dictionary.
    
    System.Collections.Generic.KeyNotFoundException: The given key 'version' was not present in the dictionary.
       at Inedo.ProGet.Feeds.Cargo.CargoMetadata.<.ctor>g__getDependency|3_4(KeyValuePair`2 dependency) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\Feeds\Cargo\CargoMetadata.cs:line 152
       at System.Linq.Enumerable.SelectManySingleSelectorIterator`2.MoveNext()
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoIndexHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoIndexHandler.cs:line 106
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoIndexHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoIndexHandler.cs:line 89
       at Inedo.ProGet.WebApplication.FeedEndpoints.Cargo.CargoFeedHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, CargoFeed feed, String relativeUrl) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\Cargo\CargoFeedHandler.cs:line 107
       at Inedo.ProGet.WebApplication.FeedEndpoints.CanonicalFeedHandler`1.Inedo.Web.IHttpAsyncHandler.ProcessRequestAsync(AhHttpContext context) in C:\Users\builds\AppData\Local\Temp\InedoAgent\BuildMaster\192.168.44.60\Temp\_E627894\Src\src\ProGet\WebApplication\FeedEndpoints\CanonicalFeedHandler.cs:line 85
    
    ::Web Error on 16/01/2026 13:02:14::
    

    So the team has disabled the Connector Crate Caching entirely. But if the Caching is ON, we need to clear the cache for the aws-lc-sys package to download. We are not entirely sure if these other Exception while reading from stream and Internal Npgsql bug: unexpected value 0 of enum BackendMessageCode are appearing only during when the Connector Crate Caching is disabled or not.

    So if we could get this error fixed, so that our Connector Crate Caching is ON again, we could probably see if that's related to the Exceptions and Internal Npgsql bug


  • inedo-engineer

    Hi @caspacokku_2900,

    Would you be able to send us over a Cargo.toml that can recreate the errors you are seeing? Although this all points to server overload, that will at least allow me to attempt to recreate the errors you are seeing.

    Thanks,
    Rich



  • This post is deleted!

  • inedo-engineer

    Hi @caspacokku_2900,

    Thanks for sending an example over. I did test this, but I was unable to recreate the postgres errors you were seeing. If you are using ProGet as a mirror to crates.io, one thing that may be helpful is to modify the Dependency Resolution on the Feed Properties page. Standard resolution has to check in ProGet to determine if the dependency exists or not to determine when to tall the cargo client to use ProGet vs crates.io. That will help with the retries and getting rate limited on crates.io. These are things to just help reduce load from Cargo on the ProGet server.

    Does this happen every time you pull packages using cargo?

    Thanks,
    Rich


Log in to reply
 

Inedo Website HomeSupport HomeCode of ConductForums GuideDocumentation