Navigation

    Inedo Community Forums

    Forums

    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups
    1. Home
    2. scott.wright_8356
    3. Posts
    S
    • Profile
    • Following
    • Followers
    • Topics
    • Posts
    • Best
    • Groups

    Posts made by scott.wright_8356

    • ProGet Connector Timeout

      Hi Everyone,

      We have an issue with our ProGet server running 24.0.6. We have added some new caching feeds and getting the following error in the logs consistently a few times a day.

      Level:Warning
      Category:Connector
      Message:Unable to fetch connector data; using cached copy.
      Details:System.Net.WebException: The operation has timed out.
      at System.Net.HttpWebRequest.EndGetResponse(IAsyncResult asyncResult)
      at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction, Task`1 promise, Boolean requiresSynchronization)
      --- End of stack trace from previous location ---
      at System.Net.WebRequest.GetResponseAsync()
      at Inedo.ProGet.Feeds.Connector.GetDirectResponseAsync(String url)
      at Inedo.ProGet.Feeds.Connector.GetCachedResponseAsync(String url)
      

      We are unable to tell from the logs which connector is timing out. We want to check the network and firewall and ensure no errors for the public URL. Is there a way to determine this?

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • RE: ProGet Lock Issues

      I set our metadata caching to 10000 queries over 24 hours. I will reduce to the default first and monitor.

      Thanks Dean

      posted in Support
      S
      scott.wright_8356
    • RE: ProGet Lock Issues

      Hi Dean,

      We have narrowed the problem down to a particular query causing SQL CPU Blocking. Connectors_GetCachedResponse. This is causing significant timeouts when our server is under load.

      ALTER PROCEDURE [dbo].[Connectors_GetCachedResponse]
      (
        @Connector_Id INT,
        @Request_Hash BINARY(32)
      )
      AS BEGIN

      SET NOCOUNT ON

      BEGIN TRY
        BEGIN TRANSACTION

      UPDATE [ConnectorResponses]
         SET [LastUsed_Date] = GETUTCDATE(),
         [Request_Count] = [Request_Count] + 1
         WHERE [Connector_Id] = @Connector_Id
         AND [Request_Hash] = @Request_Hash

      SELECT *
         FROM [ConnectorResponses]
         WHERE [Connector_Id] = @Connector_Id
         AND [Request_Hash] = @Request_Hash

      COMMIT
      END TRY BEGIN CATCH
        IF XACT_STATE()<>0 ROLLBACK
        EXEC [HandleError]
      END CATCH

      END

      3517e4f8-864b-472f-ba1b-3ebf69a23c67-image.png

      posted in Support
      S
      scott.wright_8356
    • ProGet Lock Issues

      Hi ProGet Support,

      We have an issue where our High-Availability ProGet infrastructure uses over 1000 SQL connections and reaches the max pool size. Some investigation on the SQL server using the activity monitor has shown the following queries running.

      CREATE PROCEDURE [PgvdVulnerabilities_GetVulnerabilitiesForPackage]
      (
      	@PackageName_Id INT
      )
      AS
      BEGIN
       
          SELECT * INTO #PgvdPackageNames FROM [PgvdPackageNames_Extended] WHERE [PackageName_Id] = @PackageName_Id
          SELECT * FROM [PgvdVulnerabilities_Extended] 
           WHERE [Pgvd_Id] IN (SELECT [Pgvd_Id] FROM #PgvdPackageNames)
       
          SELECT * FROM #PgvdPackageNames
       
          SELECT * FROM [PgvdAssessments_Extended]
           WHERE [Pgvd_Id] IN (SELECT [Pgvd_Id] FROM #PgvdPackageNames)
       
      END
      
      CREATE PROCEDURE [Feeds_GetExtendedConfiguration]
      (
      	@Feed_Id INT
      )
      AS
      BEGIN
       
      	SET NOCOUNT ON
       
      	SELECT *
      	  FROM [FeedPackageAccessRules]
      	 WHERE [Feed_Id] = @Feed_Id
      	 ORDER BY [Sequence_Number]
       
      	SELECT C.*
      	  FROM [FeedConnectors] FC
      	       INNER JOIN [Connectors] C
      		           ON C.[Connector_Id] = FC.[Connector_Id]
      	 WHERE FC.[Feed_Id] = @Feed_Id
      	 ORDER BY FC.[Sequence_Number]
       
      	SELECT *
      	  FROM [FeedPackageFilters]
      	 WHERE [Feed_Id] = @Feed_Id
      	 ORDER BY [Sequence_Number]
       
      END
      

      This is causing an object lock

      0a7b85d3-e641-4094-bc4e-4be74f4c0756-image.png

      Our CD/CI process keeps requesting packages, and within 5 minutes, all the have 1000's of connections, and we get the following errors in ProGet when the lock releases.

      An error occurred processing a GET request to http://proget.XXXXX/npm/Registry/cache-base: Timeout expired. The timeout period elapsed prior to obtaining a connection from the pool. This may have occurred because all pooled connections were in use and max pool size was reached.
      Details:System.InvalidOperationException: Timeout expired. The timeout period elapsed prior to obtaining a connection from the pool. This may have occurred because all pooled connections were in use and max pool size was reached.
      at Microsoft.Data.Common.ADP.ExceptionWithStackTrace(Exception e)
      --- End of stack trace from previous location ---
      at Inedo.Data.SqlServerDatabaseContext.CreateConnectionAsync()
      at Inedo.Data.DatabaseContext.ExecuteInternalAsync(String storedProcName, GenericDbParameter[] parameters)
      at Inedo.Data.SqlServerDatabaseContext.ExecuteInternalAsync(String storedProcName, GenericDbParameter[] parameters)
      at Inedo.Data.DatabaseContext.ExecuteTableAsync[TRow](String storedProcName, GenericDbParameter[] parameters)
      at Inedo.ProGet.WebApplication.FeedEndpoints.Npm.NpmPackageMetadataHandler.TryProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, NpmFeed feed, String relativeUrl)
      at Inedo.ProGet.WebApplication.FeedEndpoints.Npm.NpmHandler.ProcessRequestAsync(AhHttpContext context, WebApiContext apiContext, NpmFeed feed, String relativeUrl)
      at Inedo.ProGet.WebApplication.FeedEndpoints.FeedEndpointHandler.FeedRequestHandler.ProcessRequestAsync(AhHttpContext context)
      

      We are running version 23.0.31.

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • RE: Conda Feed to SMB Share

      @rhessinger Wonderful, thank you very much and credit to Pawel Ostrowski who also did a lot of investigation on this

      posted in Support
      S
      scott.wright_8356
    • RE: Conda Feed to SMB Share

      Hi Alana,

      What we did find to get our small applications working was the following post. This mentioned that when opening the file the path should start with four backslashes. "\\"

      https://stackoverflow.com/questions/41330660/sqlite-database-file-cant-be-opened-when-placed-in-network-folder

      https://stackoverflow.com/questions/17303076/sqlite-cannot-open-network-file-programmatically-even-though-worked-before

      This worked for our small applications and allowed the SQL lite package to work over the SMB share.

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • RE: Conda Feed to SMB Share

      Hi Alana,

      We have written many simple programs using the same SQL Lite package as above. We cannot find a scenario where SQL Lite works over an SMB share, and we have been able to find content that says not to use it over the network. We were able to confirm that the create database option works fine. It is the opening that fails every time. What happens with the OpenOrCreateDatabase is it rolls back the file created when the open fails, so you end up with nothing.

      https://www.sqlite.org/useovernet.html

      https://stackoverflow.com/questions/788517/sqlite-over-a-network-share

      We are using the IIS setup. Has this been tested with IIS and SMB share for Conda? I assume the index information for the package repository is what is going into the SQL Lite DB? Would it not be faster to store this information locally on each node? Does the SQL Lite DB need to be shared?

      Is there an option to set the Conda/Debian package storage on the network share and the SQL Lite DB locally for each node?

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • RE: Conda Feed to SMB Share

      Hi Alana,

      We wrote a program to use the SQL Lite library and ran it from the ProGet Node.

      e46f533d-817b-44d4-a112-8ff1c59c8a17-image.png

      0dcf3131-557c-4515-9b4b-c87a9012e8e9-image.png

      3b9357dd-30db-4bc3-a6a9-d6adfcf24974-image.png

      This is from the ProGet node server to our ProGet SMB share, and there are no issues. It is just the ProGet application that is having a problem.

      posted in Support
      S
      scott.wright_8356
    • Conda Feed to SMB Share

      Hi Support,

      We have an issue creating a Conda feed to an SMB share. The SQL Lite file cannot be created there; we are running a High Availability structure with no issues with NuGet, Npm, Python, and Maven feeds. With the Conda feed, we get
      20aa33ef-3605-434e-b200-ff8ac39766df-image.png

      Is there a particular port that ProGet requires when communicating with SMB share for SQL Lite? We can get the feed working with local storage on one of the nodes but not with the shared storage. When we put the SQL lite file there manually and refresh the feed, it is deleted. It is like clearing the file and then attempting to write it there using a different process than the other feeds.

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • RE: ProGet New Vulnerability scanning removes ability to block a package

      Thank you very much for this, Alana. Very much appreciated.

      posted in Support
      S
      scott.wright_8356
    • RE: ProGet New Vulnerability scanning removes ability to block a package

      Hi Alana,

      How do we set the package status to blocked? I cannot find this option against these packages, which is what I have been looking for. I remember it being there, but it appears to be gone in version 23.0.31. Also, regarding the above response, do you intend to allow users to modify the vulnerability database or not? The style of the answer indicates no.

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • ProGet New Vulnerability scanning removes ability to block a package

      Hi Support,

      We have an issue with the Moq library in NuGet. The Vulnerability assessment is wrong and has a limited list of versions to block.

      PGV-2358804: Moq v4.20.0-rc to 4.20.1 share hashed user data

      We have confirmed that 40.20.2 and 4.20.69 still have the vulnerability, but we cannot clock these in the new versions of ProGet now. How do we extend the vulnerabilities to block packages that are a problem? I can understand why these versions were missed, as you need to go through the commits that make up the versions and check them for yourself. This is why the ability to block manually on the existing version was so important.

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • Package Latest Version not showing in All Versions

      Hi Support,

      We often have an issue showing up for a npm feed. The feed is a public cache feed of https://registry.npmjs.org with metadata caching enabled. What is happening is that on the feed when searching the package, it is showing the latest version.

      8fd21fa9-b3de-4610-b727-05f184256152-image.png

      When selecting that version, we get the following error.

      2be5ac82-e5b5-4c0c-844c-011c6d07349c-image.png

      Also, we cannot see the latest package when looking at All Versions.

      9f856f59-990a-4aec-be95-08d64cc9b986-image.png

      This issue fixes itself over time. However, for example, this package is updated hourly, consumed as a dependency, and causes intermittent build issues in our CD/CI.

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • ProGet Enteprise License Update

      Hi Support,

      We just updated our High Availably structure with a new ProGet Enterprise license key and received the following error message.

      Logged:2/04/2024 9:32:36 AM
      Level:Error
      Category:Web
      Message:An error occurred in the web application: No primary service node has been registered.
      Details:URL: http://proget.wtg.zone/administration/licensing/change-license-key
      Referrer: https://proget.wtg.zone/administration/licensing/change-license-key
      User: SW
      User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36 Edg/122.0.0.0
      Stack trace: at Inedo.ProGet.WebApplication.AggregateServiceMessengerClient.GetPrimaryNodeId()
      at Inedo.ProGet.WebApplication.AggregateServiceMessengerClient.SendMessage(ServiceMessage message)
      at Inedo.ProGet.WebApplication.Pages.Administration.Licensing.ChangeLicenseKeyPage.<>c__DisplayClass1_0.<<CreateChildControls>b__0>d.MoveNext()
      --- End of stack trace from previous location ---
      at Inedo.Web.PageFree.SimplePageBase.ExecutePageLifeCycleAsync()
      at Inedo.Web.PageFree.SimplePageBase.ProcessRequestAsync(AhHttpContext context)
      at Inedo.Web.AhWebMiddleware.InvokeAsync(HttpContext context)
      

      I went back to the page and found the key had successfully updated. I manually ran the activation process. It appears to be working, as the expiry date has updated on the license.

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • RE: Maven Andriod Endpoint URL

      @atripp We determined what the issue was. Our firewall had application identification enabled and hence blocked it. Can we find out what the Connector Health check is doing? In our case, some connectors were not healthy. ProGet was reporting healthy in its checks.

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • RE: Maven Andriod Endpoint URL

      Thank you Alana,

      I will investigate a lot more and see if I can work something out over the weekend. Will post back here the results if still stuck.

      posted in Support
      S
      scott.wright_8356
    • RE: Maven Andriod Endpoint URL

      @atripp said in Maven Andriod Endpoint URL:

      https://dl.google.com/android/maven2

      We have a problem with this on our old server. We have the packages on the feed. We have imported them to the new ProGet Server. The connector is setup correctly.

      53d256d5-6ff4-44c3-aa0c-75dbcad069c1-image.png

      It is healthy

      e3a8eb7c-6dae-4066-ac8c-5ba2e3aa0a18-image.png

      It is connected to the feed.

      b5a54564-3e6c-46d7-9c5b-97ed07e9e1d3-image.png

      When we request the package, we are after we get the following.

      9dcc7759-2fe9-4786-b1af-05042e7fcb16-image.png

      We have attempted to import the old servers' packages directory as a temporary fix, but we get the following error for all the imports from the other package directory.

      Added Maven Package com.android.tools.build/gradle 1.5.0.
      Could not add file "\proget-smb.wtg.zone\Proget\F12\android.arch.core\common\1.1.0\common-1.1.0-sources.jar". There was not matching pom file.
      Could not add file "\proget-smb.wtg.zone\Proget\F12\android.arch.core\common\1.1.0\common-1.1.0.jar". There was not matching pom file.

      When we look at packages that were successfully imported, we get the following error:

      3f9ac923-6ebe-417f-a358-619e11ebd1bf-image.png

      With a corresponding record in the diagnostic log.

      Level:Error
      Category:Web
      Message:An error occurred in the web application: Object reference not set to an instance of an object.
      Details:URL: http://proget.wtg.zone/feeds/Maven-Android/com.android.tools.build/com.android.tools.build.gradle/1.5.0
      Referrer: https://proget.wtg.zone/packages
      User: SW
      User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36 Edg/122.0.0.0
      Stack trace: at Inedo.ProGet.Feeds.Maven.MavenFeed.Inedo.ProGet.Feeds.IBrowsablePackageFeed.ListPackageVersionsAsync(BrowsablePackageId id)
      at Inedo.ProGet.WebApplication.Pages.Packages.PackagePageBase.CreateChildControlsAsync()
      at Inedo.ProGet.WebApplication.Pages.ProGetSimplePage.InitializeAsync()
      at Inedo.Web.PageFree.SimplePageBase.ExecutePageLifeCycleAsync()
      at Inedo.Web.PageFree.SimplePageBase.ProcessRequestAsync(AhHttpContext context)
      at Inedo.Web.AhWebMiddleware.InvokeAsync(HttpContext context)
      
      posted in Support
      S
      scott.wright_8356
    • Maven Andriod Endpoint URL

      Hi Everyone,

      We are trying to work out the endpoint for the Maven Android feeds at Google. We have tried the following with no success.

      https://dl.google.com/dl/android/maven2
      https://dl.google.com
      https://dl.google.com/android/maven2
      https://maven.google.com/web/index.html

      Any help would be great.

      Cheers Scott

      posted in Support
      S
      scott.wright_8356
    • RE: Maven feed for cache

      @atripp We downgraded, but still no luck. It is incredibly slow and still getting the Object Reference errors. The 500 error in accessing Maven packages also occurs in both versions. What we did find, looking at our build logs, was the download from the feed was incredibly slow. All features were turned off the feed, and still, the download was slow. We went through the connectors and removed them one by one. We found that our connector for Google Andriod was incredibly slow, it was reporting healthy but was killing the feed.

      6eef55b3-599c-4b78-8266-cc81f0da5ede-image.png

      Is there a way to tell the speed of a public connector response so we can see the really slow ones and see if they are outdated? I think this might be a deprecated feed URL maybe.

      posted in Support
      S
      scott.wright_8356
    • RE: Maven feed for cache

      We are running ProGet 2023.31 and the problem with the Maven feeds is occurring on our test system as well.

      posted in Support
      S
      scott.wright_8356
    • RE: Maven feed for cache

      This is happening across all Maven feeds even private ones

      An error occurred in the web application: Object reference not set to an instance of an object.
      
      URL: http://proget.wtg.zone/feeds/Maven-WTG/com.cargowise.eservices/Maven Health Check API/1.0.0
      Referrer: https://proget.wtg.zone/packages?FeedId=20&Cache=all
      User: SW
      User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36 Edg/122.0.0.0
      Stack trace: at Inedo.ProGet.Feeds.Maven.MavenFeed.Inedo.ProGet.Feeds.IBrowsablePackageFeed.ListPackageVersionsAsync(BrowsablePackageId id)
      at Inedo.ProGet.WebApplication.Pages.Packages.PackagePageBase.CreateChildControlsAsync()
      at Inedo.ProGet.WebApplication.Pages.ProGetSimplePage.InitializeAsync()
      at Inedo.Web.PageFree.SimplePageBase.ExecutePageLifeCycleAsync()
      at Inedo.Web.PageFree.SimplePageBase.ProcessRequestAsync(AhHttpContext context)
      at Inedo.Web.AhWebMiddleware.InvokeAsync(HttpContext context)
      
      posted in Support
      S
      scott.wright_8356
    • RE: Maven feed for cache

      We are also getting the following error when trying to access packages on the Feed

      An error occurred in the web application: Object reference not set to an instance of an object.
      
      URL: http://proget.wtg.zone/feeds/Maven/nekohtml/Neko HTML/1.9.6.2
      Referrer: https://proget.wtg.zone/packages?FeedId=3&Cache=cached&skip=0&take=1000
      User: SW
      User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/122.0.0.0 Safari/537.36 Edg/122.0.0.0
      Stack trace: at Inedo.ProGet.Feeds.Maven.MavenFeed.Inedo.ProGet.Feeds.IBrowsablePackageFeed.ListPackageVersionsAsync(BrowsablePackageId id)
      at Inedo.ProGet.WebApplication.Pages.Packages.PackagePageBase.CreateChildControlsAsync()
      at Inedo.ProGet.WebApplication.Pages.ProGetSimplePage.InitializeAsync()
      at Inedo.Web.PageFree.SimplePageBase.ExecutePageLifeCycleAsync()
      at Inedo.Web.PageFree.SimplePageBase.ProcessRequestAsync(AhHttpContext context)
      at Inedo.Web.AhWebMiddleware.InvokeAsync(HttpContext context)
      
      posted in Support
      S
      scott.wright_8356
    • RE: Maven feed for cache

      We have an issue where Maven downloads from the public repository (https://repo1.maven.org/maven2) are taking forever. It is timing out.

      posted in Support
      S
      scott.wright_8356
    • Maven feed for cache

      Hi Support,

      We have a public Maven feed for which we cannot see the artefacts. We left it for 20 minutes, but it showed loading artefacts.

      4f1f88bc-4fa2-4d93-87b3-88ef5bd2c31e-image.png

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • ProGet IIS Application Pool Managed Pipeline Mode

      Hi Support,

      On our new installs of ProGet, we noticed that the IIS Application Pool Managed Pipeline Mode is classic. Is there any reason these cannot be integrated?

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • RE: SQL Error after upgrade version

      A possible solution to this is to use Extended Properties in SQL. That way you can check the version of the files in the upgrade and not re-create them when they have already been updated?

      posted in Support
      S
      scott.wright_8356
    • RE: SQL Error after upgrade version

      @atripp We had the same error when upgrading each node on a high availability install. Does the upgrade routine delete and recreate the stored procedures for each node upgrade? It felt like there was no check of a version for each node upgrade.

      posted in Support
      S
      scott.wright_8356
    • RE: SQL Server permissions issue in ProGet installation

      When you say Web Server Windows Service, I think you should put the account against the ProGetAppPool Identity. We are running as an integrated SQL connection, and the account is a DB Owner. Both the APP Pool and ProGet Service run as this account. We added the following to the connection string Persist Security Info=False;Integrated Security=true;

      posted in Support
      S
      scott.wright_8356
    • RE: ProGet Packages error getting records

      Yes, Using SELECT * FROM FeedPackageVersions_ExtendedWithMaven. I have found several packages with null Package_Names across the Maven feeds. The ones for the Maven-WTG can be seen here.

      ae3c2812-0605-4a50-9609-fe72edcd2c81-image.png

      So there are a few in there. We used the bulk import process to bring these across. The Maven feed is a public cache feed, and these were all downloaded. Latest version of ProGet

      posted in Support
      S
      scott.wright_8356
    • ProGet Packages error getting records

      Hi Support,

      We have a problem with the packages option in ProGet. We are getting the following error when selected.

      231c0c44-e80e-4ebb-a48c-279bcedda026-image.png

      We have narrowed it down to one feed, the Maven-WTG feed. The others are working without issues.

      0b69135c-d2b8-48c4-89e9-2eb8ac3dfff7-image.png

      e2fa7c4b-12ed-4816-aa91-b66708145dd6-image.png

      There is an error in the diagnostic centre.

      Message: Value cannot be null. (Parameter 'stringToEscape')
      
      Details:
      
      System.ArgumentNullException: Value cannot be null. (Parameter 'stringToEscape')
      at System.UriHelper.EscapeString(String stringToEscape, Boolean checkExistingEscaped, ReadOnlySpan`1 unreserved, Char forceEscape1, Char forceEscape2)
      at Inedo.ProGet.WebApplication.Pages.Packages.PackageOverviewPage.BuildUrl(FeedId feedId, String group, String name, String version)
      at Inedo.ProGet.WebApplication.Controls.PackageLink.GetPackageUrl(Int32 feedId, String packageId, String groupId, String version)
      at Inedo.ProGet.WebApplication.Controls.PackageLink..ctor(FeedPackageVersions_Extended p)
      at Inedo.ProGet.WebApplication.Pages.Packages.ListLocalPackagesPage.<>c__DisplayClass18_1.<<CreateChildControls>g__enumerat|6>d.MoveNext()
      at System.Collections.Generic.List`1..ctor(IEnumerable`1 collection)
      at System.Linq.Enumerable.ToList[TSource](IEnumerable`1 source)
      at Inedo.Web.Controls.AhTable.Inedo.Web.Controls.ISimpleCallbackHandler.ProcessRequestAsync(AhHttpContext context, String eventName, String eventArgument)
      
      posted in Support
      S
      scott.wright_8356
    • RE: ProGet HA Availability Setup and Update

      Excellent, we have just moved to using integrated security with the SQL server. The account was configured as DB owner. Will test the next upgrade when available.

      posted in Support
      S
      scott.wright_8356
    • RE: ProGet npm feed Errors in High Availability structure

      Thank you for the information. I will investigate the virus scanner

      posted in Support
      S
      scott.wright_8356
    • ProGet Cluster Configuration Info

      Hi Support,

      We have created a cluster of 3 ProGet nodes. When looking at the cluster management page, we get a message about "Cannot connect to service messenger." This changes on the servers as the HA proxy redirects to another node.

      d4dc787b-57b8-4952-b239-49bde0030432-image.png

      We have confirmed that port 33237 is accessible across the server, so I am not sure why we are getting this error. Also, if this is a problem?

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • ProGet npm feed Errors in High Availability structure

      Hi Support,

      We have a new high availability install and are testing the feed setup. We are testing the feed and hitting a number of errors that look like it may have something to do with the shared storage. We are not getting these errors on our NuGet and Maven feeds.

      An error occurred processing a GET request to http://proget.wtg.zone/npm/Registry/regexpu-core/-/regexpu-core-4.2.0.tgz: The process cannot access the file '\SMBShare\Proget\Packages.npm\F9\regexpu-core\4.2.0\package.tgz' because it is being used by another process.

      An error occurred processing a GET request to http://proget.wtg.zone/npm/Registry/@vueuse/core/-/core-10.4.1.tgz: Uncommittable transaction is detected at the end of the batch. The transaction is rolled back.

      The builds continue to work even though we are getting this error but they are filling up the logs.

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • ProGet HA Availability Setup and Update

      Hi Support,

      We have set up Proget with a high availability structure. It has three Windows nodes running IIS, a single SQL Enterprise server, and SMB shared storage. When installing, we ran Inedo Hub on each of the node servers, installing IIS and ProGet on them. After installing the first node, we encountered errors with the other nodes; we could not find a way to install them and point to the existing database. We had to install using a new database name and update the connection string afterwards. Is there a way to easily install extra nodes that we have missed?

      Also, what is the process for upgrading ProGet in a HA setup? We have been unable to find instructions on upgrades for HA and are worried that updating one node will create the same problems we had with the install. Can we please get an indication of the correct install process and upgrade routine?

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • RE: ProGet Storage and Retention for NuGet and Npm cache feeds

      Hi Atripp,

      We have received some scripts from Alex Papadimoulis. We started running these yesterday and the SQL blocking has so far disappeared and the Dashboards_GetLargestPackages now has no issues. Looks like Brett Shearer and Alex have a solution for both problems. Our load is still an issue at peak times but features are now working fast. Will keep monitoring and get back to Alex confirming the outcomes of the new stored procedures next week.

      Thank you

      posted in Support
      S
      scott.wright_8356
    • ProGet Storage and Retention for NuGet and Npm cache feeds

      Hi Everyone,

      We have upgraded from ProGet 2022.30 to 2023.28. After the upgrade when selecting the Storage And Retention option on the feed we get a timeout. Other feeds have no issue but when selecting the one for the public NuGet Gallery proxy we get the following error.

      27f4e260-1de6-4ddf-a272-2c2594d015b6-image.png

      The logs contain this:

      URL: https://proget.wtg.zone/feed/manage/storage?feedId=1
      Referrer: https://proget.wtg.zone/feed/manage?feedId=1
      User: SW
      User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36 Edg/120.0.0.0
      Stack trace: at Microsoft.Data.SqlClient.SqlCommand.<>c.<ExecuteDbDataReaderAsync>b__209_0(Task`1 result)
      at System.Threading.Tasks.ContinuationResultTaskFromResultTask`2.InnerInvoke()
      at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
      --- End of stack trace from previous location ---
      at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)
      --- End of stack trace from previous location ---
      at Inedo.Data.DatabaseContext.DbResult.CreateAsync(DbCommand command, DatabaseContext context, DateTimeOffset startTime, Stopwatch stopwatch)
      at Inedo.Data.DatabaseContext.ExecuteInternalAsync(String storedProcName, GenericDbParameter[] parameters)
      at Inedo.Data.SqlServerDatabaseContext.ExecuteInternalAsync(String storedProcName, GenericDbParameter[] parameters)
      at Inedo.Data.DatabaseContext.ExecuteTableAsync[TRow](String storedProcName, GenericDbParameter[] parameters)
      at Inedo.ProGet.WebApplication.Pages.Feeds.Manage.ManageFeedStoragePage.BuildLargestPackages(StyledTable largestPackagesTable)
      at Inedo.ProGet.WebApplication.Pages.Feeds.Manage.ManageFeedStoragePage.AddContentControlsAsync(ContentContainer content)
      at Inedo.ProGet.WebApplication.Pages.Feeds.Manage.ManageFeedPageBase.CreateChildControlsAsync()
      at Inedo.ProGet.WebApplication.Pages.ProGetSimplePage.InitializeAsync()
      at Inedo.Web.PageFree.SimplePageBase.ExecutePageLifeCycleAsync()
      at Inedo.Web.PageFree.SimplePageBase.ProcessRequestAsync(AhHttpContext context)
      at Inedo.Web.AhWebMiddleware.InvokeAsync(HttpContext context)
      
      posted in Support
      S
      scott.wright_8356
    • RE: ProGet 2022.30 upgrade to 2023.28

      We are noticing the following query having a duration of anywhere from 12-20 seconds. Our Server is incredibly slow.

      SELECT @PackageName_Id = [PackageName_Id]
      FROM [PackageNameIds] WITH (UPDLOCK, SERIALIZABLE) 
      WHERE [PackageType_Name] = @PackageType_Name
      		       AND (([PackageGroup_Name_Lower] IS NULL AND @PackageGroup_Name IS NULL) OR ([PackageGroup_Name_Lower] = LOWER(@PackageGroup_Name)))
      		       AND [Package_Name_Lower] = LOWER(@Package_Name)
      

      Is there a reason why the Create_Indicator is always defaulting to 'Y' PackageNameIds_GetOrCreatePackageNameId. Have you considered that doing the commit with UPDLOCK and SERIALIZABLE could be causing issues with AlwaysOn and sycnchronsist commits going to the secondary? It appears everything is being blocked waiting for the secondary to update and we may not need to update at all.

      Instead of doing pessimistic locking in the stored procedure it could be changed to do optimistic locking.

      GET Id from table
      if ID is null
      	insert row
      	if error
      		Get ID from table
      	else
      		Get ID from whatever you inserted
      	end
      end
      return ID
      
      posted in Support
      S
      scott.wright_8356
    • ProGet 2022.30 upgrade to 2023.28

      Hi Inedo,

      Had an issue with the feed upgrade failing due to old packages with version issues. Was able to resolve all of these and complete the upgrade process. The server is up and running and responding to package requests across feeds are working. The issue is the event viewer we are getting .Net Runtime errors for 2 feeds npm and nuget cache feeds.

      Category: Microsoft.AspNetCore.Server.IIS.Core.IISHttpServer
      EventId: 2
      SpanId: f132db9462672ba5
      TraceId: 72864a074b90e5fac4c87f08e7c5ce94
      ParentId: 0000000000000000
      RequestId: 80000a9e-000e-c900-b63f-84710c7967bb
      RequestPath: /npm/Registry/npm
      
      Connection ID "14483576463363672733", Request ID "80000a9e-000e-c900-b63f-84710c7967bb": An unhandled exception was thrown by the application.
      
      Exception: 
      System.Threading.Tasks.TaskCanceledException: A task was canceled.
         at Inedo.Web.AhHttpResponse.CompleteAsync()
         at Inedo.Web.AhWebMiddleware.InvokeAsync(HttpContext context)
         at Inedo.Web.AhWebMiddleware.InvokeAsync(HttpContext context)
         at Inedo.Web.AhWebHost.<>c.<<Configure>b__18_0>d.MoveNext()
      --- End of stack trace from previous location ---
         at Microsoft.AspNetCore.Server.IIS.Core.IISHttpContextOfT`1.ProcessRequestAsync()
      
      Category: Microsoft.AspNetCore.Server.IIS.Core.IISHttpServer
      EventId: 2
      SpanId: ecc2892673882cd1
      TraceId: d46b306d137da872e9d90b192c3cdc99
      ParentId: 0000000000000000
      RequestId: 800007d4-000a-e900-b63f-84710c7967bb
      RequestPath: /nuget/Gallery/v3/flatcontainer/microsoft.net.workload.mono.toolchain.net6.manifest-8.0.100.msi.x64/index.json
      
      Connection ID "16789419455397496785", Request ID "800007d4-000a-e900-b63f-84710c7967bb": An unhandled exception was thrown by the application.
      
      Exception: 
      System.OperationCanceledException: The operation was canceled.
         at System.Threading.CancellationToken.ThrowOperationCanceledException()
      

      The Web.ConcurrentRequestLimit is set to 0. We only started to see these errors after the upgrade. Any idea what it could be?

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • RE: ProGet Max Pool size was reached

      Thank you atripp, confirmation of everything we thought was the problem and working on it now.

      posted in Support
      S
      scott.wright_8356
    • RE: ProGet Diagnostic Center: Delete All Messagses

      @atripp said in ProGet Diagnostic Center: Delete All Messagses:

      TRUNCATE LogMessages

      Thank you worked perfectly yes there were a lot of logs.

      posted in Support
      S
      scott.wright_8356
    • RE: ProGet Max Pool size was reached

      The NuGet FindPackagesById Query is taking a long time. I would expect this to be every quick?

      caab2fc9-9bd3-4cce-af1e-a27920d70392-image.png

      It is like there is a blocking query as they all clear in one go.

      posted in Support
      S
      scott.wright_8356
    • ProGet Max Pool size was reached

      Hi Everyone,

      We are running ProGet Version 2022.30 (Build 5) we have multiple feeds on our server mostly NPM and NuGet public connector feeds. We are getting exceptions on our ProGet server in the event log with the following:

      System.InvalidOperationException: Timeout expired. The timeout period elapsed prior to obtaining a connection from the pool. This may have occurred because all pooled connections were in use and max pool size was reached.
      at Microsoft.Data.ProviderBase.DbConnectionFactory.TryGetConnection(DbConnection owningConnection, TaskCompletionSource`1 retry, DbConnectionOptions userOptions, DbConnectionInternal oldConnection, DbConnectionInternal& connection)

      On the diagnostic centre we are also getting errors with the following:

      An error occurred processing a GET request to https://XXX/nuget/WTG-Internal/v3/index.json: Timeout expired. The timeout period elapsed prior to obtaining a connection from the pool. This may have occurred because all pooled connections were in use and max pool size was reached.

      Request URL: https://www.nuget.org/api/v2/FindPackagesById()?id='microsoft.net.sdk.macos.manifest-6.0.400.msi.x64'&semVerLevel=2.0.0
      System.Net.WebException: The operation has timed out.

      The SQL Server we are running on is SQL 2016 Enterprise Server with 2TB of RAM. The database has allow snapshot isolation and read committed snapshot enabled. What is happening is the server starts to return 503 service unavailable when the above starts happening. We have attempted to set the Max Pool's in the connection string which has not helped and the Web.NuGetRequestLimit. It appears that maybe the NPM feed could be causing this issue as well.

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • ProGet Diagnostic Center: Delete All Messagses

      Hi Forum,

      We are attempting to delete all of the error messages in ProGet Version 2022.30 (Build 5). The actual delete fails with a timeout. We can see the POST on IIS for the delete and it is running but it always times out. Any advice would be great?

      Regards Scott

      posted in Support
      S
      scott.wright_8356
    • 1 / 1