Inedo Community Forums Forums
    • Recent
    • Tags
    • Popular
    • Login

    Welcome to the Inedo Forums! Check out the Forums Guide for help getting started.

    If you are experiencing any issues with the forum software, please visit the Contact Form on our website and let us know!

    error pushing large docker images when using Azure blob storage

    Scheduled Pinned Locked Moved Support
    8 Posts 3 Posters 24 Views 1 Watching
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • B Offline
      brett.polivka
      last edited by

      I'm attempting to push some Windows-based images, which contain some very large, multi-GB layers. Theses pushes never succeed, as I keep getting the following errors in the server logs:

      A 500 error occurred in docker: The request body is too large and exceeds the maximum permissible limit.

      Where "docker" is the name of my feed.

      I'm using Azure blob store as the storage backend, and from what I can tell, this is where the error is actually coming from. My guess is that the issue stems from the 100MB block size limit imposed by Azure for block blobs.

      https://docs.microsoft.com/en-us/rest/api/storageservices/understanding-block-blobs--append-blobs--and-page-blobs

      NanciCaloN 1 Reply Last reply Reply Quote 0
      • NanciCaloN Offline
        NanciCalo inedo-engineer @brett.polivka
        last edited by

        @brett-polivka I know that there were some recent changes to these extensions; what version are you using of ProGet and the Azure extension (Admin > Extensins)?

        1 Reply Last reply Reply Quote 0
        • B Offline
          brett.polivka
          last edited by

          Proget version: 5.3.23
          Azure extension version: 1.11.0

          NanciCaloN 1 Reply Last reply Reply Quote 0
          • NanciCaloN Offline
            NanciCalo inedo-engineer @brett.polivka
            last edited by

            @brett-polivka thanks

            So, this may have been a regression due to a recent change to the Azure extension. Can you rollback to Azure 1.9.0 by manually installing it?

            1 Reply Last reply Reply Quote 0
            • B Offline
              brett.polivka
              last edited by

              Any advice on how to do that when using the docker version?

              1 Reply Last reply Reply Quote 0
              • gdivisG Offline
                gdivis inedo-engineer
                last edited by

                @brett-polivka It looks like the underlying problem is likely that 100MB limit. When we published the Azure extension, we'd mistakenly believed the maximum block size to be 4000 MB, but because we're using the v11 client library to push to azure, it's limited to the older 100mb limit. We can't upgrade without dropping support for .NET 452 on windows, which we aren't prepared to do yet, so we'll work around using another means.

                We're on it; hopefully will have an update included for tomorrow's release.

                1 Reply Last reply Reply Quote 0
                • gdivisG Offline
                  gdivis inedo-engineer
                  last edited by

                  @brett-polivka So one more update. Implementing the workaround was easier than expected. This should now be resolved in v1.11.1 of the Azure extension, which you install from the Admin->Extensions page. You may need to restart the Docker container after installing.

                  1 Reply Last reply Reply Quote 0
                  • B Offline
                    brett.polivka
                    last edited by

                    Looks good!

                    I had to create a volume mount for /var/proget/extensions to get the extension upgrade to persist, but it seems to fix the problem.

                    Thanks!

                    1 Reply Last reply Reply Quote 0

                    Hello! It looks like you're interested in this conversation, but you don't have an account yet.

                    Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

                    With your input, this post could be even better 💗

                    Register Login
                    • 1 / 1
                    • First post
                      Last post
                    Inedo Website Home • Support Home • Code of Conduct • Forums Guide • Documentation