Buildmaster odd issue - too many open files

[A Former User]

Hello, recently everything ground to a halt, during a build we get the following error:
INFO : 2022-01-17 09:44:07Z - This plan was auto-generated on 6/19/2019 3:05:11 AM; you may visit the Plans page to modify it.
INFO : 2022-01-17 09:44:07Z - Sleeping for 2 seconds...
INFO : 2022-01-17 09:44:09Z - Done sleeping.
INFO : 2022-01-17 09:44:09Z - Getting source from 'https://leadmasterops@bitbucket.org/leadmasterops/app4classic.git' on 'release/RC4.X' branch...
DEBUG: 2022-01-17 09:44:09Z - Using LocalAgent agent on localhost
DEBUG: 2022-01-17 09:44:09Z - No executable path specified, using built-in Git library...
DEBUG: 2022-01-17 09:44:09Z - Using repository at 'C:\ProgramData\BuildMaster\Temp\Service\GitWorkspaces\app4classic.git'...
DEBUG: 2022-01-17 09:44:09Z - Fetching commits from origin...
DEBUG: 2022-01-17 09:44:09Z - Connecting as user 'leadmasterops'...
ERROR: 2022-01-17 09:47:19Z - Update failed: could not open 'C:/ProgramData/BuildMaster/Temp/Service/GitWorkspaces/app4classic.git/.git/refs/tags/4.1.990': Too many open files
DEBUG: 2022-01-17 09:47:19Z - Cleaning up...
DEBUG: 2022-01-17 09:47:19Z - Deleting C:\ProgramData\BuildMaster\Temp\Service_E40487 on localhost...
DEBUG: 2022-01-17 09:47:19Z - C:\ProgramData\BuildMaster\Temp\Service_E40487 on localhost deleted.
DEBUG: 2022-01-17 09:47:19Z - Cleanup complete.

This is on windows, normally on linux I would say a ulimit issue, but being windows it has me stumped. We are running the latest version. Any hints?

[atripp]

Hi @colin_0011 , that certainly is an odd issue!

We've never seen it before, but it's coming from the library we're using (libgit2). I don't really know what it means, or what's causing it (is it a number of files in the repository, etc.), but I just have a couple ideas.

1. Restart server
2. Clear the GitWorkspaces (C:\ProgramData\BuildMaster\Temp\Service\GitWorkspaces)
3. Try using git.exe instead of the built-in library

You can do #3 by setting GitExePath parameter on the operation, or configuring a $DefaultGitExePath variable at the server or system level in BuildMaster; this will force all Git source control operations to use the CLI instead of the built-in library

It's possible the bug was already fixed in a newer version of the lbirary. What version of BuildMaster are you using?