Hi Ali,

By default, an artifact retention policy operates on artifacts alone and does not consider builds/releases/etc.

There is no current way to say "500MB of artifacts per release", however, you can combine 2 retention policies that should be close to what you want:

• Build retention policy:
  • Only purge builds in deployed releases
  • Only purge rejected builds
  • Keep last (whatever you want)
• Artifact retention policy:
  • Only purge artifacts in deployed releases
  • Only purge artifacts in rejected builds
  • Purge orphaned artifacts

The key is "purge orphaned artifacts" which will only delete artifacts after its corresponding build is deleted. This allows you to provide the necessary granularity on the builds themselves, and let the artifact policy come in after and clean up the artifacts that no longer have an existing build. This can be extended to releases in a way, since any releases that get deleted will also have all their builds deleted.

Hope this helps,
-John

For completeness, I will also add that (without any connectors), the package returned by this Native API call will be the same:

https://<proget-server>/api/json/NuGetPackagesV2_GetLatest?key=<api-key>&Feed_Id=<feed-id>&PackageIds_Psv=<packages>

Psv stands for "pipe-separated values", and if that argument is omitted, the absolute latest versions of all packages are returned. An example value for <packages> would be Inedo.BuildMaster.SDK or Inedo.BuildMaster.SDK|Inedo.ProGet.SDK

That being said, the NuGet API endpoint is still the recommended one to use if possible :)

Hi Richard,

ProGet does not currently implement v3. The V2 designation for the tables was simply the 2nd implementation of NuGet feeds that replaced the quirks feeds.

If you want to get the latest version using the NuGet v2 API, use this URL format:

https://<proget-server>/nuget/<feed-name>/FindPackagesById()?id=<package-name>&$filter=IsAbsoluteLatestVersion&$format=json

The $format=json is specific to ProGet and may be omitted if you prefer NuGet v2's traditional XML response.

Hope this helps,
-John

Hi Philippe,

Apparently 6.2 has an unrelated issue that prevents infrastructure sync which I have logged here: https://inedo.myjetbrains.com/youtrack/issue/BM-3542

Are you seeing the error "Invalid resource type specified for infrastructure sync." in the diagnostic center by chance? If so, the above issue should resolve it in the next 6.2 maintenance release due out next Friday.

Once I fixed that, the infrastructure was imported as per this log:

DEBUG: 2020-02-19 16:02:52Z - Starting infrastructure import...
INFO : 2020-02-19 16:02:52Z - Mirroring enabled; infrastructure will be deleted if it is not defined in imported configuration.
DEBUG: 2020-02-19 16:02:52Z - Variables will be imported.
INFO : 2020-02-19 16:02:52Z - Creating role BASELINE-CONFIG-SERVEURS...
INFO : 2020-02-19 16:02:52Z - Creating variable Description=[hidden]...
INFO : 2020-02-19 16:02:52Z - Creating role AD-Controleurs...
INFO : 2020-02-19 16:02:52Z - Creating variable ModulesBaselineAD=[
{"Nom":"DFSDsc","Version":"4.3.0"},
{"Nom":"xSmbShare","Version":"2.2.0"}, {"Nom":"xDNSServer","Version":"1.12.0.0"}
]

...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO-PDQ...
INFO : 2020-02-19 16:02:52Z - Creating variable ModulesPlateformesMaestroPDQ=[ {"Nom":"VMware.PowerCLI","Version":"11.2.0.12780525"},{"Nom":"DSI","Version":"1.0.0"}  ]	...
INFO : 2020-02-19 16:02:52Z - Creating role AD-PKI...
INFO : 2020-02-19 16:02:52Z - Creating role BASELINE-100-IIS...
INFO : 2020-02-19 16:02:52Z - Creating variable SitesIIS=%(GLPI-INTEGRATION: %(Bindings: @(%(IPAddress: *, Port: 8000, HostName: *, Protocol: http))), GLPI-EXPLOITATION: %(Bindings: @(%(IPAddress: *, Port: 8001, HostName: *, Protocol: http))), KANBOARD-INTEGRATION: %(Bindings: @(%(IPAddress: *, Port: 8003, HostName: *, Protocol: http))), ANNUAIRE-EXPLOITATION: %(Bindings: @(%(IPAddress: *, Port: 80, HostName: annuaire.ocapiat.fr, Protocol: http))), ANNUAIRE-INTEGRATION: %(Bindings: @(%(IPAddress: *, Port: 80, HostName: annuaire-dev.ocapiat.fr, Protocol: http))))...
INFO : 2020-02-19 16:02:52Z - Creating variable WindowsFeature-IIS=@(Web-Server, Web-WebServer, Web-Common-Http, Web-Static-Content, Web-Default-Doc, Web-Http-Errors, Web-Dir-Browsing, Web-Http-Redirect, Web-Health, Web-Http-Logging, Web-Request-Monitor, Web-Log-Libraries, Web-Performance, Web-Stat-Compression, Web-Dyn-Compression, Web-Security, Web-Filtering, Web-Basic-Auth, Web-Windows-Auth, Web-App-Dev, Web-CGI, Web-ISAPI-Ext, Web-Includes, Web-ISAPI-Filter, Web-Mgmt-Tools, Web-Mgmt-Compat, Web-Metabase, Web-WMI, Web-Lgcy-Scripting, Web-Scripting-Tools, Web-Mgmt-Service)...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO-DFS...
INFO : 2020-02-19 16:02:52Z - Creating role BASELINE-FICHIERS...
INFO : 2020-02-19 16:02:52Z - Creating variable LecteurDFS=D:...
INFO : 2020-02-19 16:02:52Z - Creating variable ModulesBaselineFichiers=[ {"Nom":"DFSDsc","Version":"4.3.0"},
{"Nom":"xSmbShare","Version":"2.2.0"} ]...
INFO : 2020-02-19 16:02:52Z - Creating variable WindowsFeature-Fichiers=@(FS-Resource-Manager, FS-DFS-Namespace, FS-DFS-Replication, FS-DATA-Deduplication, FS-VSS-Agent)...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-EXCHANGE...
INFO : 2020-02-19 16:02:52Z - Creating role BASELINE...
INFO : 2020-02-19 16:02:52Z - Creating variable ModulesBaseline=[{"Nom":"PSDscResources","Version":"2.10.0.0"} ,
 {"Nom":"Carbon","Version":"2.9.0"},
 {"Nom":"StorageDSC","Version":"4.6.0.0"},
{"Nom":"xActiveDirectory","Version":"3.0.0.0"},
{"Nom":"NetworkingDSC","Version":"7.1.0.0"}
]...
INFO : 2020-02-19 16:02:52Z - Creating variable WindowsFeaturesBaseline=@(RSAT-AD-PowerShell, RSAT-DNS-Server)...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO-GLPI...
INFO : 2020-02-19 16:02:52Z - Creating role BASELINE-010-IIS-MODULES...
INFO : 2020-02-19 16:02:52Z - Creating variable ModulesBaselineIIS=[
 {"Nom":"xWebAdministration","Version":"2.5.0.0"},
 {"Nom":"PSDscResources","Version":"2.10.0.0"}
]...
INFO : 2020-02-19 16:02:52Z - Creating variable SourceNetFx35=\\ocapiat.fr\MAESTRO\Logiciels\Entreprise\Microsoft\.Net Framework\3.5...
INFO : 2020-02-19 16:02:52Z - Creating role BASELINE-110-IIS-PHP...
INFO : 2020-02-19 16:02:52Z - Creating variable ModulesPHP=[ {"Nom":"PhpManager","Version":"1.17.2.210"} ]...
INFO : 2020-02-19 16:02:52Z - Creating variable PHPPAthRoot=D:\PHP...
INFO : 2020-02-19 16:02:52Z - Creating variable PHPVersions=@(7.3.4)...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-METAANNUAIRE...
INFO : 2020-02-19 16:02:52Z - Creating variable MetaAnnuaire=%(EXP: %(InstanceDescription: Exploitation, LocalLDAPPortToListenOn: 50000, LocalSSLPortToListenOn: 50100))...
INFO : 2020-02-19 16:02:52Z - Creating variable NomDomaine=ldap...
INFO : 2020-02-19 16:02:52Z - Creating variable WindowsFeature-ADLDS=@(ADLDS)...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-WAC...
INFO : 2020-02-19 16:02:52Z - Creating variable CName=wac.ocapiat.fr...
INFO : 2020-02-19 16:02:52Z - Creating variable WindowsFeaturesWAC=@(RSAT-DNS-Server)...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO-KANBOARD...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO-LANSWEEPER...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO-MDT...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO-IIS...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO-SNIPEIT...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-RH...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-RH-ANNUAIRE...
INFO : 2020-02-19 16:02:52Z - Creating role BASELINE-SQL...
INFO : 2020-02-19 16:02:52Z - Creating variable ModulesBaselineSQL=[
{"Nom":"dbatools","Version":"1.0.38"},{"Nom":"SQLServerDSC","Version":"13.1.0.0"},
{"Nom":"SQLServer","Version":"21.1.18147"}
]...
INFO : 2020-02-19 16:02:52Z - Creating variable SQL-Maintenance-Checksum=-2101817452...
INFO : 2020-02-19 16:02:52Z - Creating variable SQL-Maintenance-Get-Script=Get-InstanceName.sql...
INFO : 2020-02-19 16:02:52Z - Creating variable SQL-Maintenance-Set-Script=MaintenanceSolution.sql...
INFO : 2020-02-19 16:02:52Z - Creating variable SQL-Maintenance-Test-Script=ObjectChecksum.sql...
INFO : 2020-02-19 16:02:52Z - Creating variable SQL-Scripts-Folder=c:\dsi\sql...
INFO : 2020-02-19 16:02:52Z - Creating variable SQLInstances=@()...
INFO : 2020-02-19 16:02:52Z - Creating variable SQLInstancesConfig=%(MAESTRODEV: %(RAM: 2048, StaticPort: 1450), TEST: %(RAM: 2048, StaticPort: 1451), PAIE: %(RAM: 4096, StaticPort: 1450), MAESTROPRD: %(RAM: 2048, StaticPort: 1450), LANSWEEPER: %(RAM: 4096, StaticPort: 1451), TESTPUB: %(RAM: 4096, StaticPort: 1451), TESTABO: %(RAM: 4096, StaticPort: 1452))...
INFO : 2020-02-19 16:02:52Z - Creating variable WindowsFeaturesBaselineSQL=@(NET-Framework-45-Core)...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-WORKSPACE...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO-GIT...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-RDS...
INFO : 2020-02-19 16:02:52Z - Creating role LINUX-BASELINE...
INFO : 2020-02-19 16:02:52Z - Creating variable APT-MARIADB=mariadb-server mariadb-client...
INFO : 2020-02-19 16:02:52Z - Creating role LINUX-HAPROXY...
INFO : 2020-02-19 16:02:52Z - Creating variable APT-Modules=haproxy keepalived git wget...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-WORDPRESS-HAPROXI...
INFO : 2020-02-19 16:02:52Z - Creating role LINUX-MARIADB...
INFO : 2020-02-19 16:02:52Z - Creating variable APT-MARIADB=mariadb-server mariadb-client...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-WORDPRESS...
INFO : 2020-02-19 16:02:52Z - Creating variable APT-WP-PHP=php7.2 php7.2-cli php7.2-mysql php7.2-json php7.2-opcache php7.2-mbstring php7.2-xml php7.2-gd php7.2-curl...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-MAESTRO-SQL...
INFO : 2020-02-19 16:02:52Z - Creating role PLATEFORMES-PAIE...
INFO : 2020-02-19 16:02:53Z - Creating role PLATEFORMES-WORKFOLDER...
INFO : 2020-02-19 16:02:53Z - Creating variable ModulesWorkFolders=[{"Nom":"xDNSServer","Version":"1.16.0.0"},{"Nom":"CertificateDsc","Version":"4.7.0.0"}]...
INFO : 2020-02-19 16:02:53Z - Creating variable WindowsFeature-WorkFolders=@(FS-SyncShareService, Web-WHC, FS-Data-Deduplication)...
INFO : 2020-02-19 16:02:53Z - Creating variable WorkFolder-DossierBase=D:\WKFLD...
INFO : 2020-02-19 16:02:53Z - Creating role PLATEFORMES-WORKFOLDER-SETUP...
INFO : 2020-02-19 16:02:53Z - Creating role PLATEFORMES-SOR-HAPROXI...
INFO : 2020-02-19 16:02:53Z - Creating environment DEVELOPPEMENT...
INFO : 2020-02-19 16:02:53Z - Updating environment INTEGRATION (id=1)...
INFO : 2020-02-19 16:02:53Z - Creating variable RootDrive=D:\...
INFO : 2020-02-19 16:02:53Z - Creating variable RootEnv=INT...
INFO : 2020-02-19 16:02:53Z - Updating environment PRODUCTION (id=3)...
INFO : 2020-02-19 16:02:53Z - Creating variable RootDrive=D:\...
INFO : 2020-02-19 16:02:53Z - Creating variable RootEnv=DEV...
INFO : 2020-02-19 16:02:53Z - Deleting environment Testing...
INFO : 2020-02-19 16:02:53Z - Creating server VM121007...
INFO : 2020-02-19 16:02:53Z - Creating server VM121004...
INFO : 2020-02-19 16:02:53Z - Creating server VM121010...
INFO : 2020-02-19 16:02:53Z - Creating server VM121001...
INFO : 2020-02-19 16:02:53Z - Creating server VM121002...
INFO : 2020-02-19 16:02:53Z - Creating server VM120001...
INFO : 2020-02-19 16:02:53Z - Creating server VM121009...
INFO : 2020-02-19 16:02:53Z - Creating server VM121012...
INFO : 2020-02-19 16:02:53Z - Creating server VM121011...
INFO : 2020-02-19 16:02:53Z - Creating server VM121008...
INFO : 2020-02-19 16:02:53Z - Creating server VM121003...
INFO : 2020-02-19 16:02:53Z - Creating server VM121006...
INFO : 2020-02-19 16:02:53Z - Creating server VM121005...
INFO : 2020-02-19 16:02:53Z - Creating server VM120002...
INFO : 2020-02-19 16:02:53Z - Creating server VM121013...
INFO : 2020-02-19 16:02:53Z - Creating variable PHPVersion=7.3.4...
INFO : 2020-02-19 16:02:53Z - Creating server VM121014...
INFO : 2020-02-19 16:02:53Z - Creating server VM120003...
INFO : 2020-02-19 16:02:53Z - Creating server VM120004...
INFO : 2020-02-19 16:02:53Z - Creating server VM120005...
INFO : 2020-02-19 16:02:53Z - Creating server VM121016...
INFO : 2020-02-19 16:02:53Z - Creating variable SQLInstances=@(TEST)...
INFO : 2020-02-19 16:02:53Z - Creating server VM121015...
INFO : 2020-02-19 16:02:53Z - Creating server VM121018...
INFO : 2020-02-19 16:02:53Z - Creating server VM121017...
INFO : 2020-02-19 16:02:53Z - Creating server VM121019...
INFO : 2020-02-19 16:02:53Z - Creating server VM121023...
INFO : 2020-02-19 16:02:53Z - Creating server VM121024...
INFO : 2020-02-19 16:02:53Z - Creating server VM121025...
INFO : 2020-02-19 16:02:53Z - Creating variable SQLInstances=@(MAESTROPRD,LANSWEEPER)...
INFO : 2020-02-19 16:02:53Z - Creating variable SQLSourcePath=\\ocapiat.fr\maestro\Logiciels\Entreprise\Microsoft\SQL Server\Standard\2016-FR-SP2...
INFO : 2020-02-19 16:02:53Z - Creating server VM121026...
INFO : 2020-02-19 16:02:53Z - Creating server VM121028...
INFO : 2020-02-19 16:02:53Z - Creating server VM121030...
INFO : 2020-02-19 16:02:53Z - Creating server VM121031...
INFO : 2020-02-19 16:02:53Z - Creating server VM121032...
INFO : 2020-02-19 16:02:53Z - Creating server VM120006...
INFO : 2020-02-19 16:02:53Z - Creating server VM121036...
INFO : 2020-02-19 16:02:53Z - Creating server VM121034...
INFO : 2020-02-19 16:02:53Z - Creating server VM121037...
INFO : 2020-02-19 16:02:53Z - Creating server VM121035...
INFO : 2020-02-19 16:02:53Z - Creating server VM111001...
INFO : 2020-02-19 16:02:53Z - Creating variable WPSITES=@(wpliv)...
INFO : 2020-02-19 16:02:53Z - Creating server VM121029...
INFO : 2020-02-19 16:02:53Z - Creating variable SQLInstances=@(PAIE)...
INFO : 2020-02-19 16:02:53Z - Creating variable SQLSourcePath=\\ocapiat.fr\maestro\Logiciels\Entreprise\Microsoft\SQL Server\Standard\2016-FR-SP2...
INFO : 2020-02-19 16:02:53Z - Creating server VM121038...
INFO : 2020-02-19 16:02:53Z - Creating server VM121040...
INFO : 2020-02-19 16:02:53Z - Creating server VM121039...
INFO : 2020-02-19 16:02:53Z - Creating server VM121027...
INFO : 2020-02-19 16:02:53Z - Creating server VM111002...
INFO : 2020-02-19 16:02:53Z - Creating server VM111003...
INFO : 2020-02-19 16:02:53Z - Creating server VM111005...
INFO : 2020-02-19 16:02:53Z - Creating variable WPSITES=@(wpsbx)...
INFO : 2020-02-19 16:02:53Z - Creating server VM121041...
INFO : 2020-02-19 16:02:53Z - Creating server VM120009...
INFO : 2020-02-19 16:02:53Z - Creating variable SQLInstances=@(TESTABO)...
INFO : 2020-02-19 16:02:53Z - Creating server VM120008...
INFO : 2020-02-19 16:02:53Z - Creating variable SQLInstances=@(TESTPUB)...
INFO : 2020-02-19 16:02:53Z - Creating server VM111007...
INFO : 2020-02-19 16:02:53Z - Creating variable WPSITES=@(WPDEV)...
INFO : 2020-02-19 16:02:53Z - Deleting server localhost...
DEBUG: 2020-02-19 16:02:53Z - Committing transaction...
INFO : 2020-02-19 16:02:53Z - Import complete.

Hope this helps,
-John

Hello,

@mhull_0872 your timing is perfect. While currently it requires custom headers, we are implementing a simple REST API right now that will be allow you to add custom deployment records. Here is the associated issue: https://inedo.myjetbrains.com/youtrack/issue/PG-1666

It's planned to be included in the 5.2.26 release due out next Friday.

Hope this helps,
-John

Hi Phillipe,

The bug should have been resolved in both lines (it was fixed in 6.1 but merged into 6.2). I had originally used the infrastructure you sent in testing it, I will try again tomorrow or Wednesday in 2 clean instances to see what I find and report back.

Thanks,
-John

Hi Ali,

By default, an artifact retention policy operates on artifacts alone and does not consider builds/releases/etc.

There is no current way to say "500MB of artifacts per release", however, you can combine 2 retention policies that should be close to what you want:

• Build retention policy:
  • Only purge builds in deployed releases
  • Only purge rejected builds
  • Keep last (whatever you want)
• Artifact retention policy:
  • Only purge artifacts in deployed releases
  • Only purge artifacts in rejected builds
  • Purge orphaned artifacts

The key is "purge orphaned artifacts" which will only delete artifacts after its corresponding build is deleted. This allows you to provide the necessary granularity on the builds themselves, and let the artifact policy come in after and clean up the artifacts that no longer have an existing build. This can be extended to releases in a way, since any releases that get deleted will also have all their builds deleted.

Hope this helps,
-John

Hi Philipe,

Thank you for the export. Using it to perform an import, I was able to determine the root cause for the "item with the same key has already been added" error and have submitted a fix for it.

If you would like a pre-release version with the fix included let me know and I'll make one available, otherwise it will be included in 6.1.26 due out next Friday.

Thanks,
-John

Hi Philipe,

I am getting back to investigating this issue now. Are you able to send over an example export (Admin > Export Configuration) that exhibits the error? Please make sure to sanitize any agent connection information from the export :)

Thanks,
-John

Hi Philip,

The next TFS extension v1.4.0 now has a TFVC monitor included. It's a little rough around the edges i.e. it monitors separate paths instead of branches for the time being.

Let me know if you run into any issues with it.

Thanks,
-John

Hi Philip,

Sorry for the delay, most (i.e. all) of our dev resources were assigned to the BuildMaster v6.2 release this week. Now that it's out, I have been assigned the implementation for this, scheduled for Jan 31, however I expect to get to it a lot sooner than that.

Thank you for your patience,
-John