[BM] /!\ Proget Integration broken - given key was not present

[philippe.camelio_3885]

Hi,

Proget integration is broken.
I am using docker version

• Proget 2023.32
• Buildmaster : 2023.13

It was working iprevious versions (beginning of february, this was working)

Integration with older version of proget (5.X) is working

Any solution is welcome
Best regards

PhilippeC.

[stevedennis]

Hi @philippe-camelio_3885 ,

No idea I'm afraid; there's clearly some issue with unexpected data coming from your ProGet server that's not being validated.

Can you share the results of /health (first API call) then /api/management/feeds/list (using the API token you specified)?

With that we can hopefully spot something.

Thanks,
Steve

[philippe.camelio_3885]

@stevedennis said in [BM] /!\ Proget Integration broken - given key was not present:

/api/management/feeds/list

Hell @stevedennis
Both commands are working fine on Proget

{
  "applicationName": "ProGet",
  "databaseStatus": "OK",
  "databaseStatusDetails": null,
  "extensionsInstalled": {
    "ProGetCoreEx": "23.0.32",
    "Inedo.SDK": "2.3.0",
    "Sonatype": "2.0.1",
    "Azure": "2.0.1",
    "InedoCore": "2.3.2",
    "Amazon AWS": "2.0.3"
  },
  "licenseStatus": "OK",
  "licenseStatusDetail": null,
  "versionNumber": "2023.32 (Build 3)",
  "releaseNumber": "23.0.32",
  "serviceStatus": "OK",
  "serviceStatusDetail": null,
  "replicationStatus": {
  "serverStatus": null,
  "serverError": null,
  "clientStatus": null,
  "clienterror": null,
  "incoming": [],
  "outgoing": []
}

On Buildmaster /health returns this:

{
  "applicationName": "BuildMaster",
  "databaseStatus": "OK",
  "databaseStatusDetails": null,
  "extensionsInstalled": {
    "BuildMaster Core Extensions": "23.0.13",
    "BuildMaster": "23.0.13",
    "Inedo.SDK": "2.4.0",
    "Git": "2.4.2",
    "Node": "2.2.0",
    "Scripting": "2.4.0",
    "Windows": "2.0.3",
    "Bitbucket": "2.4.0",
    "Azure": "2.0.1",
    "Jira": "2.4.2",
    "TeamCity": "2.4.0",
    "InedoCore": "2.4.1",
    "Python": "2.2.0",
    "Gitea": "2.4.0",
    "Docker": "2.4.3",
    "GitHub": "2.4.2",
    "Jenkins": "2.4.0",
    "Java": "2.2.0",
    "AzureDevOps": "2.4.0",
    "GitLab": "2.4.0",
    "DotNet": "2.2.9",
    "PHP": "2.0.0",
    "Linux": "2.0.0"
  },
  "instanceName": null,
  "licenseStatus": "OK",
  "licenseStatusDetail": null,
  "versionNumber": "2023.13 (Build 1)",
  "releaseNumber": "23.0.13",
  "serviceStatus": "OK",
  "serviceStatusDetail": null
}

[philippe.camelio_3885]

I installed fresh BM and Proget. (last docker version)

• Proget Integration is working fine

I tried:

• Fresh BM with fresh Proget => OK
• Fresh BM with fresh Proget => KO
• Existing BM with fresh Proget => OK
• Existing BM with existing Proget => KO

Something is broken in the existing Proget

Whatever the APIKey I create, Proget integration is unsuccessfull

[atripp]

Hi @philippe-camelio_3885 ,

Can you share the results of /api/management/feeds/list (on ProGet) using the API token you specified?

With that we can hopefully spot something.

Thanks,
Alana

[philippe.camelio_3885]

@atripp
The result of the api.
But the error is more like BM wasn't able to validate the token
Is there any way to trace the call made by BM ?

[{"name":"fsrm-rules","alternateNames":[],"feedType":"asset","description":"Json des extensions interdites pour les serveurs de fichiers","active":true,"cacheConnectors":true,"allowedLicenses":[],"blockedLicenses":[],"connectors":[],"vulnerabilitySources":[],"retentionRules":[],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":false,"restrictPackageStatistics":false,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":false,"licensesEnabled":false,"useWithProjects":true},{"name":"internal-docker","alternateNames":[],"feedType":"docker","active":true,"cacheConnectors":true,"allowedLicenses":[],"blockedLicenses":[],"connectors":[],"vulnerabilitySources":["PGVC","My PVGC"],"retentionRules":[{"deletePrereleaseVersions":false,"keepVersionsCount":null,"keepUsedWithinDays":90,"deletePackageIds":null,"keepPackageIds":null,"keepVersions":null,"deleteVersions":["*-pre*"],"deleteCached":false,"sizeTriggerKb":null,"sizeExclusive":false,"triggerDownloadCount":null,"keepConsumedWithinDays":null,"keepIfActivelyConsumed":false,"keepPackageUsageRemovedDays":180}],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":true,"restrictPackageStatistics":false,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":true,"licensesEnabled":false,"useWithProjects":false},{"name":"internal-files","alternateNames":[],"feedType":"asset","description":"Assets de Buildmaster","active":true,"cacheConnectors":true,"allowedLicenses":[],"blockedLicenses":[],"connectors":[],"vulnerabilitySources":[],"retentionRules":[],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":false,"restrictPackageStatistics":false,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":false,"licensesEnabled":false,"useWithProjects":true},{"name":"internal-psm","alternateNames":[],"feedType":"powershell","active":true,"cacheConnectors":true,"allowedLicenses":[],"blockedLicenses":[],"symbolServerEnabled":false,"stripSymbols":false,"stripSource":false,"endpointUrl":"https://proget-2023.ocapiat.fr/nuget/internal-psm/","connectors":[],"vulnerabilitySources":["PGVC","My PVGC"],"retentionRules":[],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":true,"restrictPackageStatistics":true,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":true,"licensesEnabled":true,"useWithProjects":true},{"name":"mariadb-backup","alternateNames":[],"feedType":"asset","active":true,"cacheConnectors":true,"allowUnknownLicenses":true,"allowedLicenses":[],"blockedLicenses":[],"connectors":[],"vulnerabilitySources":[],"retentionRules":[],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":false,"restrictPackageStatistics":false,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":false,"licensesEnabled":false,"useWithProjects":true},{"name":"public-docker","alternateNames":[],"feedType":"docker","active":true,"cacheConnectors":true,"allowedLicenses":[],"blockedLicenses":[],"connectors":["Docker Hub","Microsoft Container Registry","Google Container Registry"],"vulnerabilitySources":["PGVC","My PVGC"],"retentionRules":[],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":true,"restrictPackageStatistics":false,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":true,"licensesEnabled":false,"useWithProjects":false},{"name":"public-npm","alternateNames":[],"feedType":"npm","active":true,"cacheConnectors":true,"allowedLicenses":[],"blockedLicenses":[],"endpointUrl":"https://proget-2023.ocapiat.fr/npm/public-npm/","connectors":["registry.npmjs.org"],"vulnerabilitySources":["PGVC","My PVGC"],"retentionRules":[],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":true,"restrictPackageStatistics":false,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":true,"licensesEnabled":true,"useWithProjects":true},{"name":"public-psm","alternateNames":[],"feedType":"powershell","description":"PowerShell Gallery","active":true,"cacheConnectors":true,"allowedLicenses":[],"blockedLicenses":[],"symbolServerEnabled":false,"stripSymbols":false,"stripSource":false,"endpointUrl":"https://proget-2023.ocapiat.fr/nuget/public-psm/","connectors":["PowerShellGallery.com"],"vulnerabilitySources":["PGVC","My PVGC"],"retentionRules":[],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":true,"restrictPackageStatistics":true,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":true,"licensesEnabled":true,"useWithProjects":true},{"name":"public-ubuntu","alternateNames":[],"active":true,"cacheConnectors":true,"allowedLicenses":[],"blockedLicenses":[],"endpointUrl":"https://proget-2023.ocapiat.fr/debian/public-ubuntu/","connectors":["jammy"],"vulnerabilitySources":[],"retentionRules":[{"deletePrereleaseVersions":false,"keepVersionsCount":10,"keepUsedWithinDays":90,"deletePackageIds":null,"keepPackageIds":null,"keepVersions":null,"deleteVersions":null,"deleteCached":false,"sizeTriggerKb":null,"sizeExclusive":false,"triggerDownloadCount":null,"keepConsumedWithinDays":null,"keepIfActivelyConsumed":false,"keepPackageUsageRemovedDays":90}],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":true,"restrictPackageStatistics":false,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":true,"licensesEnabled":true,"useWithProjects":true},{"name":"public-zabbix","alternateNames":[],"description":"Packages pour Zabbix","active":true,"cacheConnectors":true,"allowedLicenses":[],"blockedLicenses":[],"endpointUrl":"https://proget-2023.ocapiat.fr/debian/public-zabbix/","connectors":["zabbix-jammy-6.4","zabbix-focal-6.4"],"vulnerabilitySources":["PGVC","My PVGC"],"retentionRules":[],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":true,"restrictPackageStatistics":false,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":true,"licensesEnabled":true,"useWithProjects":true},{"name":"test","alternateNames":[],"feedType":"powershell","active":true,"cacheConnectors":true,"allowedLicenses":[],"blockedLicenses":[],"symbolServerEnabled":false,"stripSymbols":false,"stripSource":false,"endpointUrl":"https://proget-2023.ocapiat.fr/nuget/test/","connectors":[],"vulnerabilitySources":[],"retentionRules":[],"packageFilters":{},"packageAccessRules":{},"variables":{},"canPublish":true,"packageStatisticsEnabled":false,"restrictPackageStatistics":false,"deploymentRecordsEnabled":true,"usageRecordsEnabled":true,"vulnerabilitiesEnabled":true,"licensesEnabled":true,"useWithProjects":false}]

[atripp]

Hi @philippe-camelio_3885 ,

Thanks for sharing that, I was able to find the issue.

The two feeds - public-ubuntu are missing public-zabbix are missing the property feedType. This is a bug in BuildMaster for not validating the data in that case and in ProGet for not sending it. So we will fix both:

• PG-2617 FIX: FeedManagement API not returning feedType for debian feeds
• BM-3942 FIX: Improve error handling for ProGet connection calidation

In the meantime, as a work-around, you can block those feeds from your API key, so they can't be read. They aren't usable in BuildMaster anyway, and that will prevent the bad data from being returned, which is what's making the API break.

Thanks,
Alana

[philippe.camelio_3885]

@atripp
Thanks for the fast reply and the bypass.
Best regards
PhilippeC.