Welcome to the Inedo Forums! Check out the Forums Guide for help getting started.
If you are experiencing any issues with the forum software, please visit the Contact Form on our website and let us know!
Debian Connectors Performance Issue
-
Hi,
some Debian feeds, especially for kali-rolling, are very slow after a day since the connector was renewed. I have to repeatedly reset or renew the connector in order to be able to work with it.
If not, an “apt update” takes several minutes or it is going to be stucked up. The index.sqlite files grow to up to 50 GB. In addition, index.sqilte3-shm and -wal also grow to almost the same size. And CPU consumption increases proportionally to these problems. And if the connectors are not renewed, the sqlite database consumes all the available storage space in the partition where the volumes for packages are located.
Additional Information:
Upstream link that we are testing and using:
http://mirror.netcologne.de/kali/
http://http.kali.org/kaliProGet version: 2025.20(Build 23) with external database (MSSQL), both in containers
Connector configuration: Index poll frequency is already set to triple digits in minutes.
Further Information I've already researched:
- https://forums.inedo.com/topic/5467/proget-2024-dealing-with-large-debian-package-connectors
- https://forums.inedo.com/topic/5410/debian-feed-mirror-performance/2
Please investigate this behavior. In addition to RPM repos, we also use a lot of Debian repos.
If the cause is known, can you implement additional clean measures in addition to “Index poll frequency”?Can the problem perhaps be avoided by using a proxy?