-
Notifications
You must be signed in to change notification settings - Fork 130
Description
Version
pulpcore 3.84.0
Describe the bug
We upgraded our pulpcore version from 3.83.2 to 3.84.0 and since then, tasks have sometimes been stuck at "waiting". The problem surfaces in our test environment but we can also produce it locally in our dev environments. It seems to happen pretty reliably during our package directory upload test which uploads files concurrently. These tasks are created within < 1 second. If I turn off concurrency, the problem seems to go away as tasks queue up at > 1 second apart.
To Reproduce
Execute two tasks concurrently or in very quick succession (< 1 second). I think maybe part of the problem is that we're only running one worker in our test/dev environments.
Expected behavior
Tasks don't get stuck at waiting.
Additional context
Here's an example of two tasks (one stuck at waiting). The second was created at 10:54am and it's currently 10:57am.
{
"id": "/pulp/api/v3/tasks/0198c1f7-2463-7a3c-b18b-54da349d1002/",
"pulp_created": "2025-08-19T10:54:16.190522Z",
"state": "waiting",
"name": "pulpcore.app.tasks.base.general_create",
"logging_cid": "d543df56-d072-4a75-a7f0-71fe4671d273",
"started_at": null,
"finished_at": null,
"error": null,
"worker": null,
"progress_reports": [],
"created_resources": [],
"reserved_resources_record": [
"shared:prn:core.domain:431fb816-c18e-4b8a-83c8-8b5b0013f67c"
]
},
{
"id": "/pulp/api/v3/tasks/0198c1f7-2460-7129-ad53-9c6823985ff6/",
"pulp_created": "2025-08-19T10:54:16.168997Z",
"state": "completed",
"name": "pulpcore.app.tasks.base.general_create",
"logging_cid": "d543df56-d072-4a75-a7f0-71fe4671d274",
"started_at": "2025-08-19T10:54:16.284407Z",
"finished_at": "2025-08-19T10:54:16.438698Z",
"error": null,
"worker": "/pulp/api/v3/workers/0198c1f4-c606-7c87-b0e3-3bde13a83243/",
"progress_reports": [],
"created_resources": [
"/pulp/api/v3/content/file/files/0198c1f7-2567-727d-9b14-64b02ed712c3/"
],
"reserved_resources_record": [
"shared:prn:core.domain:431fb816-c18e-4b8a-83c8-8b5b0013f67c"
]
},