Skip to content

Tasks stuck at "waiting" in 3.84.0 #6873

@daviddavis

Description

@daviddavis

Version
pulpcore 3.84.0

Describe the bug
We upgraded our pulpcore version from 3.83.2 to 3.84.0 and since then, tasks have sometimes been stuck at "waiting". The problem surfaces in our test environment but we can also produce it locally in our dev environments. It seems to happen pretty reliably during our package directory upload test which uploads files concurrently. These tasks are created within < 1 second. If I turn off concurrency, the problem seems to go away as tasks queue up at > 1 second apart.

To Reproduce
Execute two tasks concurrently or in very quick succession (< 1 second). I think maybe part of the problem is that we're only running one worker in our test/dev environments.

Expected behavior
Tasks don't get stuck at waiting.

Additional context
Here's an example of two tasks (one stuck at waiting). The second was created at 10:54am and it's currently 10:57am.

{
         "id": "/pulp/api/v3/tasks/0198c1f7-2463-7a3c-b18b-54da349d1002/",
         "pulp_created": "2025-08-19T10:54:16.190522Z",
         "state": "waiting",
         "name": "pulpcore.app.tasks.base.general_create",
         "logging_cid": "d543df56-d072-4a75-a7f0-71fe4671d273",
         "started_at": null,
         "finished_at": null,
         "error": null,
         "worker": null,
         "progress_reports": [],
         "created_resources": [],
         "reserved_resources_record": [
            "shared:prn:core.domain:431fb816-c18e-4b8a-83c8-8b5b0013f67c"
         ]
      },
      {
         "id": "/pulp/api/v3/tasks/0198c1f7-2460-7129-ad53-9c6823985ff6/",
         "pulp_created": "2025-08-19T10:54:16.168997Z",
         "state": "completed",
         "name": "pulpcore.app.tasks.base.general_create",
         "logging_cid": "d543df56-d072-4a75-a7f0-71fe4671d274",
         "started_at": "2025-08-19T10:54:16.284407Z",
         "finished_at": "2025-08-19T10:54:16.438698Z",
         "error": null,
         "worker": "/pulp/api/v3/workers/0198c1f4-c606-7c87-b0e3-3bde13a83243/",
         "progress_reports": [],
         "created_resources": [
            "/pulp/api/v3/content/file/files/0198c1f7-2567-727d-9b14-64b02ed712c3/"
         ],
         "reserved_resources_record": [
            "shared:prn:core.domain:431fb816-c18e-4b8a-83c8-8b5b0013f67c"
         ]
      },

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions