Skip to content

runpod self.current_concurrency turned into None in some cases. #458

@waganawa

Description

@waganawa

Describe the bug

20j67gt48z9xxe[error]Uncaught exception | ['Traceback (most recent call last):\n', '  
File "/app/runpod_concurrent_handler_launch.py", line 14, in <module>\n    runpod.serverless.start(\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/__init__.py", line 178, in start\n    worker.main(config)\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/worker.py", line 56, in main\n    run_worker(config)\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/worker.py", line 43, in run_worker\n    job_scaler.start()\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/modules/rp_scale.py", line 108, in start\n    asyncio.run(self.run())\n', '  
File "/usr/lib/python3.12/asyncio/runners.py", line 194, in run\n    return runner.run(main)\n           ^^^^^^^^^^^^^^^^\n', '  
File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run\n    return self._loop.run_until_complete(task)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  
File "/usr/lib/python3.12/asyncio/base_events.py", line 687, in run_until_complete\n    return future.result()\n           ^^^^^^^^^^^^^^^\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/modules/rp_scale.py", line 135, in run\n    await asyncio.gather(*tasks)\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/modules/rp_scale.py", line 226, in run_jobs\n    while len(tasks) < self.current_concurrency and not self.jobs_queue.empty():\n          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', 
"TypeError: '<' not supported between instances of 'int' and 'NoneType'\n"]

To Reproduce
UnKown....

Expected behavior
running other jobs.

Screenshots

Image

Additional context
I Don't Know why is this happend. but when it cased in my concurrent worker, it Just Stop 2~3 minnute and then just restart the docker.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions