feat!: apps SDK, decorator-native GPU compute with live dev sessions and a new rp CLI#534
Open
KAJdev wants to merge 92 commits into
Open
feat!: apps SDK, decorator-native GPU compute with live dev sessions and a new rp CLI#534KAJdev wants to merge 92 commits into
KAJdev wants to merge 92 commits into
Conversation
…d datacenter selection
|
Capy auto-review is paused for this organization because the usage-cycle auto-review limit has been reached. Increase the limit or turn it off in billing settings to resume automatic reviews. |
![github-code-quality[bot]](https://avatars.githubusercontent.com/u/9919?s=60&v=4){kind=small}
KAJdev
changed the title
# Conflicts: # requirements.txt
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
There was a problem hiding this comment.
CodeQL found more than 20 potential problems in the proposed changes. Check the Files changed tab for more details.
|
Promptless prepared a documentation update related to this change. Triggered by runpod-python PR #534 This PR introduces the apps SDK (successor to |
Contributor
Author
|
@capy-ai review |
![capy-ai[bot]](https://avatars.githubusercontent.com/in/1915919?s=60&v=4){kind=small}
| # BaseException on purpose: user module top-level code can raise | ||
| # SystemExit/KeyboardInterrupt; those must surface as discovery | ||
| # errors on the caller thread, not kill this worker thread | ||
| except BaseException as exc: # noqa: BLE001 - reported to caller |
| run_entrypoint(fn) | ||
| # BaseException on purpose: SystemExit/KeyboardInterrupt from | ||
| # the entrypoint must reach the loop, not die on this thread | ||
| except BaseException as exc: # noqa: BLE001 - marshalled to the loop |
| torch.cuda.synchronize() | ||
| start = time.time() | ||
| for _ in range(10): | ||
| a @ b |
| loop.call_soon_threadsafe(_finish, None) | ||
|
|
||
| threading.Thread(target=_runner, daemon=True).start() | ||
| await done |
| rp dev tests/e2e/examples/01_hello_world.py --once | ||
| """ | ||
|
|
||
| import runpod |
|
|
||
| import asyncio | ||
|
|
||
| import runpod |
| rp dev tests/e2e/examples/03_gpu.py --once | ||
| """ | ||
|
|
||
| import runpod |
| rp dev tests/e2e/examples/04_dependencies.py --once | ||
| """ | ||
|
|
||
| import runpod |
| rp dev tests/e2e/examples/05_api_service.py --once | ||
| """ | ||
|
|
||
| import runpod |
| rp dev tests/e2e/examples/06_tasks.py --once | ||
| """ | ||
|
|
||
| import runpod |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This is the successor to
runpod-flash, folded into the corerunpodpackage. I know this is absolutely massive but its a port of all existing flash features plus whole new App, Model, and Secret classes, @app.task decorator for running ephemeral pods, new runtimes, and shims for injecting into custom images. (with 90% test coverage!)Completes CON-652
For existing Flash users
flashApps,flashEnvironments,flashBuilds). Deployed Flash apps keep running, and this client can see and manage them (rp app list,rp undeploy).@remote(...)shapes become@app.queue,@app.api, and@app.task, with full config paritypip install runpod,rp deploy. A migration guide should land in docs alongside the release.Secret()andModel()classes, + custom image supportRelease checklist
runpod.runtimes(e2e12_custom_imagecurrently pins the branch tarball viaRUNPOD_PACKAGE_SPEC)runpod-flashrunpod config,exec, andprojectCLI commands removed;rp loginandrp initreplace themrp updateagainst the published version, drop the tarball note from the e2e READMEBreaking changes
config,exec, andprojectcommand groups removed;ssh list-keysandadd-keyrenamed tossh listandaddrunpod.serverless,Endpoint, and ctl commands are unchanged.