Commit Graph

19 Commits (be2512d2703d60f284f26d68c9bec6b7d40e4dec)

Author SHA1 Message Date
Guillermo Rodriguez be2512d270
Further simplification of daemon code, remove NetConnector 2025-02-18 16:27:41 -03:00
Guillermo Rodriguez 6a991561de
Mostly minor typing and comment changes remaining from fomos re-review, only big change is removed BaseException catch inside compute_one 2025-02-18 16:07:57 -03:00
Guillermo Rodriguez 9eb46862ae
Add CI, finish structification, break smart contract table sync logic to its own class with context manager, add better test helpers 2025-02-18 16:07:57 -03:00
Guillermo Rodriguez 30eaa6c194
Switch to non interator poller, NetConnector has wait_data_update() now 2025-02-18 15:56:47 -03:00
Guillermo Rodriguez f39859943d
Update py-leap and use its new apis on testing, add a comment on fields of DgpuConfig struct, minor name changing and mechanics of open_worker, make logging configurable 2025-02-18 15:56:46 -03:00
Guillermo Rodriguez 149d9f9f33
Factor out WorkerDaemon, split into functions, made poller into an async gen and moved it to NetConnector as well as should_cancel 2025-02-18 15:56:46 -03:00
Guillermo Rodriguez ea3b35904c
Create msgspec struct for config 2025-02-18 15:56:46 -03:00
Guillermo Rodriguez 5a3a43b3c6
Refactoring tui to be functional style 2025-02-18 15:56:46 -03:00
Guillermo Rodriguez 12b32a7188
Refactor ModelMngr to be a context manager + function combo 2025-02-18 15:56:46 -03:00
Guillermo Rodriguez 8b45fb5979
Begin adding TUI 2025-02-18 15:56:45 -03:00
Guillermo Rodriguez a5dbe5ab12
Further improvements in indentation and logic in daemons maybe_serve_one, also might of fixed a bug related to using id instead of request_id in the search existing results phase, and add way more logging 2025-02-18 15:56:45 -03:00
Guillermo Rodriguez 1b437b761b
Change dgpu submodules classes name per fomos suggestion 2025-02-18 15:56:45 -03:00
Guillermo Rodriguez 5f5314cd35
Remove all shebangs 2025-02-18 15:56:45 -03:00
Tyler Goodlet e0704e3787
Suggest `skynet.dgpu` docs, typing, pythonisms
From the deep-ish dive drafting our first set of design/architecture
diagrams in https://github.com/skygpu/cyberdyne/pull/2, this adds
a buncha suggestions, typing, and styling adjustments.

Namely the code tweaks include,
- changing to multi-line import tuples where appropriate (since they're
  much handier to modify ;)
- adding typing in many spots where it wasn't clear to me the types
  being returned/operated-with in various (internal) methods.
- doc strings (in mostly random spots Xp ) where i had the need to
  remember the impl's purpose but didn't want to re-read the code in
  detail again.
- ALOT of TODOs surrounding various potential style changes,
  re-factorings, naming and in some cases "modernization" according to
  the latest python3.12 feats/spec/stdlib.
2025-02-18 15:56:17 -03:00
Tyler Goodlet 01e6bfe252
Doc and type `skynet.dgpu` pkg mod 2025-02-18 15:56:17 -03:00
Guillermo Rodriguez edd6ccc3e1
Add worker benchmark api 2023-10-08 19:37:25 -03:00
Guillermo Rodriguez d3b5d56187
Add new data gathering mechanic on worker and mp tractor backend 2023-10-07 21:28:52 -03:00
Guillermo Rodriguez 3622c8ea11
Add venv to dockerignore
Improve readme
Improve dockerization as ipfs cli exec runs not needed anymore
Fix pyproject toml for gpu workers
Add more sections on example config
Drop and siomplify many cli commands, try to use config.ini for everything now
Use more dynamic imports on cli to speed up startup
Improve model pipelines to allow low mem cards to run big models
Add upscaler download to `skynet download` cmd
2023-10-07 11:01:40 -03:00
Guillermo Rodriguez bbc5751837
Separate worker into submodules 2023-06-04 17:51:43 -03:00