Skip to content

Dev#646

Merged
XaverStiensmeier merged 215 commits into
masterfrom
dev
May 5, 2025
Merged

Dev#646
XaverStiensmeier merged 215 commits into
masterfrom
dev

Conversation

@XaverStiensmeier

Copy link
Copy Markdown
Contributor

No description provided.

jkrue and others added 22 commits February 4, 2025 19:07
- use invidual  pyhton venv (instead of global one)
- bump ansible version to 10.7, minor changes over some tasks
fix #595 for 22.04
…in path expression

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Potential fix for code scanning alert no. 22: Uncontrolled data used in path expression
…igurations (#619)

* fixed smaller issues with the model and schema regardig the vpnInstance

* updated configuration models with reasonable value suggestions

* added exclude_none to be more core code compliant

* made other configurations minimal (just infrastructure and cloud)

* improved formatting

* REST improvements

* removed class duplicate

* fixed handler naming

* better defaults

* fixed no floating ip bug on early crashes

* Improved exception text

* Improved exceptions, get to post for no file option

* added untested public keys

* improved state message

* fixed bug for multiple on demand workers overwriting group instances

* log traceback even without debug flag. Made sshPublicKeys a list in models.py

* added debug log removed logging of entire configuration after execution

* restructured slurmctld installation

* ./ can now be used for local bibigrid.yaml paths

* removed openapi_plugin restriction

* updated gitignore

* added integration tests for rest

* updated fastapi

* moved tests to separate file. multiple minor fixes.

* added example file for rest_test.json

* added check of clouds.yaml on startup. --clouds can be used to change clouds entry name

* restructured the clouds call

* added cloud_node_requirements.yaml

* standardization encoding="UTF-8"

* please linter

* please linter

* added cluster_info to omitted folders in version print

* improved model

* replaced version number with ANY

* pleased linter

* added a test for get_requirements

* removed List aspect

* removed delays as single worker can't work async

* fixed log level added time

* now checking for success instead of exit state (bug)

* added count: 1 to verify for master and vpn

* updated documentation

* fixed line too long

* fixed comment line too long

* updated requirements files

* fixed ssh-keygen

* fixed terminate regex unsafe cluster id

* code security fixes

* code security fixes

* moved zabbix api installation to server only

* fixed host key not allowed

* print error when failed during create

* fixed a bug causing cluster creation always to fail when cluster_id is given

* changed cluster id to be 15 characters long

* updated tests

* changed raised error to ValueError

* improved error

* now uses safe_cluster_id for both possible regex

* added secure_filename check to sanitize cluster_id and updated requirements files

* bibiplay now links to /opt/ where ansible is installed

* moved not-strictly wireguard related stuff in front of wireguard

* improved logging

* formatting

* added newline at the end

* added default and enforced configuration for a range of applications

* removed print statements

* improved path construction

* moved enforced and default config path defaults to basic_path

* code cleanup

* code cleanup (moved write_cluster_state to terminate)

* added last_changed to ClusterStateResponseModel

* Minor fixes more verbosity

* imports directly from basic path now

* switched to threading instead of asyncio to fix async issues. Improved setup. Added enforced/default merge.

* now sole holder of write_cluster_state

* removed large print

* code cleanup

* simplified method that sometimes returned 2, sometimes 3 values

* feat(Rest):added basic Dockerfile for Bibigrid-Rest

* added 'meta' for create_server

* added 'meta' validation for create_server

* added tests for meta validation function str_dict_or_none

* added meta for create_server

* added configuration overwrite local value for uploaded data

* improved code alignment

* securityGroups are now addable

* additive security groups for on demand workers and master, too

* added 400 error response when trying to start a cluster with an already existing cluster_id

* fixed tests

* added security groups to validation/validator

* configuration is now linked in README.md

* updated configuration.md

* moved pylint disable

* simplified method structure

* improved help message

* added securityGroup and meta key to bibigrid.yaml

* merge meta global and instance variables

* fixed try catch positioning

* moved from docker-compose-v2 to docker-compose-plugin

* pleasing linter

* updated tests. Removed unnecessary comment

* added noAllPartition

* fixed test

* updated documentation to include noAllPartition key

* updated model

* noAllPartition added for master conf

* updated requirements txts and minor improvements

* clarified on demand in documentation

* fixed trialing '.'

---------

Co-authored-by: dweinholz <david-weinholz@web.de>
@XaverStiensmeier XaverStiensmeier merged commit e22a1ef into master May 5, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants