Skip to content

Production Deploy#3457

Merged
davidsmejia merged 103 commits into
masterfrom
dev
Nov 9, 2023
Merged

Production Deploy#3457
davidsmejia merged 103 commits into
masterfrom
dev

Conversation

@davidsmejia

@davidsmejia davidsmejia commented Nov 9, 2023

Copy link
Copy Markdown
Contributor

Production Deploy v1.46.22

Changelog

  • Integrates 1 Password for secrets management
  • Moves away from RAVEN_DSN naming to SENTRY_DSN
  • Unifies bug tracking by using environment in Sentry configuration
  • Updates secrets naming for improved readability
  • Splits NOOP and Downloader tests
  • removes tracking of dev tfvars
  • improvements to slack updates summary
  • renames harmonized value genotype to genetic_information
  • persists harmonized value developmental_stage
  • adds new mappings for supported airway pathogens via Add new airway pathogens to organism-strain mapping file #3366
  • adds species taxon id to mapping config file to handle ambiguity when processing a division
  • adds tracking data request command for reporting on data processing requests
  • scales up worker storage to from 500GB to 1TB
  • transcriptome indexes download protocol from ftp to http
  • implements heredoc syntax for dockerfiles
  • moves api static files from /tmp to /var
  • and other housekeeping changes

arkid15r and others added 30 commits September 12, 2023 08:51
Place compendia test data to data-refinery-test-assets bucket
Move microarray.txt and rnaseq.txt under workers/tests/data
Sort microarray.txt and rnaseq.txt URLs
Don't include 0 downloads users into stats calculation
Use GH workflow badge for refine.bio status
Add a command that gathers/shows stats based on a accession code list.
The areas of interest include attempted/available experiments
(total and broken down by source) as well as attempted/available samples
(total and broken down by source).
The total number of jobs created includes all job types.
Export SYSTEM_VERSION when unset
Set platform for `run_management_command.sh`
It's mostly done to speed up the prod (different docker registry)
build process.
…-for-prod-image-builds

Extend using of staging images cache
  - Unify secret names
  - Move SSH_PUBLIC_KEY to vars
  - Set GH env secrets in necessary scopes only
  - Add environment and release version into Sentry context
Update downloaders image aspera path.
arkid15r and others added 26 commits October 20, 2023 11:08
  - Bump certifi version
  - Remove unused coveralls dependency
…op-test-jobs

Split downloaders/no_op test jobs
…ntal-stage

Add Sample::developmental_stage field support
…start

Add API server SSH connection check
  - Remove 30d+ old Docker images.
  - Use wget instead of curl for gene index downloads
  - Set specific unzip/rm file instructions
  - Set pre-commit to use Python 3.11
…tart-flag

Add restart flag to API docker container
…estart

Map static dir on API to /var/www/volumes_static on deploy
Co-authored-by: Arkadii Yakovets <ark@ccdatalab.org>
…pi-static-dir

3452 Ensure /var/www/volumes_static exists on container restart
@davidsmejia davidsmejia requested a review from arkid15r November 9, 2023 18:25
@davidsmejia davidsmejia marked this pull request as ready for review November 9, 2023 19:14

@arkid15r arkid15r left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 🚀

🤞

@davidsmejia davidsmejia merged commit 50ac1f4 into master Nov 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants