Commit Graph

127 Commits

Author SHA1 Message Date
TC
24f3438b31 Limit CI testing to relevant changes 2024-12-25 16:10:27 +00:00
TC
2cf82dd7b8 Adding Semgrep to CI 2024-12-25 04:49:13 +00:00
TC Johnson
c198064b90
Version update: v0.4.0 → v0.4.1 2024-10-25 14:35:08 -05:00
TC Johnson
0909068270
Version update: v0.4.0 → v0.4.1 2024-10-24 20:33:53 -05:00
TC
493428d3b2 Re-commented crates and python publishing until I can update rustc on the build machine images. [ci skip] 2024-10-25 01:26:21 +00:00
TC
b3e8fd907f Uncommented Crates and Python publishing jobs [ci skip] 2024-10-25 00:19:03 +00:00
TC
9fb54947e2 Add pipeline failure job that destroys build machines [ci skip] 2024-09-15 20:20:17 +00:00
-k
76cc33a00f
Skip format job during release runs 2024-08-14 20:47:14 -07:00
-k
384cff519d
Do not cache outside of project directory
gitlab-org/gitlab#14151
2024-08-14 20:45:30 -07:00
-k
c608e0a3b7
Add format job 2024-08-09 23:55:24 -07:00
TC
06abd73731 Update .gitlab-ci.yml file [ci skip] 2024-08-02 15:18:13 +00:00
TC
952254b73b Just going to re-run the release but without pushing crates or python. [skip ci] 2024-08-02 15:13:25 +00:00
TC
b4e4299e7b temp change 2 to complete stuck release [skip ci] 2024-08-02 15:04:49 +00:00
TC
d142c3d8c5 temp change to complete stuck release [skip ci] 2024-08-02 15:02:10 +00:00
TC
e2d4121c2c Fixing order of jobs. Needs setting of build_repositories was causing stage leap frogging. 2024-08-02 02:58:24 +00:00
TC
b1ff6b643b Merge branch 'add_nightly_builds' into 'main'
Another tweak to GitLab secure storage

See merge request veilid/veilid!300
2024-07-19 20:50:48 +00:00
TC Johnson
ab582b8d3e
Another tweak to GitLab secure storage 2024-07-19 15:49:29 -05:00
TC
b776accb94 Merge branch 'add_nightly_builds' into 'main'
Further adventures in nightly release automation

See merge request veilid/veilid!297
2024-07-19 19:11:41 +00:00
TC Johnson
c9d2b354f7
Further adventures in nightly release automation
Pushing this up in order to end-to-end test automated nightly
releases.
 Please enter the commit message for your changes. Lines starting
2024-07-19 14:08:25 -05:00
TC
0d95aa0859 Merge branch 'add_nightly_builds' into 'main'
Fixed CICD missing params

See merge request veilid/veilid!295
2024-07-15 03:58:58 +00:00
TC Johnson
ae46f32187
Fixed CICD missing params 2024-07-14 22:58:26 -05:00
TC
d062d60bf5 Merge branch 'add_nightly_builds' into 'main'
Manually set nightly to true in Earthfile to test rest of process

See merge request veilid/veilid!293
2024-07-15 03:14:49 +00:00
TC Johnson
59a69e7839
Manually set nightly to true in Earthfile to test rest of process 2024-07-14 22:13:53 -05:00
TC
34c1bcc08c Merge branch 'add_nightly_builds' into 'main'
Found Earthly doc saying ENVAR should be in quotes

See merge request veilid/veilid!292
2024-07-15 02:15:43 +00:00
TC Johnson
579abedcab
Found Earthly doc saying ENVAR should be in quotes 2024-07-14 21:15:02 -05:00
TC
efe0d28cf1 Update .gitlab-ci.yml file 2024-07-14 23:19:53 +00:00
TC
bf6d21e1f1 Update .gitlab-ci.yml file 2024-07-14 23:17:29 +00:00
TC
e22d00b92d The CI yaml doesn't accept a bool as a custom variable. I've switched it to a string to pass linting but I think this is going to break stuff. 2024-07-14 22:43:24 +00:00
TC Johnson
fc7debba3f
Adding automatic nightly release builds
- Restructured linux repo directory structure to include Stable and Nightly releases
- Reworked Earthfile to pass IS_NIGHTLY boolean to package build scripts for use in
file names
- Added nightly pipeline to CICD config yaml. Pipeline is triggered by IS_NIGHTLY
variable
- Two distribution scripts now exist, one for Stable and one for Nightly
- Reworked RPM build spec files to create appropriate file names
- Reworked debian release generation scripts
- RPM repo directory structure is prepped for arm64 builds
- Switched from scp to rsync for moving the completed repo from ochestration
to repo server
- Created schedule in Gitlab UI to trigger nightly release at 2300 Central Time
2024-07-14 17:22:50 -05:00
Δ ǀ Ξ ȼ
33141776f3
Add support for no container repository (i.e. a new fork) 2024-05-22 23:07:57 +01:00
Δ ǀ Ξ ȼ
35b1c7f847
Rebuild container cache if Earthfile is newer than cache 2024-05-06 21:55:27 +01:00
TC
bcacaeb300 [ci dryrun] 2024-04-30 00:44:21 +00:00
TC
4242e6179d [ci dryrun] 2024-04-30 00:22:44 +00:00
TC
6a7afe9017 Uncommented crates.io section. 2024-04-30 00:04:30 +00:00
TC
c3035a0406 Uncommented crates.io section. 2024-04-30 00:02:59 +00:00
TC
59d261b899 [ci dryrun] 2024-04-29 22:34:52 +00:00
TC
058df24933 [ci dryrun] 2024-04-29 22:16:38 +00:00
TC
31347f3ce0 [ci dryrun] 2024-04-29 22:15:19 +00:00
TC Johnson
4d9787fb86
Fixes scp from build machines to orchestrator
Each machine needed a script this specified that machine's arch
and OS type. Also added a rule on the cache and test jobs to not
run if the dry run trigger is present. [ci dryrun]
2024-04-29 17:07:40 -05:00
TC Johnson
37dbe70e05
Testing dry run trigger
The trigger is [ci dryrun]
2024-04-29 16:26:13 -05:00
TC Johnson
bd4600576f
Switched to regex trigger
The previous trigger condition wasn't liked by Gitlab's
yaml parser. I'm switching to trying a commit message
based regex trigger. This message does not contain the
trigger and so should not fire the dry run.
2024-04-29 16:22:58 -05:00
TC Johnson
0a1a37f048
Replaced missing 'if:' on line 249. 2024-04-29 16:12:37 -05:00
TC Johnson
fa1ca77d35
Further dry run trigger refinements
The dry run should now be configured if changes to .gitlab-ci.yml,
Earthfile, contents of scripts/cicd, or contents of package arrive
as the result of a push OR merge but NOT when a tag is present. I
think that will prevent the dry run executing alongside the actual
release process when a new release tag is pushed but that also
contains changes to the above mentioned files. <fingers crossed emoji>
2024-04-29 16:03:38 -05:00
TC Johnson
c33f0f19da
Added Earthfile condition and RPM spec fix
Dry run will now trigger for Earthfile changes. I also reordered the
changelog in veilid-server.spec to descending to correct that error.

Commented out the crates.io publishing dry run. This branch does not
have access to the protected variables.
2024-04-29 15:26:03 -05:00
TC Johnson
038f4d2121
Added CICD dry run
This is the first attempt at setting up a dry run pipeline
to test changes to the CICD config without actually publishing
the compiled binaries and packages built by the process.

The dry run should be triggered by any changes to .gitlab-ci.yml
or changes to any of the scripts under scripts/cicd/.
2024-04-29 14:40:07 -05:00
TC Johnson
6c6be00feb
Calling bash explicitly
The paths work now, but the scripts are not set with execute permission.
I don't know if that permission will survive the transfer from my machine
across the git and runner stuff so I added an explicit call for bash instead.
2024-04-28 20:39:18 -05:00
TC Johnson
2821e4ee18
It was a typo in the script name
Was missing the r in ctrl then spread via copy paste. Fixed the typo and
reverted the paths to relative because that should work just fine.
2024-04-28 19:24:45 -05:00
TC Johnson
4644b7a401
Hardcoded runner IDs into script paths
The runner ID CI variable resolved to the runners' numeric ID whereas
the project path uses the runners' alpha-numeric formatted ID. Both
IDs show in Gitlab's settings->cicd->runners. For the time being, I've
hardcoded the alpha-numeric ID into the script paths in the CI config.
If we have to retate runners, we will need to update these entries.
2024-04-28 18:58:28 -05:00
TC Johnson
2a73946246
Modified path to CICD scripts in CI config
I thought CICD's working directory was in the project root but the release
failed to find the scripts. I've changed the script executions to absolute
paths. There's a directory is named for the runner's ID, is different on
each machine, and changes if the runner is replaced. There's a variable
that should overcome this, CI_RUNNER_ID, which I've used in the asbolute
paths. Fingers crossed, let's try it again.
2024-04-28 18:21:39 -05:00
TC Johnson
06f344ebb4
Migrating CICD scripts to Veilid repo
Copied CICD scripts into the repository so that the community can make
contributions to the build system. Wrote a brief description of the
build and distribute process. Modified the CICD config to use the repo
hosted scripts. [ci skip]
2024-04-21 13:37:45 -05:00