2023-11-13 09:33:28 -05:00
|
|
|
# sys-cacher
|
|
|
|
|
|
|
|
Caching proxy server for software repositories in Qubes OS.
|
|
|
|
|
|
|
|
## Table of Contents
|
|
|
|
|
|
|
|
* [Description](#description)
|
|
|
|
* [Installation](#installation)
|
2024-04-26 13:27:52 -04:00
|
|
|
* [Access control](#access-control)
|
2023-11-13 09:33:28 -05:00
|
|
|
* [Usage](#usage)
|
|
|
|
* [Report Page and Maintenance Tasks](#report-page-and-maintenance-tasks)
|
|
|
|
* [Connect to the cacher via IP instead of Qrexec](#connect-to-the-cacher-via-ip-instead-of-qrexec)
|
|
|
|
* [Non-TemplateVMs integration](#non-templatevms-integration)
|
|
|
|
* [Uninstallation](#uninstallation)
|
|
|
|
* [Credits](#credits)
|
|
|
|
|
|
|
|
## Description
|
|
|
|
|
|
|
|
The caching proxy is "sys-cacher" based on apt-cacher-ng, it stores downloaded
|
2024-06-06 14:38:27 -04:00
|
|
|
packages, so that you need only download a package once and fetch locally the
|
|
|
|
next time you want to upgrade your system packages.
|
2023-11-13 09:33:28 -05:00
|
|
|
|
2024-01-12 11:30:29 -05:00
|
|
|
When you install this package, qubes will be tagged with "updatevm-sys-cacher"
|
2023-11-13 09:33:28 -05:00
|
|
|
and they will be altered to use the proxy by default. When there is "https://"
|
|
|
|
in your repository definitions, the entries will be changed in the templates
|
|
|
|
from to "http://HTTPS///". This is so that the request to the proxy is plain
|
|
|
|
text, and the proxy will then make the request via https.
|
|
|
|
|
|
|
|
This change will be done automatically for every template that exists and is
|
|
|
|
not Whonix based. No changes are made to Whonix templates, and updates to
|
|
|
|
those templates will not be cached.
|
|
|
|
|
2024-06-06 14:38:27 -04:00
|
|
|
The caching proxy supports:
|
|
|
|
|
|
|
|
- Debian and derivatives (but not Whonix)
|
|
|
|
- Fedora and derivatives
|
|
|
|
- Arch Linux and derivatives
|
2024-05-29 10:16:03 -04:00
|
|
|
|
2023-11-13 09:33:28 -05:00
|
|
|
## Installation
|
|
|
|
|
|
|
|
Installation may take a long time as it will target all templates unless you
|
|
|
|
specify otherwise.
|
|
|
|
|
|
|
|
- Top
|
|
|
|
```sh
|
2024-02-23 10:54:35 -05:00
|
|
|
sudo qubesctl top.enable sys-cacher browser
|
|
|
|
sudo qubesctl --targets=tpl-browser,sys-cacher-browser,tpl-sys-cacher,sys-cacher state.apply
|
|
|
|
sudo qubesctl top.disable sys-cacher browser
|
|
|
|
sudo qubesctl state.apply sys-cacher.appmenus,sys-cacher.tag
|
2024-04-25 05:25:42 -04:00
|
|
|
sudo qubesctl --skip-dom0 --targets="$(qvm-ls --no-spinner --raw-list --tags updatevm-sys-cacher | tr "\n" ",")" state.apply sys-cacher.install-client
|
2023-11-13 09:33:28 -05:00
|
|
|
```
|
|
|
|
|
|
|
|
- State
|
|
|
|
<!-- pkg:begin:post-install -->
|
|
|
|
```sh
|
2024-02-23 10:54:35 -05:00
|
|
|
sudo qubesctl state.apply sys-cacher.create
|
|
|
|
sudo qubesctl --skip-dom0 --targets=tpl-browser state.apply browser.install
|
|
|
|
sudo qubesctl --skip-dom0 --targets=tpl-sys-cacher state.apply sys-cacher.install
|
|
|
|
sudo qubesctl --skip-dom0 --targets=sys-cacher state.apply sys-cacher.configure
|
|
|
|
sudo qubesctl --skip-dom0 --targets=sys-cacher-browser state.apply sys-cacher.configure-browser
|
|
|
|
sudo qubesctl state.apply sys-cacher.appmenus,sys-cacher.tag
|
2024-03-25 07:34:59 -04:00
|
|
|
sudo qubesctl --skip-dom0 --targets="$(qvm-ls --no-spinner --raw-list --tags updatevm-sys-cacher | tr "\n" ",")" state.apply sys-cacher.install-client
|
2023-11-13 09:33:28 -05:00
|
|
|
```
|
|
|
|
<!-- pkg:end:post-install -->
|
|
|
|
|
2024-04-13 10:09:06 -04:00
|
|
|
## Access control
|
|
|
|
|
|
|
|
The distributed policy will take precedence over the ones set during first
|
|
|
|
installation or the GUI Global Config. If you want to use `sys-cacher`
|
|
|
|
and edit configuration for certain qubes to update over different proxys, you
|
|
|
|
can do so.
|
|
|
|
|
|
|
|
Allow qubes with tag `whonix-updatevm` to use the proxy in `sys-alt-whonix`
|
|
|
|
and qube `dev` to use the proxy in `disp-sys-net`.
|
|
|
|
```qrexecpolicy
|
|
|
|
qubes.UpdatesProxy * @tag:whonix-updatevm @default allow target=sys-alt-whonix
|
|
|
|
qubes.UpdatesProxy * @tag:whonix-updatevm @anyvm deny
|
|
|
|
qubes.UpdatesProxy * dev @default allow target=disp-sys-net
|
|
|
|
qubes.UpdatesProxy * dev @anyvm deny
|
|
|
|
```
|
|
|
|
|
2024-04-25 05:53:47 -04:00
|
|
|
## Usage
|
|
|
|
|
2023-11-13 09:33:28 -05:00
|
|
|
### Report Page and Maintenance Tasks
|
|
|
|
|
|
|
|
The report page is available from `sys-cacher` and `sys-cacher-browser` at
|
|
|
|
`http://127.0.0.1:8082/acng-report.html` and any other client qube that has
|
|
|
|
`sys-cacher` as it's update qube. This is apt-cacher-ng limitation and is bad
|
|
|
|
security wise, every client has administrative access to the cacher qube. You
|
|
|
|
should add the following to the end of `sys-cacher` rc.local:
|
|
|
|
```sh
|
2023-11-21 18:55:16 -05:00
|
|
|
echo "AdminAuth: username:password" | tee /etc/qubes-apt-cacher-ng/zzz_security.conf
|
2023-11-13 09:33:28 -05:00
|
|
|
```
|
|
|
|
Where username and password are HTTP Auth strings.
|
|
|
|
|
|
|
|
If you want to view statistics or manage the server through a GUI, open
|
|
|
|
`sys-cacher` or `sys-cacher-browser` desktop file `cacher-browser.desktop`
|
|
|
|
from Dom0. Addresses starting with `http` or `https` will be redirected
|
|
|
|
to `sys-cacher-browser`.
|
|
|
|
|
|
|
|
The browser separation from the server is to avoid browsing malicious sites
|
|
|
|
and exposing the browser to direct network on the same machine the server is
|
|
|
|
running. The browser qube is offline and only has access to the admin
|
|
|
|
interface. In other words, it has control over the server functions, if the
|
|
|
|
browser is compromised, it can compromise the server.
|
|
|
|
|
|
|
|
### Connect to the cacher via IP instead of Qrexec
|
|
|
|
|
|
|
|
Because the `sys-cacher` qube is listening on port `8082`, you can use it from
|
|
|
|
non-template qubes and qubes that do not have a working Qrexec. Use the native
|
|
|
|
configuration to set the update proxy using the IP address of `sys-cacher` by
|
2024-03-21 16:50:02 -04:00
|
|
|
setting `sys-cacher` as the netvm of the client qube.
|
2023-11-13 09:33:28 -05:00
|
|
|
|
2024-04-26 13:23:14 -04:00
|
|
|
Set `sys-cacher` as the netvm of your qube:
|
|
|
|
```sh
|
|
|
|
qvm-prefs QUBE netvm sys-cacher
|
|
|
|
```
|
|
|
|
|
|
|
|
Enable the service `netvm-cacher`:
|
|
|
|
```sh
|
|
|
|
qvm-features QUBE service.netvm-cacher 1
|
|
|
|
```
|
|
|
|
|
|
|
|
Copy [apt-cacher-ng-repo](files/client/bin/apt-cacher-ng-repo) to your qube
|
|
|
|
and set the script to run on boot. Make sure that the file
|
|
|
|
`/var/run/qubes-service/netvm-cacher` exists on every startup for the proxy
|
|
|
|
address change take effect.
|
|
|
|
|
|
|
|
The qube has to be restarted for changes to take effect.
|
|
|
|
|
2023-11-13 09:33:28 -05:00
|
|
|
### Non-TemplateVMs integration
|
|
|
|
|
2024-03-21 16:50:02 -04:00
|
|
|
**Attention**: this method will allow a client qube to bypass the qubes
|
2024-04-26 13:23:14 -04:00
|
|
|
firewall and connect to a remote host via the updates proxy.
|
2023-11-13 09:33:28 -05:00
|
|
|
|
|
|
|
By default, only templates will use the proxy to update, if you want to cache
|
2024-04-26 13:23:14 -04:00
|
|
|
non-TemplateVMs updates or simply make them functional again, the qube will
|
2023-11-13 09:33:28 -05:00
|
|
|
need the `service.updates-proxy-setup` feature set:
|
|
|
|
```sh
|
2024-06-06 14:38:27 -04:00
|
|
|
qvm-tags QUBE add updatevm-sys-cacher
|
2023-11-13 09:33:28 -05:00
|
|
|
qvm-features QUBE service.updates-proxy-setup 1
|
2024-03-25 07:34:59 -04:00
|
|
|
sudo qubesctl --skip-dom0 --targets=QUBE state.apply sys-cacher.install-client
|
2023-11-13 09:33:28 -05:00
|
|
|
```
|
|
|
|
Don't forget to restart the qube.
|
|
|
|
|
|
|
|
If you don't want or can't restart the qube, such as DispVMs, where you would
|
2024-03-25 07:34:59 -04:00
|
|
|
lose the current session:
|
2023-11-13 09:33:28 -05:00
|
|
|
```sh
|
2024-06-06 14:38:27 -04:00
|
|
|
qvm-tags QUBE add updatevm-sys-cacher
|
2024-03-25 07:34:59 -04:00
|
|
|
qvm-features QUBE service.updates-proxy-setup 1
|
2024-06-06 14:38:27 -04:00
|
|
|
sudo qubesctl --skip-dom0 --targets=QUBE state.apply sys-cacher.install-client
|
2024-03-25 07:34:59 -04:00
|
|
|
qvm-run --user=root QUBE -- "
|
2024-04-30 08:05:48 -04:00
|
|
|
touch /var/run/qubes-service/updates-proxy-setup
|
|
|
|
/usr/bin/apt-cacher-ng-repo
|
|
|
|
systemctl restart qubes-updates-proxy-forwarder.socket"
|
2023-11-13 09:33:28 -05:00
|
|
|
```
|
|
|
|
|
|
|
|
## Uninstallation
|
|
|
|
|
|
|
|
- Top:
|
|
|
|
```sh
|
2024-02-23 10:54:35 -05:00
|
|
|
sudo qubesctl top.enable sys-cacher.deinit
|
2024-03-25 07:34:59 -04:00
|
|
|
sudo qubesctl --targets="$(qvm-ls --no-spinner --raw-list --tags updatevm-sys-cacher | tr "\n" ",")" state.apply
|
2024-02-23 10:54:35 -05:00
|
|
|
sudo qubesctl top.disable sys-cacher.deinit
|
2024-04-25 05:25:42 -04:00
|
|
|
sudo qubesctl state.apply sys-cacher.untag
|
2023-11-13 09:33:28 -05:00
|
|
|
```
|
|
|
|
|
|
|
|
- State:
|
|
|
|
```sh
|
2024-02-23 10:54:35 -05:00
|
|
|
sudo qubesctl state.apply sys-cacher.remove-policy
|
2024-03-25 07:34:59 -04:00
|
|
|
sudo qubesctl --skip-dom0 --targets="$(qvm-ls --no-spinner --raw-list --tags updatevm-sys-cacher | tr "\n" ",")" state.apply sys-cacher.uninstall-client
|
2024-02-23 10:54:35 -05:00
|
|
|
sudo qubesctl state.apply sys-cacher.untag
|
2023-11-13 09:33:28 -05:00
|
|
|
```
|
|
|
|
|
2024-03-25 07:34:59 -04:00
|
|
|
If you want to use the standard proxy for a few qubes, only uninstall it
|
|
|
|
from the templates that you don't want to cache packages:
|
2023-11-13 09:33:28 -05:00
|
|
|
```sh
|
2024-03-25 07:34:59 -04:00
|
|
|
sudo qubesctl --skip-dom0 --targets=QUBE state.apply sys-cacher.uninstall-client
|
2024-06-06 14:38:27 -04:00
|
|
|
qvm-tags QUBE del updatevm-sys-cacher
|
2023-11-13 09:33:28 -05:00
|
|
|
```
|
|
|
|
|
2024-05-29 10:16:03 -04:00
|
|
|
If you tagged manually a qube that is unsupported, updates for that qube will
|
|
|
|
fail. Get a full list of unsupported qubes (**warning**: there may be false
|
|
|
|
positives of supported qubes being listed):
|
|
|
|
```sh
|
|
|
|
sudo qubesctl --show-output state.apply sys-cacher.list-extra-tag
|
|
|
|
```
|
|
|
|
|
2023-11-13 09:33:28 -05:00
|
|
|
## Credits
|
|
|
|
|
|
|
|
- [Unman](https://github.com/unman/shaker/tree/main/cacher)
|