Skip to content

Instantly share code, notes, and snippets.

@conorsch
Created March 31, 2020 23:25
Show Gist options
  • Save conorsch/db95d5add4af4ab68862257cca655882 to your computer and use it in GitHub Desktop.
Save conorsch/db95d5add4af4ab68862257cca655882 to your computer and use it in GitHub Desktop.
Observations during debugging qubes-qmemman service
[root@dom0 ~]# cat /home/user/scripts/evaluate-qmemman.sh
#!/bin/bash
set -u
set -o pipefail
vm="fpf-dev-dvm"
echo "Poll the assigned memory for the vm, so we can see whether it changes"
while true; do
echo "$(date) $(xl list | grep -i $vm)"
sleep 2;
done &
# Wait a bit to gather data...
sleep 10
echo "Firefox was running, let's kill it"
qvm-run -p "$vm" "pgrep firefox-esr"
qvm-run "$vm" "killall firefox-esr"
sleep 2
qvm-run -p "$vm" "pgrep firefox-esr" || true
echo "Start Firefox again, which should rebalance memory"
qvm-run "$vm" firefox &
echo "Check whether script thinks qmemman failed"
/home/user/scripts/check-qmemman.sh || true
sleep 5
echo "Let's restart qmemman and see if that helps"
sudo systemctl restart qubes-qmemman
sleep 30
wait
[root@dom0 ~]# /home/user/scripts/evaluate-qmemman.sh
Poll the assigned memory for the vm, so we can see whether it changes
Mon Mar 30 16:53:55 PDT 2020 fpf-dev-dvm 85 399 2 -b---- 677.2
Mon Mar 30 16:53:57 PDT 2020 fpf-dev-dvm 85 399 2 -b---- 677.3
Mon Mar 30 16:53:59 PDT 2020 fpf-dev-dvm 85 399 2 -b---- 677.3
Mon Mar 30 16:54:01 PDT 2020 fpf-dev-dvm 85 399 2 -b---- 677.3
Mon Mar 30 16:54:03 PDT 2020 fpf-dev-dvm 85 399 2 -b---- 677.3
Firefox was running, let's kill it
Mon Mar 30 16:54:05 PDT 2020 fpf-dev-dvm 85 399 2 -b---- 677.3
3219
Running 'killall firefox-esr' on fpf-dev-dvm
Mon Mar 30 16:54:07 PDT 2020 fpf-dev-dvm 85 399 2 -b---- 677.6
Start Firefox again, which should rebalance memory
Check whether script thinks qmemman failed
Running 'firefox' on fpf-dev-dvm
Looks like qmembalance has failed.
You should restarted it with:
sudo systemctl restart qubes-qmemman
Mon Mar 30 16:54:09 PDT 2020 fpf-dev-dvm 85 399 2 -b---- 678.6
Mon Mar 30 16:54:11 PDT 2020 fpf-dev-dvm 85 399 2 r----- 680.3
Let's restart qmemman and see if that helps
Mon Mar 30 16:54:13 PDT 2020 fpf-dev-dvm 85 399 2 -b---- 681.7
Mon Mar 30 16:54:15 PDT 2020 fpf-dev-dvm 85 2108 2 r----- 683.6
Mon Mar 30 16:54:17 PDT 2020 fpf-dev-dvm 85 2338 2 -b---- 685.6
Mon Mar 30 16:54:19 PDT 2020 fpf-dev-dvm 85 2338 2 -b---- 685.8
Mon Mar 30 16:54:21 PDT 2020 fpf-dev-dvm 85 2338 2 -b---- 685.9
Mon Mar 30 16:54:23 PDT 2020 fpf-dev-dvm 85 2271 2 -b---- 686.3
Mon Mar 30 16:54:25 PDT 2020 fpf-dev-dvm 85 2272 2 r----- 687.5
Mon Mar 30 16:54:27 PDT 2020 fpf-dev-dvm 85 2429 2 r----- 690.3
Mon Mar 30 16:54:29 PDT 2020 fpf-dev-dvm 85 2578 2 -b---- 692.0
Mon Mar 30 16:54:31 PDT 2020 fpf-dev-dvm 85 2746 2 -b---- 693.5
Mon Mar 30 16:54:33 PDT 2020 fpf-dev-dvm 85 2746 2 -b---- 694.3
Mon Mar 30 16:54:35 PDT 2020 fpf-dev-dvm 85 2657 2 -b---- 695.4
Mon Mar 30 16:54:37 PDT 2020 fpf-dev-dvm 85 2747 2 -b---- 696.6
Mon Mar 30 16:54:39 PDT 2020 fpf-dev-dvm 85 2724 2 r----- 697.9
Mon Mar 30 16:54:41 PDT 2020 fpf-dev-dvm 85 2724 2 r----- 699.1
Mon Mar 30 16:54:43 PDT 2020 fpf-dev-dvm 85 2739 2 r----- 700.9
Mon Mar 30 16:54:45 PDT 2020 fpf-dev-dvm 85 2802 2 r----- 703.0
Mon Mar 30 16:54:47 PDT 2020 fpf-dev-dvm 85 2802 2 r----- 705.0
Mon Mar 30 16:54:49 PDT 2020 fpf-dev-dvm 85 2802 2 r----- 706.2
Mon Mar 30 16:54:51 PDT 2020 fpf-dev-dvm 85 2802 2 r----- 707.6
Mon Mar 30 16:54:53 PDT 2020 fpf-dev-dvm 85 2802 2 -b---- 708.4
Mon Mar 30 16:54:55 PDT 2020 fpf-dev-dvm 85 2802 2 -b---- 709.5
Mon Mar 30 16:54:57 PDT 2020 fpf-dev-dvm 85 2802 2 -b---- 710.2
Mon Mar 30 16:54:59 PDT 2020 fpf-dev-dvm 85 2802 2 -b---- 711.2
Mon Mar 30 16:55:02 PDT 2020 fpf-dev-dvm 85 2874 2 -b---- 712.7
Mon Mar 30 16:55:04 PDT 2020 fpf-dev-dvm 85 2874 2 -b---- 713.6
Mon Mar 30 16:55:06 PDT 2020 fpf-dev-dvm 85 2874 2 ------ 714.8
Mon Mar 30 16:55:08 PDT 2020 fpf-dev-dvm 85 2874 2 -b---- 715.5
Mon Mar 30 16:55:10 PDT 2020 fpf-dev-dvm 85 2874 2 -b---- 716.8
Mon Mar 30 16:55:12 PDT 2020 fpf-dev-dvm 85 2874 2 -b---- 717.7
Mon Mar 30 16:55:14 PDT 2020 fpf-dev-dvm 85 2874 2 r----- 718.8
Mon Mar 30 16:55:16 PDT 2020 fpf-dev-dvm 85 2874 2 -b---- 719.4
Mon Mar 30 16:55:18 PDT 2020 fpf-dev-dvm 85 2874 2 -b---- 720.4
Mon Mar 30 16:55:20 PDT 2020 fpf-dev-dvm 85 2874 2 r----- 721.2
Mon Mar 30 16:55:22 PDT 2020 fpf-dev-dvm 85 2859 2 -b---- 722.0
Mon Mar 30 16:55:24 PDT 2020 fpf-dev-dvm 85 2859 2 r----- 722.8
Mon Mar 30 16:55:26 PDT 2020 fpf-dev-dvm 85 2859 2 -b---- 724.0
Mon Mar 30 16:55:28 PDT 2020 fpf-dev-dvm 85 2859 2 -b---- 724.7
Mon Mar 30 16:55:30 PDT 2020 fpf-dev-dvm 85 2859 2 -b---- 725.6
Mon Mar 30 16:55:32 PDT 2020 fpf-dev-dvm 85 2859 2 -b---- 726.5
Mon Mar 30 16:55:34 PDT 2020 fpf-dev-dvm 85 2859 2 -b---- 727.5
Mon Mar 30 16:55:36 PDT 2020 fpf-dev-dvm 85 2859 2 -b---- 728.6
Mon Mar 30 16:55:38 PDT 2020 fpf-dev-dvm 85 2467 2 -b---- 729.8
Mon Mar 30 16:55:40 PDT 2020 fpf-dev-dvm 85 2550 2 r----- 731.2
Mon Mar 30 16:55:42 PDT 2020 fpf-dev-dvm 85 2693 2 r----- 733.7
^C
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment