Bug 13076

Summary: fuse mount in borgbackup is not working in CU173
Product: IPFire Reporter: Adolf Belka <adolf.belka>
Component: ---Assignee: Adolf Belka <adolf.belka>
Status: CLOSED FIXED QA Contact:
Severity: Minor Usability    
Priority: Will only affect a few users CC: jon.murphy, peter.mueller
Version: 2   
Hardware: unspecified   
OS: Unspecified   

Description Adolf Belka 2023-04-03 11:21:34 UTC
When fixing bug 13032 the original failure was fixed but it looks like the change resulted in the fuse mount not working again. Looks like I forgot to test that functionality in the previous bug.

I will work through the changes I made for bug 13032 to find out what trigerred this.

One possibility is reqktaed to the update of fuse in CU173. It might be that that update caused python3-pyfuse3 to not work properly for borgbackup.
Comment 1 Jon 2023-04-03 14:48:14 UTC
I am curious what you saw.  Were there errors in the log or something else?  I've been using Borg since the last commit and all seems A-OK.
Comment 2 Adolf Belka 2023-04-03 16:16:28 UTC
I did an update of borgbackup and also python3-msgpack and before testing that update I ran some tests on my CU173 vm testbed system.

I ran

borg list borg_repo

and that worked fine and then I ran

borg mount borg_repo borg-mount

and I got the error message that it couldn't mount anything as it could not find any fuse system neither llfuse or pyfuse3

So is borg mount repo-path mount-point

working for you @jon with CU173?
Comment 3 Adolf Belka 2023-04-03 16:27:59 UTC
Here are the commands I just ran again on my CU173 system and re-confirmed the answers I got.

-bash-5.2$ borg list borg_repo/
Enter passphrase for key /home/user/borg_repo: 
First-test                           Sun, 2022-07-24 13:48:19 [8041788a16d33e24dd9b0aa3e513db3fe8e27b4c3ba9936548c5d0f3ab4f9947]

-bash-5.2$ borg mount borg_repo/ borg-mount/
borg mount not available: no FUSE support, BORG_FUSE_IMPL=pyfuse3,llfuse.

The repo is called First-test because that is what it was. I am just using it as a test of the borg functionality when I want to do updates.
Comment 4 Jon 2023-04-03 17:10:11 UTC
I missed that one also.  ugh...

[root@ipfire ~] # /usr/bin/borg mount --verbose /mnt/ssd/borgbackup /tmp/borg
borg mount not available: no FUSE support, BORG_FUSE_IMPL=pyfuse3,llfuse.
[root@ipfire ~] #
Comment 5 Jon 2023-04-03 17:11:42 UTC
FYI - Borg list works fine for me also

[root@ipfire ~] # /usr/bin/borg list --verbose /mnt/ssd/borgbackup
2023-02-28__13.36.15                 Tue, 2023-02-28 13:36:16 [9047b24e2961c9d024c3dfeef197f5372544338ab2825ef070def8e35fce5167]
2023-02-28__14.17.51                 Tue, 2023-02-28 14:17:52 [d6c6f8fc72a0bcabe0296f260a37362210c9dca63b731dedee0581125dec764e]
2023-03-05__23.01.06                 Sun, 2023-03-05 23:01:06 [376d2d35003b6d5e42a62cca895ce352f4294f312d0513a55dc4df730153f28f]
2023-03-12__23.01.06                 Sun, 2023-03-12 23:01:06 [f370e15c71531174892b386116e13aae360ea63791c1e6842aeee0998624e524]
2023-03-19__23.01.06                 Sun, 2023-03-19 23:01:07 [25743ef7a8edb3d016872dd2d0d59ac023505c108cf374991448f2ea773c1553]
2023-03-26__23.01.06                 Sun, 2023-03-26 23:01:06 [2f6f405f56e3b84e94e27026f607686408defbf607861313fc780545d900a3ed]
2023-03-27__23.01.06                 Mon, 2023-03-27 23:01:06 [6b7ed8711e21af6c403240847c47ee032dcc2d6e18eac3246882f36bbcf22010]
2023-03-28__23.01.06                 Tue, 2023-03-28 23:01:06 [3176d14630f6c903a4064df9f8ddd1c710b4b328bdd653849c0e625f3eb13b95]
2023-03-29__23.01.06                 Wed, 2023-03-29 23:01:06 [31df5d9a9c548502c45723022c69520c9e9038db3b3248876b1435170aaef74c]
2023-03-30__23.01.06                 Thu, 2023-03-30 23:01:06 [16e6a3c9c2289c81efd4b68f2e7b4b3e7a04156afb2ca20e2a093d3f4d25797c]
2023-03-31__23.01.06                 Fri, 2023-03-31 23:01:06 [c0fac49a8fc59971a573f49e4b8de33313794f56a0b69c979827e1b8e663ee0d]
2023-04-01__23.01.06                 Sat, 2023-04-01 23:01:06 [7edbdfb50fc9c12668dbfd4f16480117fbb6952a44f5cfc30135ee60912804b8]
2023-04-02__01.01.06                 Sun, 2023-04-02 01:01:06 [a8d7cedd009091aba62ebf179c585c80613a214e645d38e732693fb06308c229]
2023-04-02__02.01.06                 Sun, 2023-04-02 02:01:06 [cfb98d17c50294e154c26a3a87b23afcb29a4dc241274ae29b553f4a77a58294]
2023-04-02__03.01.06                 Sun, 2023-04-02 03:01:06 [1a5c55be4155ca450011fc017a80c3b4795ac79f42bf63cd009444d2adc0a6ae]
2023-04-02__04.01.06                 Sun, 2023-04-02 04:01:06 [5151e84a8699c985eddab1b3306c1865d2b0af3d30cc3c904575735ef1d98d85]
2023-04-02__05.01.06                 Sun, 2023-04-02 05:01:06 [58dbb8aa3522b9713bfe3d85d0d04d29b349ac0c94fd97e695879f3d220eabee]
2023-04-02__06.01.06                 Sun, 2023-04-02 06:01:06 [c7c88f456c0bff50ac83ec21c410d133a17034721a62a305ea894f2a6a2fa702]
2023-04-02__07.01.06                 Sun, 2023-04-02 07:01:06 [1036a1077fd26543c2993022b6945b01763590d1ab3defccdda2f4b8fa5b3e25]
2023-04-02__08.01.06                 Sun, 2023-04-02 08:01:06 [ea0e04eb18c5851ad4b057dd1ee9944062e495d6fbc07937aa1d9c3c3e212fb2]
2023-04-02__09.01.06                 Sun, 2023-04-02 09:01:06 [fc048f9119b07002bd81e349d07b0ed041df6393061e77f335ea436aa88108b9]
2023-04-02__10.01.06                 Sun, 2023-04-02 10:01:06 [a93ac466139ef0d76b8dc8d056c62060e0feea5aa700fbae19e204c65fb3d049]
2023-04-02__11.01.06                 Sun, 2023-04-02 11:01:06 [53ec51bbad66c967fbae254b374085d62d11f7d8f607796391e934647f81a69b]
2023-04-02__12.01.06                 Sun, 2023-04-02 12:01:06 [d0b5fb2b6196cd39887d883a7f9192ca247295b86bb59676c5275cb03b073dcf]
2023-04-02__13.01.06                 Sun, 2023-04-02 13:01:06 [ef9a7bc3755e3edd4c3820806b618ae19759ac64f70ce76244f80d798a2b29a0]
2023-04-02__14.01.06                 Sun, 2023-04-02 14:01:06 [a34f34bbc37862ca2480b208c8e5984071aab6763e6733d3936befc331d01698]
2023-04-02__15.01.06                 Sun, 2023-04-02 15:01:06 [27dae99666e777df1ed36d91890bf54a05c6f9e14c964b05ba06a543748108dc]
2023-04-02__16.01.06                 Sun, 2023-04-02 16:01:07 [9c0086be4406690c79513377e1044cf739062d685fcb8c37ddeeccc0097ad9af]
2023-04-02__17.01.06                 Sun, 2023-04-02 17:01:06 [23d9c679218d178e4eb5e0af9e72e905968a14b36721a2fad24201a453a30dc8]
2023-04-02__18.01.06                 Sun, 2023-04-02 18:01:06 [741eb121b8bb91929f589ffa902858d53e21745e21523851d310e3cff7d0aef0]
2023-04-02__19.01.06                 Sun, 2023-04-02 19:01:06 [1dfe1b56c9cd34ffe0705e667256fe62bdacb11e502dd61f4a574f8dd5ad9d78]
2023-04-02__20.01.06                 Sun, 2023-04-02 20:01:06 [ed47b1eea3c5d3e5abccd7ab83fa52e0011148ad3b3fee5c1b952ed9e83f387c]
2023-04-02__21.01.06                 Sun, 2023-04-02 21:01:06 [a3bda3bb3d582bccdedf0fd8d0f32eace7a5c85fa35ebde39b1b91d57ebc392c]
2023-04-02__22.01.06                 Sun, 2023-04-02 22:01:06 [4b9f6d10629aba393402eb9bd1ced1dc8a427f8ac0694fd1ac3fd0bcf9f06244]
2023-04-02__23.01.06                 Sun, 2023-04-02 23:01:07 [96a32e9eb65e54f90785b5c5e51b0caa0b0d81057b0c2d323e6858b763ae004e]
2023-04-03__00.01.06                 Mon, 2023-04-03 00:01:07 [63bda72bbf3a7850cbc88b59cb3aef971bd61dd7c8fb5b0b2111dc554f01bef9]
2023-04-03__01.01.06                 Mon, 2023-04-03 01:01:06 [1dfb053f6390263111865588842c719843e09727206df8cd1d327b790e328932]
2023-04-03__02.01.06                 Mon, 2023-04-03 02:01:06 [595af3c1970d51140101885c17a9939d8ace8d01724fe40eb36f2f559f101fb0]
2023-04-03__03.01.06                 Mon, 2023-04-03 03:01:06 [f156b231e30a61aac24322422828654db3731cb372cdf74d389d0991e215b77f]
2023-04-03__04.01.06                 Mon, 2023-04-03 04:01:06 [57ecfc5c15221b651072f598f181d31ba7f5ed33c3fc15aa8f4f0db79f751a9d]
2023-04-03__05.01.06                 Mon, 2023-04-03 05:01:06 [7893a3d4691568007b632a323309a2ac7a74d83a0cbc8d8d56a53594e5969ebe]
2023-04-03__06.01.06                 Mon, 2023-04-03 06:01:06 [e49bb76de99a7527354f28f53da2c595dd1c1fc80c1180996affe7ee4409a8ff]
2023-04-03__07.01.06                 Mon, 2023-04-03 07:01:06 [b7b2b98d5174de562eb6532e3ec5f87e9e2254861645ae80fb5b9d9dd6297072]
2023-04-03__08.01.06                 Mon, 2023-04-03 08:01:06 [9509341efd04f68454f6295dd988080fa774da06a355ce5a53d47e4684bc0a8c]
2023-04-03__09.01.06                 Mon, 2023-04-03 09:01:06 [de32b7adc0b51ef1e3328ed1758da40b932493d278136b54f14854f40cdad190]
2023-04-03__10.01.06                 Mon, 2023-04-03 10:01:07 [45513084d64fea99a787830b36bdbd7774b196073ebe9aa9f29de734b7ee3f41]
2023-04-03__11.01.06                 Mon, 2023-04-03 11:01:06 [8f4a60f3b3b970bf86affbe2335330007ec844d710d08ead019404e348058523]
[root@ipfire ~] #
Comment 6 Adolf Belka 2023-04-03 17:30:02 UTC
(In reply to Jon from comment #4)
> I missed that one also.  ugh...
> 
> [root@ipfire ~] # /usr/bin/borg mount --verbose /mnt/ssd/borgbackup /tmp/borg
> borg mount not available: no FUSE support, BORG_FUSE_IMPL=pyfuse3,llfuse.
> [root@ipfire ~] #

Thanks for the checks and confirming what I found.

To be honest, I prefer that you also have the problem otherwise we would be having to figure out what makes me have the problem and you not.

I just need to start with the previous known working combination and then change one package at a time until I find out what is causing the python3-pyfuse3 package to not be found.

I checked the build logs and there were no errors.

I will figure it out eventually but CU175 will be the earliest a fix can be included.
Comment 7 Jon 2023-04-03 19:20:04 UTC
No rush!

Right now I am playing with rsnapshot.  At the moment I like rsnapshot more.  It is much easier to setup and use.  I still need to test a few more things (including a restore).  It is rsync based and very fast!  Bottom line I may switch away from Borg.
Comment 8 Adolf Belka 2023-05-10 12:37:03 UTC
I figured out what the problem was. python3-trio was updated to 0.22.0 when python was upgraded to 3.10.8

python3-trio built okay after that change but a new dependency was created for using python3-pyfuse3. python3-trio now needs python3-exceptiongroup in executing mode and python3-flit_scm for build of python3-exceptiongroup.

python3-exceptiongroup and python3-flit_scm have no setup.py file, only pyproject.toml. Trying python3-pyproject2setuppy to create the setup.py from the pyproject.toml failed to work.

Eventually, with some help from Michael, worked out the commands needed.

Confirmed with the standard CU175 install that borg mount failed, as with CU173 and CU174.

Packages successfully built and installed in a CU175 vm machine and confirmed to work with borg mount command.
Comment 9 Adolf Belka 2023-05-10 13:08:54 UTC
Patch set submitted to dev mailing list and patchwork.


https://lists.ipfire.org/pipermail/development/2023-May/015871.html
https://patchwork.ipfire.org/project/ipfire/list/?series=3625
Comment 11 Adolf Belka 2023-05-20 11:29:53 UTC
Core Update Testing issued.

https://blog.ipfire.org/post/ipfire-2-27-core-update-175-is-available-for-testing
Comment 12 Adolf Belka 2023-05-20 11:31:12 UTC
Tested borg mount with Core Update 175 Testing.

Confirmed that borg mount is now working again.

Standard borg list confirmed to also still be working.
Comment 13 Jon 2023-05-22 19:31:51 UTC
All seems good to me.  I tested:

```
[root@ipfireAPU tmp] # /usr/bin/borg list --verbose /mnt/hdd1/borgbackup
Warning: Attempting to access a previously unknown unencrypted repository!
Do you want to continue? [yN] y
2023-02-06__22.06.33                 Mon, 2023-02-06 22:06:33 [16a7f455fd17fc02e8cca6c54d14384d003921faffe5a99d28e7d77c98444699]
2023-02-06__22.06.50                 Mon, 2023-02-06 22:06:50 [8798d26568e1c5d4b3cd9a0a7280ea67a1bffb9ecad60fee278e68a3aef60438]
2023-02-06__22.22.40                 Mon, 2023-02-06 22:22:40 [b59d9a7044400b2356188197839ce2e7d2432ed49295fed93829aab8f6060668]
2023-02-17__14.59.17                 Fri, 2023-02-17 14:59:17 [f1b5040bcf2a7cce3e27118fa0b8ce3198130f8cf5d51dea267278c9308ab12b]
```
and 

```
[root@ipfireAPU tmp] # /usr/bin/borg mount --verbose /mnt/hdd1/borgbackup /tmp/borg
Mounting filesystem
[root@ipfireAPU tmp] # ls -al /tmp/borg
total 4
drwxr-xr-x 1 root root    0 May 22 14:01 .
drwxrwxrwt 3 root root 4096 May 22 14:01 ..
drwxr-xr-x 1 root root    0 Feb  6 22:06 2023-02-06__22.06.33
drwxr-xr-x 1 root root    0 Feb  6 22:06 2023-02-06__22.06.50
drwxr-xr-x 1 root root    0 Feb  6 22:22 2023-02-06__22.22.40
drwxr-xr-x 1 root root    0 Feb 17 14:59 2023-02-17__14.59.17
[root@ipfireAPU tmp] # 
```

Tested on:
APU4D4
IPFire 2.27 (x86_64) - Core-Update 175 Development Build: master/c6c78f8e
Comment 14 Adolf Belka 2023-06-12 18:38:37 UTC
CU175 released.

https://blog.ipfire.org/post/ipfire-2-27-core-update-175-released