File Level Restore Issue



  • It should be the right XOA yes.



  • So, as the log indicated, there is no systemd-run in /bin. Appears to actually reside in /usr/bin on my copy of XOA.

    Thoughts?



  • Never saw this message before, I don't understand. I suppose you have rebooted your XOA?



  • @Danp said:

    So, as the log indicated, there is no systemd-run in /bin. Appears to actually reside in /usr/bin on my copy of XOA.

    Thoughts?

    It is not on my compiled version, either.



  • @BRRABill said:

    @Danp said:

    So, as the log indicated, there is no systemd-run in /bin. Appears to actually reside in /usr/bin on my copy of XOA.

    Thoughts?

    It is not on my compiled version, either.

    Not that that maters, just adding info. 🙂



  • Thanks for the feedback guys!

    We are investigating, it's strange that it works for others 😕



  • @olivierlambert said:

    Thanks for the feedback guys!

    We are investigating, it's strange that it works for others 😕

    What's strange is that it didn't work for me until I ran a backup on the upgraded 16.10 system.

    But I was getting a different error than @Danp

    @Danp ... have you tried taking a new, fresh backup with the XOA and seeing if that worked?



  • @olivierlambert said:

    Never saw this message before, I don't understand. I suppose you have rebooted your XOA?

    It was stopped until yesterday. I booted it and then updated to the latest version. Don't believe that I have restarted since. I can try that now.



  • @BRRABill Just did. No change in behavior. 😞



  • @Danp @olivierlambert

    It's not back to not working for me.

    It works on my Windows VM but not the Linux one.

      at Promise.all.then.arr (/opt/xo-server/node_modules/execa/index.js:201:11)
        at tryCatcher (/opt/xo-server/node_modules/bluebird/js/release/util.js:16:23)
        at Promise._settlePromiseFromHandler (/opt/xo-server/node_modules/bluebird/js/release/promise.js:510:31)
        at Promise._settlePromise (/opt/xo-server/node_modules/bluebird/js/release/promise.js:567:18)
        at Promise._settlePromise0 (/opt/xo-server/node_modules/bluebird/js/release/promise.js:612:10)
        at Promise._settlePromises (/opt/xo-server/node_modules/bluebird/js/release/promise.js:691:18)
        at Promise._fulfill (/opt/xo-server/node_modules/bluebird/js/release/promise.js:636:18)
        at PromiseArray._resolve (/opt/xo-server/node_modules/bluebird/js/release/promise_array.js:125:19)
        at PromiseArray._promiseFulfilled (/opt/xo-server/node_modules/bluebird/js/release/promise_array.js:143:14)
        at Promise._settlePromise (/opt/xo-server/node_modules/bluebird/js/release/promise.js:572:26)
        at Promise._settlePromise0 (/opt/xo-server/node_modules/bluebird/js/release/promise.js:612:10)
        at Promise._settlePromises (/opt/xo-server/node_modules/bluebird/js/release/promise.js:691:18)
        at Async._drainQueue (/opt/xo-server/node_modules/bluebird/js/release/async.js:133:16)
        at Async._drainQueues (/opt/xo-server/node_modules/bluebird/js/release/async.js:143:10)
        at Immediate.Async.drainQueues (/opt/xo-server/node_modules/bluebird/js/release/async.js:17:14)",
      "code": 5,
      "killed": false,
      "stdout": "",
      "stderr": "File descriptor 11 (/var/lib/xo-server/data/leveldb/LOG) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 12 (/var/lib/xo-server/data/leveldb/LOCK) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 13 (/var/lib/xo-server/data/leveldb/000086.log) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 15 (/var/lib/xo-server/data/leveldb/MANIFEST-000084) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
      Volume group \"graylog-vg\" not found
      Cannot process volume group graylog-vg
    


  • It works on my Windows VMs, but not all of my Linux VMs. Thinking it may be LVM related, but not positive.



  • Out of curiosity, I deleted all my backups and started totally fresh. (Still toying with XO backups before using them in production.)

    Same issue.



  • You may want to capture the complete error and post it here. Look under Settings > Logs, and then click the eyeball to get a popup with all of the error text.



  • @Danp said:

    You may want to capture the complete error and post it here. Look under Settings > Logs, and then click the eyeball to get a popup with all of the error text.

    backup.scanFiles
    {
      "remote": "2499afb2-109f-44d8-9258-b78eaf99830d",
      "disk": "vm_delta_GrayLog Delta_ada68a59-d4c3-dccd-6188-5afc88c2a9d3/vdi_22092ee0-f3c2-4a4e-9588-1600afaebc43/20170202T212525Z_full.vhd",
      "path": "/",
      "partition": "000ad9d8-05/graylog-vg/root"
    }
    {
      "message": "Command failed: vgchange -ay graylog-vg
    File descriptor 11 (/var/lib/xo-server/data/leveldb/LOG) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 12 (/var/lib/xo-server/data/leveldb/LOCK) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 13 (/var/lib/xo-server/data/leveldb/000086.log) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 15 (/var/lib/xo-server/data/leveldb/MANIFEST-000084) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
      Volume group \"graylog-vg\" not found
      Cannot process volume group graylog-vg
    ",
      "stack": "Error: Command failed: vgchange -ay graylog-vg
    File descriptor 11 (/var/lib/xo-server/data/leveldb/LOG) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 12 (/var/lib/xo-server/data/leveldb/LOCK) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 13 (/var/lib/xo-server/data/leveldb/000086.log) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 15 (/var/lib/xo-server/data/leveldb/MANIFEST-000084) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
      Volume group \"graylog-vg\" not found
      Cannot process volume group graylog-vg
    
        at Promise.all.then.arr (/opt/xo-server/node_modules/execa/index.js:201:11)
        at tryCatcher (/opt/xo-server/node_modules/bluebird/js/release/util.js:16:23)
        at Promise._settlePromiseFromHandler (/opt/xo-server/node_modules/bluebird/js/release/promise.js:510:31)
        at Promise._settlePromise (/opt/xo-server/node_modules/bluebird/js/release/promise.js:567:18)
        at Promise._settlePromise0 (/opt/xo-server/node_modules/bluebird/js/release/promise.js:612:10)
        at Promise._settlePromises (/opt/xo-server/node_modules/bluebird/js/release/promise.js:691:18)
        at Promise._fulfill (/opt/xo-server/node_modules/bluebird/js/release/promise.js:636:18)
        at PromiseArray._resolve (/opt/xo-server/node_modules/bluebird/js/release/promise_array.js:125:19)
        at PromiseArray._promiseFulfilled (/opt/xo-server/node_modules/bluebird/js/release/promise_array.js:143:14)
        at Promise._settlePromise (/opt/xo-server/node_modules/bluebird/js/release/promise.js:572:26)
        at Promise._settlePromise0 (/opt/xo-server/node_modules/bluebird/js/release/promise.js:612:10)
        at Promise._settlePromises (/opt/xo-server/node_modules/bluebird/js/release/promise.js:691:18)
        at Async._drainQueue (/opt/xo-server/node_modules/bluebird/js/release/async.js:133:16)
        at Async._drainQueues (/opt/xo-server/node_modules/bluebird/js/release/async.js:143:10)
        at Immediate.Async.drainQueues (/opt/xo-server/node_modules/bluebird/js/release/async.js:17:14)",
      "code": 5,
      "killed": false,
      "stdout": "",
      "stderr": "File descriptor 11 (/var/lib/xo-server/data/leveldb/LOG) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 12 (/var/lib/xo-server/data/leveldb/LOCK) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 13 (/var/lib/xo-server/data/leveldb/000086.log) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
    File descriptor 15 (/var/lib/xo-server/data/leveldb/MANIFEST-000084) leaked on vgchange invocation. Parent PID 862: /usr/local/bin/node
      Volume group \"graylog-vg\" not found
      Cannot process volume group graylog-vg
    ",
      "failed": true,
      "signal": null,
      "cmd": "vgchange -ay graylog-vg",
      "timedOut": false
    }
    


  • @olivierlambert Replying here rather than the other recent thread because I'm not sure if this is the same issue.

    fdisk -l

    Disk /dev/xvda: 16.1 GB, 16106127360 bytes, 31457280 sectors
    Units = sectors of 1 * 512 = 512 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    Disk label type: dos
    Disk identifier: 0x000c9cc3
    
        Device Boot      Start         End      Blocks   Id  System
    /dev/xvda1   *        2048     1026047      512000   83  Linux
    /dev/xvda2         1026048    31457279    15215616   8e  Linux LVM
    
    Disk /dev/mapper/centos-root: 13.9 GB, 13925089280 bytes, 27197440 sectors
    Units = sectors of 1 * 512 = 512 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    
    
    Disk /dev/mapper/centos-swap: 1610 MB, 1610612736 bytes, 3145728 sectors
    Units = sectors of 1 * 512 = 512 bytes
    Sector size (logical/physical): 512 bytes / 512 bytes
    I/O size (minimum/optimal): 512 bytes / 512 bytes
    

    vgs

      VG     #PV #LV #SN Attr   VSize  VFree
      centos   1   2   0 wz--n- 14.51g 40.00m
    

    lvs

      LV   VG     Attr       LSize  Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
      root centos -wi-ao---- 12.97g
      swap centos -wi-ao----  1.50g
    

    Testing with the latest XOA from today, I'm getting the following errors in the log --

    May 12 11:14:49 xoa systemd[1]: Starting LVM2 PV scan on device 7:0...
    May 12 11:14:49 xoa systemd[1]: Started LVM2 PV scan on device 7:0.
    May 12 11:14:49 xoa systemd-udevd[12771]: failed to execute '/bin/systemd-run' '/bin/systemd-run /sbin/lvm pvscan --cache 7:0': No such file or directory
    May 12 11:14:49 xoa systemd[1]: Stopping LVM2 PV scan on device 7:0...
    May 12 11:14:49 xoa systemd[1]: Stopped LVM2 PV scan on device 7:0.
    May 12 11:14:49 xoa xo-server[12152]: [Warn] Possibly unhandled rejection: Error: Command failed: pvs --noheading --nosuffix --nameprefixes --unbuffered --units b -o vg_name /dev/loop0
    May 12 11:14:49 xoa xo-server[12152]: File descriptor 13 (/var/lib/xo-server/data/leveldb/LOG) leaked on pvs invocation. Parent PID 12152: node
    May 12 11:14:49 xoa xo-server[12152]: File descriptor 14 (/var/lib/xo-server/data/leveldb/LOCK) leaked on pvs invocation. Parent PID 12152: node
    May 12 11:14:49 xoa xo-server[12152]: File descriptor 16 (/var/lib/xo-server/data/leveldb/000059.log) leaked on pvs invocation. Parent PID 12152: node
    May 12 11:14:49 xoa xo-server[12152]: File descriptor 17 (/var/lib/xo-server/data/leveldb/MANIFEST-000057) leaked on pvs invocation. Parent PID 12152: node
    May 12 11:14:49 xoa xo-server[12152]: Failed to find device "/dev/loop0"
    May 12 11:14:49 xoa xo-server[12152]: at Promise.all.then.arr (/usr/local/lib/node_modules/xo-server/node_modules/execa/index.js:210:11)
    May 12 11:14:49 xoa xo-server[12152]: at tryCatcher (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/util.js:16:23)
    May 12 11:14:49 xoa xo-server[12152]: at Promise._settlePromiseFromHandler (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/promise.js:512:31)
    May 12 11:14:49 xoa xo-server[12152]: at Promise._settlePromise (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/promise.js:569:18)
    May 12 11:14:49 xoa xo-server[12152]: at Promise._settlePromise0 (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/promise.js:614:10)
    May 12 11:14:49 xoa xo-server[12152]: at Promise._settlePromises (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/promise.js:693:18)
    May 12 11:14:49 xoa xo-server[12152]: at Promise._fulfill (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/promise.js:638:18)
    May 12 11:14:49 xoa xo-server[12152]: at PromiseArray._resolve (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/promise_array.js:126:19)
    May 12 11:14:49 xoa xo-server[12152]: at PromiseArray._promiseFulfilled (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/promise_array.js:144:14)
    May 12 11:14:49 xoa xo-server[12152]: at Promise._settlePromise (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/promise.js:574:26)
    May 12 11:14:49 xoa xo-server[12152]: at Promise._settlePromise0 (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/promise.js:614:10)
    May 12 11:14:49 xoa xo-server[12152]: at Promise._settlePromises (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/promise.js:693:18)
    May 12 11:14:49 xoa xo-server[12152]: at Async._drainQueue (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/async.js:133:16)
    May 12 11:14:49 xoa xo-server[12152]: at Async._drainQueues (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/async.js:143:10)
    May 12 11:14:49 xoa xo-server[12152]: at Immediate.Async.drainQueues (/usr/local/lib/node_modules/xo-server/node_modules/bluebird/js/release/async.js:17:14)
    `


  • In an uptodate XOA, after a brand new free installed of CentOS 7 with default partitioning (so using LVM), I backup it, then trying file level restore. And it works.

    I can't reproduce your issue, IDK why… 😕



  • @olivierlambert Thanks for checking. I'll do some additional testing on this end.



  • So I was apparently on an older build (16.12.20) of XOA.



  • We didn't changed a lot in the latest XOA build, at least nothing related to filelevel restore.

    edit: basically, we bundled this: https://xen-orchestra.com/blog/xoa-improvements/


Log in to reply