● quobyte-nfs.

service - Quobyte NFS Proxy

Loaded: loaded (/usr/lib/systemd/system/quobyte-nfs.service; enabled; vendor
preset: disabled)
Active: active (running) since Tue 2019-03-19 21:32:15 +08; 36min ago
Main PID: 47405 (ganesha.nfsd)
CGroup: /system.slice/quobyte-nfs.service
└─47405 /opt/quobyte/bin/ganesha.nfsd -L /var/log/quobyte/nfs.log -f
/etc/quobyte/nfs.cfg -p /var/run/quobyte/nfs.run

Mar 19 21:58:15 node2.adds.com quobyte[47405]: Server 10.85.232.21:7861 did not

respond to requests or pings (last sign of life more than 91s ago), considering
dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Reseting connection to
10.85.232.21:7861 with 0 in-flight, 1 pending, call -1 on socket: NETWORK_ERROR
Server 10.85.232.21:7861 did not respond to requests or pings (last sign of life
more than 91s ago), considering dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Request 35001:1 (373) received error
from registry:@10.85.232.21:7861 retrying on different server with call_id=375:
error_type: NETWORK_ERROR posix_errno: POSIX_ERROR_NONE error_message: "Server
10.85.232.21:7861 did not respond to requests or pings (last sign of life more than
91s ago), considering dead."
Mar 19 21:58:30 node2.adds.com quobyte[47405]: Request 35001:1 (375) received error
from registry:@10.85.232.22:7861 retrying on different server with call_id=377:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:2) unknown lease for
database dirdb"
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Request 51001:1 (379) received error
from registry:@10.85.232.21:7861 Last error: error_type: RETRY error_message: "".
Giving up after 1 attempts.
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Could not upload metrics:
error_type: RETRY error_message: ""
Mar 19 21:58:45 node2.adds.com quobyte[47405]: Request 35001:1 (377) received error
from registry:@10.85.232.23:7861 retrying on different server with call_id=380:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:3) unknown lease for
database dirdb"
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Request 35001:1 (380) to
registry:@10.85.232.21:7861 finished successfully after 1m 32s 38ms 63us 501ns and
3 attempts. Initial call id: 366; Last error: error_type: RETRY_OTHER_IMMEDIATELY
error_message: "(d:3) unknown lease for database dirdb"

● quobyte-nfs.service - Quobyte NFS Proxy

Loaded: loaded (/usr/lib/systemd/system/quobyte-nfs.service; enabled; vendor
preset: disabled)
Active: active (running) since Tue 2019-03-19 21:32:15 +08; 36min ago
Main PID: 47405 (ganesha.nfsd)
CGroup: /system.slice/quobyte-nfs.service
└─47405 /opt/quobyte/bin/ganesha.nfsd -L /var/log/quobyte/nfs.log -f
/etc/quobyte/nfs.cfg -p /var/run/quobyte/nfs.run

Mar 19 21:58:15 node2.adds.com quobyte[47405]: Server 10.85.232.21:7861 did not

respond to requests or pings (last sign of life more than 91s ago), considering
dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Reseting connection to
10.85.232.21:7861 with 0 in-flight, 1 pending, call -1 on socket: NETWORK_ERROR
Server 10.85.232.21:7861 did not respond to requests or pings (last sign of life
more than 91s ago), considering dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Request 35001:1 (373) received error
from registry:@10.85.232.21:7861 retrying on different server with call_id=375:
error_type: NETWORK_ERROR posix_errno: POSIX_ERROR_NONE error_message: "Server
10.85.232.21:7861 did not respond to requests or pings (last sign of life more than
91s ago), considering dead."
Mar 19 21:58:30 node2.adds.com quobyte[47405]: Request 35001:1 (375) received error
from registry:@10.85.232.22:7861 retrying on different server with call_id=377:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:2) unknown lease for
database dirdb"
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Request 51001:1 (379) received error
from registry:@10.85.232.21:7861 Last error: error_type: RETRY error_message: "".
Giving up after 1 attempts.
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Could not upload metrics:
error_type: RETRY error_message: ""
Mar 19 21:58:45 node2.adds.com quobyte[47405]: Request 35001:1 (377) received error
from registry:@10.85.232.23:7861 retrying on different server with call_id=380:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:3) unknown lease for
database dirdb"
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Request 35001:1 (380) to
registry:@10.85.232.21:7861 finished successfully after 1m 32s 38ms 63us 501ns and
3 attempts. Initial call id: 366; Last error: error_type: RETRY_OTHER_IMMEDIATELY
error_message: "(d:3) unknown lease for database dirdb"

● quobyte-nfs.service - Quobyte NFS Proxy

Loaded: loaded (/usr/lib/systemd/system/quobyte-nfs.service; enabled; vendor
preset: disabled)
Active: active (running) since Tue 2019-03-19 21:32:15 +08; 36min ago
Main PID: 47405 (ganesha.nfsd)
CGroup: /system.slice/quobyte-nfs.service
└─47405 /opt/quobyte/bin/ganesha.nfsd -L /var/log/quobyte/nfs.log -f
/etc/quobyte/nfs.cfg -p /var/run/quobyte/nfs.run

Mar 19 21:58:15 node2.adds.com quobyte[47405]: Server 10.85.232.21:7861 did not

respond to requests or pings (last sign of life more than 91s ago), considering
dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Reseting connection to
10.85.232.21:7861 with 0 in-flight, 1 pending, call -1 on socket: NETWORK_ERROR
Server 10.85.232.21:7861 did not respond to requests or pings (last sign of life
more than 91s ago), considering dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Request 35001:1 (373) received error
from registry:@10.85.232.21:7861 retrying on different server with call_id=375:
error_type: NETWORK_ERROR posix_errno: POSIX_ERROR_NONE error_message: "Server
10.85.232.21:7861 did not respond to requests or pings (last sign of life more than
91s ago), considering dead."
Mar 19 21:58:30 node2.adds.com quobyte[47405]: Request 35001:1 (375) received error
from registry:@10.85.232.22:7861 retrying on different server with call_id=377:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:2) unknown lease for
database dirdb"
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Request 51001:1 (379) received error
from registry:@10.85.232.21:7861 Last error: error_type: RETRY error_message: "".
Giving up after 1 attempts.
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Could not upload metrics:
error_type: RETRY error_message: ""
Mar 19 21:58:45 node2.adds.com quobyte[47405]: Request 35001:1 (377) received error
from registry:@10.85.232.23:7861 retrying on different server with call_id=380:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:3) unknown lease for
database dirdb"
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Request 35001:1 (380) to
registry:@10.85.232.21:7861 finished successfully after 1m 32s 38ms 63us 501ns and
3 attempts. Initial call id: 366; Last error: error_type: RETRY_OTHER_IMMEDIATELY
error_message: "(d:3) unknown lease for database dirdb"

● quobyte-nfs.service - Quobyte NFS Proxy

Loaded: loaded (/usr/lib/systemd/system/quobyte-nfs.service; enabled; vendor
preset: disabled)
Active: active (running) since Tue 2019-03-19 21:32:15 +08; 36min ago
Main PID: 47405 (ganesha.nfsd)
CGroup: /system.slice/quobyte-nfs.service
└─47405 /opt/quobyte/bin/ganesha.nfsd -L /var/log/quobyte/nfs.log -f
/etc/quobyte/nfs.cfg -p /var/run/quobyte/nfs.run

Mar 19 21:58:15 node2.adds.com quobyte[47405]: Server 10.85.232.21:7861 did not

respond to requests or pings (last sign of life more than 91s ago), considering
dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Reseting connection to
10.85.232.21:7861 with 0 in-flight, 1 pending, call -1 on socket: NETWORK_ERROR
Server 10.85.232.21:7861 did not respond to requests or pings (last sign of life
more than 91s ago), considering dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Request 35001:1 (373) received error
from registry:@10.85.232.21:7861 retrying on different server with call_id=375:
error_type: NETWORK_ERROR posix_errno: POSIX_ERROR_NONE error_message: "Server
10.85.232.21:7861 did not respond to requests or pings (last sign of life more than
91s ago), considering dead."
Mar 19 21:58:30 node2.adds.com quobyte[47405]: Request 35001:1 (375) received error
from registry:@10.85.232.22:7861 retrying on different server with call_id=377:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:2) unknown lease for
database dirdb"
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Request 51001:1 (379) received error
from registry:@10.85.232.21:7861 Last error: error_type: RETRY error_message: "".
Giving up after 1 attempts.
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Could not upload metrics:
error_type: RETRY error_message: ""
Mar 19 21:58:45 node2.adds.com quobyte[47405]: Request 35001:1 (377) received error
from registry:@10.85.232.23:7861 retrying on different server with call_id=380:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:3) unknown lease for
database dirdb"
● quobyte-nfs.service - Quobyte NFS Proxy
Loaded: loaded (/usr/lib/systemd/system/quobyte-nfs.service; enabled; vendor
preset: disabled)
Active: active (running) since Tue 2019-03-19 21:32:15 +08; 36min ago
Main PID: 47405 (ganesha.nfsd)
CGroup: /system.slice/quobyte-nfs.service
└─47405 /opt/quobyte/bin/ganesha.nfsd -L /var/log/quobyte/nfs.log -f
/etc/quobyte/nfs.cfg -p /var/run/quobyte/nfs.run

Mar 19 21:58:15 node2.adds.com quobyte[47405]: Server 10.85.232.21:7861 did not

respond to requests or pings (last sign of life more than 91s ago), considering
dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Reseting connection to
10.85.232.21:7861 with 0 in-flight, 1 pending, call -1 on socket: NETWORK_ERROR
Server 10.85.232.21:7861 did not respond to requests or pings (last sign of life
more than 91s ago), considering dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Request 35001:1 (373) received error
from registry:@10.85.232.21:7861 retrying on different server with call_id=375:
error_type: NETWORK_ERROR posix_errno: POSIX_ERROR_NONE error_message: "Server
10.85.232.21:7861 did not respond to requests or pings (last sign of life more than
91s ago), considering dead."
Mar 19 21:58:30 node2.adds.com quobyte[47405]: Request 35001:1 (375) received error
from registry:@10.85.232.22:7861 retrying on different server with call_id=377:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:2) unknown lease for
database dirdb"
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Request 51001:1 (379) received error
from registry:@10.85.232.21:7861 Last error: error_type: RETRY error_message: "".
Giving up after 1 attempts.
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Could not upload metrics:
error_type: RETRY error_message: ""
Mar 19 21:58:45 node2.adds.com quobyte[47405]: Request 35001:1 (377) received error
from registry:@10.85.232.23:7861 retrying on different server with call_id=380:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:3) unknown lease for
database dirdb"
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Request 35001:1 (380) to
registry:@10.85.232.21:7861 finished successfully after 1m 32s 38ms 63us 501ns and
3 attempts. Initial call id: 366; Last error: error_type: RETRY_OTHER_IMMEDIATELY
error_message: "(d:3) unknown lease for database dirdb"

● quobyte-nfs.service - Quobyte NFS Proxy

Loaded: loaded (/usr/lib/systemd/system/quobyte-nfs.service; enabled; vendor
preset: disabled)
Active: active (running) since Tue 2019-03-19 21:32:15 +08; 36min ago
Main PID: 47405 (ganesha.nfsd)
CGroup: /system.slice/quobyte-nfs.service
└─47405 /opt/quobyte/bin/ganesha.nfsd -L /var/log/quobyte/nfs.log -f
/etc/quobyte/nfs.cfg -p /var/run/quobyte/nfs.run

Mar 19 21:58:15 node2.adds.com quobyte[47405]: Server 10.85.232.21:7861 did not

respond to requests or pings (last sign of life more than 91s ago), considering
dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Reseting connection to
10.85.232.21:7861 with 0 in-flight, 1 pending, call -1 on socket: NETWORK_ERROR
Server 10.85.232.21:7861 did not respond to requests or pings (last sign of life
more than 91s ago), considering dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Request 35001:1 (373) received error
from registry:@10.85.232.21:7861 retrying on different server with call_id=375:
error_type: NETWORK_ERROR posix_errno: POSIX_ERROR_NONE error_message: "Server
10.85.232.21:7861 did not respond to requests or pings (last sign of life more than
91s ago), considering dead."
Mar 19 21:58:30 node2.adds.com quobyte[47405]: Request 35001:1 (375) received error
from registry:@10.85.232.22:7861 retrying on different server with call_id=377:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:2) unknown lease for
database dirdb"
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Request 51001:1 (379) received error
from registry:@10.85.232.21:7861 Last error: error_type: RETRY error_message: "".
Giving up after 1 attempts.
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Could not upload metrics:
error_type: RETRY error_message: ""
Mar 19 21:58:45 node2.adds.com quobyte[47405]: Request 35001:1 (377) received error
from registry:@10.85.232.23:7861 retrying on different server with call_id=380:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:3) unknown lease for
database dirdb"
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Request 35001:1 (380) to
registry:@10.85.232.21:7861 finished successfully after 1m 32s 38ms 63us 501ns and
3 attempts. Initial call id: 366; Last error: error_type: RETRY_OTHER_IMMEDIATELY
error_message: "(d:3) unknown lease for database dirdb"

● quobyte-nfs.service - Quobyte NFS Proxy

Loaded: loaded (/usr/lib/systemd/system/quobyte-nfs.service; enabled; vendor
preset: disabled)
Active: active (running) since Tue 2019-03-19 21:32:15 +08; 36min ago
Main PID: 47405 (ganesha.nfsd)
CGroup: /system.slice/quobyte-nfs.service
└─47405 /opt/quobyte/bin/ganesha.nfsd -L /var/log/quobyte/nfs.log -f
/etc/quobyte/nfs.cfg -p /var/run/quobyte/nfs.run

Mar 19 21:58:15 node2.adds.com quobyte[47405]: Server 10.85.232.21:7861 did not

respond to requests or pings (last sign of life more than 91s ago), considering
dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Reseting connection to
10.85.232.21:7861 with 0 in-flight, 1 pending, call -1 on socket: NETWORK_ERROR
Server 10.85.232.21:7861 did not respond to requests or pings (last sign of life
more than 91s ago), considering dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Request 35001:1 (373) received error
from registry:@10.85.232.21:7861 retrying on different server with call_id=375:
error_type: NETWORK_ERROR posix_errno: POSIX_ERROR_NONE error_message: "Server
10.85.232.21:7861 did not respond to requests or pings (last sign of life more than
91s ago), considering dead."
Mar 19 21:58:30 node2.adds.com quobyte[47405]: Request 35001:1 (375) received error
from registry:@10.85.232.22:7861 retrying on different server with call_id=377:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:2) unknown lease for
database dirdb"
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Request 51001:1 (379) received error
from registry:@10.85.232.21:7861 Last error: error_type: RETRY error_message: "".
Giving up after 1 attempts.
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Could not upload metrics:
error_type: RETRY error_message: ""
Mar 19 21:58:45 node2.adds.com quobyte[47405]: Request 35001:1 (377) received error
from registry:@10.85.232.23:7861 retrying on different server with call_id=380:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:3) unknown lease for
database dirdb"
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Request 35001:1 (380) to
registry:@10.85.232.21:7861 finished successfully after 1m 32s 38ms 63us 501ns and
3 attempts. Initial call id: 366; Last error: error_type: RETRY_OTHER_IMMEDIATELY
error_message: "(d:3) unknown lease for database dirdb"

● quobyte-nfs.service - Quobyte NFS Proxy

Loaded: loaded (/usr/lib/systemd/system/quobyte-nfs.service; enabled; vendor
preset: disabled)
Active: active (running) since Tue 2019-03-19 21:32:15 +08; 36min ago
Main PID: 47405 (ganesha.nfsd)
CGroup: /system.slice/quobyte-nfs.service
└─47405 /opt/quobyte/bin/ganesha.nfsd -L /var/log/quobyte/nfs.log -f
/etc/quobyte/nfs.cfg -p /var/run/quobyte/nfs.run

Mar 19 21:58:15 node2.adds.com quobyte[47405]: Server 10.85.232.21:7861 did not

respond to requests or pings (last sign of life more than 91s ago), considering
dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Reseting connection to
10.85.232.21:7861 with 0 in-flight, 1 pending, call -1 on socket: NETWORK_ERROR
Server 10.85.232.21:7861 did not respond to requests or pings (last sign of life
more than 91s ago), considering dead.
Mar 19 21:58:15 node2.adds.com quobyte[47405]: Request 35001:1 (373) received error
from registry:@10.85.232.21:7861 retrying on different server with call_id=375:
error_type: NETWORK_ERROR posix_errno: POSIX_ERROR_NONE error_message: "Server
10.85.232.21:7861 did not respond to requests or pings (last sign of life more than
91s ago), considering dead."
Mar 19 21:58:30 node2.adds.com quobyte[47405]: Request 35001:1 (375) received error
from registry:@10.85.232.22:7861 retrying on different server with call_id=377:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:2) unknown lease for
database dirdb"
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Request 51001:1 (379) received error
from registry:@10.85.232.21:7861 Last error: error_type: RETRY error_message: "".
Giving up after 1 attempts.
Mar 19 21:58:37 node2.adds.com quobyte[47405]: Could not upload metrics:
error_type: RETRY error_message: ""
Mar 19 21:58:45 node2.adds.com quobyte[47405]: Request 35001:1 (377) received error
from registry:@10.85.232.23:7861 retrying on different server with call_id=380:
error_type: RETRY_OTHER_IMMEDIATELY error_message: "(d:3) unknown lease for
database dirdb"
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Request 35001:1 (380) to
registry:@10.85.232.21:7861 finished successfully after 1m 32s 38ms 63us 501ns and
3 attempts. Initial call id: 366; Last error: error_type: RETRY_OTHER_IMMEDIATELY
error_message: "(d:3) unknown lease for database dirdb"
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Resolving 'registry:' with default
10.85.232.21:7861,10.85.232.22:7861,10.85.232.23:7861
Mar 19 21:59:00 node2.adds.com quobyte[47405]: Request 35001:1 (380) to
registry:@10.85.232.21:7861 finished successfully after 1m 32s 38ms 63us 501ns and
3 attempts. Initial call id: 366; Last error: error_type: RETRY_OTHER_IMMEDIATELY
error_message: "(d:3) unknown lease for database dirdb"