SSHFS destination / Clear Cache?

cPanel, Industry leading hosting platform with world-class support.
Post Reply
zealotbug
Posts: 10
Joined: January 7th, 2016, 4:44 am

SSHFS destination / Clear Cache?

Post by zealotbug »

Hi,

1
I have a sshfs mount that allows a remote file system to act as local.
SSHFS doesn't support hardlinks, will the incremental backup system still work properly if a SSHFS mounted folder is used as the backup destination?

2
What is the purpose of the Index backup files (Clear Cache):?
isn't having indexing always the faster and better rather then clearing it all the time?
User avatar
idanbe
Staff Member
Staff Member
Posts: 30
Joined: October 22nd, 2015, 2:34 pm

Re: SSHFS destination / Clear Cache?

Post by idanbe »

Hello,

1. the backup will work properly, but it will create hard copy instead of hard link.
so in your case each snap will consume full size and not only the changes.

2. to index all the backups from all the destinations is taking time, so we added cache system that holds all the backups list, and clears on each day or each backup job that runs.
zealotbug
Posts: 10
Joined: January 7th, 2016, 4:44 am

Re: SSHFS destination / Clear Cache?

Post by zealotbug »

Hi ,

thank you for the reply.

1.
The latest version of sshfs supports hard link, i tested and it appears to work, however calculating space used by the backup
is taking too long on sshfs mount, there don't seem to be any option available to turn this off for "local storage" backup destination.

2.
When we generate a backup to be downloaded from a "remote ssh backup destination" ,the system appears to be generating
a local "backup" file for downloading. is there any way to skip this?

As we are concern that the server will be littered with us files from user actions to download backups,
is there an option to automatically remove such files?

Also where is the that was geneated for backup stored?

3.
There is an option that says "Keep Users Data" , if this is off, will it skip the local backup file generation?
what does keep users data actually do? what kind of user data is this referring to?



Rgds
User avatar
elialum
Staff Member
Staff Member
Posts: 95
Joined: October 25th, 2015, 1:44 pm

Re: SSHFS destination / Clear Cache?

Post by elialum »

Hi,
calculating space used by the backup is taking too long on sshfs mount, there don't seem to be any option available to turn this off for "local storage" backup destination.
As far as I know, JBM will not calculate backup space on backup destinations (remote or local), unless it was configured to do so under "Settings -> Performance settings -> Update Remote Incremental Backups Sizes"

When you list and account's full backups, do you actually see the backup sizes ?
(Backup Manager › List Accounts › {USERNAME} Backups › Full Backups)
When we generate a backup to be downloaded from a "remote ssh backup destination" ,the system appears to be generating
a local "backup" file for downloading. is there any way to skip this?

As we are concern that the server will be littered with us files from user actions to download backups,
is there an option to automatically remove such files?
The files chosen for download are zipped on the remote destination, then transferred to the user's homedir for download.
File should be cleared on the daily cron job, so they will not stay there for more then 24h.

Furthermore, to protect server resources, we've added these to the performance settings -

Performance settings -> Queue Active (default yes)
When activated jobs are processed "one by one", when disabled all jobs are processed at once.
So if 10 users will start a download, they will be processed only one-by-one, and not all together.

Performance settings -> Limit accounts Downloads
You can limit each cPanel account to X download per action. One user can generate only one download. If he will generate the second one (only after the first finished), it will first erase the first download, then will place the file of the second one.
Also where is the that was generated for backup stored?
/home/user/.jbm
There is an option that says "Keep Users Data" , if this is off, will it skip the local backup file generation?
what does keep users data actually do? what kind of user data is this referring to?
This has nothing to do with the downloads. The "user data" is actually, cpanel account related data - domains, statistics, logs etc
Since this information doesn't change often, it is preferred to save it locally, and only update changes.

Setting "Keep Users Data" to yes will speed up the backup process, but will cost you disk space (about 2-5GB for entire server with 100-200 accounts).

Hope this helps :)

Eli.
Post Reply