Keyword search: 

Resource Management (for CPU, Memory, threading and bandwidth)

3/9/2012 2:16 AM
You can subscribe to this wiki article using an RSS feed reader.
Resource Manager aims to limit the number of CPU/memory intensive tasks running concurrently thereby stabilizing the system and preventing it from reaching a situation in which the utilization of resources could potentially bring the system to a halt. This functionality will relieve the stress on the system.

Overview:
The parameters can be set in the FRP s2s.properties file. The file is located in the /FileReplicationPro/etc directory.  By default, the value for each of the parameters is set to 20.  Please note the 2s.properties file does not include the parameters listed below. They should be added to the file (See sample at end of article) for resource management customization for your environment.  It is our recommendation to first test FRP with the default settings prior to changing the default settings.


The parameters that can be set are as follows:


s2s.max_concurrent_jobs: Defines the number of jobs allowed to run concurrently. Our recommended starting point when testing new parameters in limited environments is 5.

s2s.max_concurrent_compressions:   Sets the number of simultaneous compression/decompression threads.

s2s.max_concurrent_transfers: Defines the number of concurrent files that will be replicated. This parameter does not limit the number of replications within a specific job.  It does limit the number of concurrent replications occurring at one time in different jobs.

s2s.max_concurrent_dsync:  Sets the max number of concurrent dsync computations (for byte level differential replication).

Sample Reource Manager Entry

Stop FRPrep on each server and use a text editor to add the following entry to the end of your s2s.properties file.  See the comments in the following for guidance.  Restart the FRPrep service after saving the changes you have added.

#--The three last resource management parameters are usually not enabled. 
#--Try this and if replication is too slow make small changes to the items and retest until a balance of performance and stability is found.
#-- The default setting for each of these which FRP ships with is 20. Changes using these entries over ride the defaults in FRP.
s2s.max_concurrent_jobs=5
s2s.max_concurrent_compressions=5
s2s.max_concurrent_transfers=5
s2s.max_concurrent_dsync=5


For more information on the dsync process, See details on The dsync function of FRP.
 
-Yitzi 7-2-2009

Tags:
Home: WIKI - Knowledge Base Index What's new: Recently changed articles