Created
November 23, 2011 17:14
-
-
Save kirbysayshi/1389254 to your computer and use it in GitHub Desktop.
quick examples of how to change many many wsp (graphite/whisper) files settings
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
for f in $(find $1 -iname "*.wsp"); do | |
if [ -a $f ]; | |
then /opt/graphite/bin/whisper-set-aggregation-method.py $f max; | |
fi; | |
done |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
for f in $(find $1 -iname "*.wsp"); do | |
if [ -a $f ]; | |
then /opt/graphite/bin/whisper-resize.py $f 10s:12h 60s:7d 10m:3y; | |
fi; | |
done |
@gargnisha1605 : you have increased the number of data points to retain with this operation because of your higher sampling frequency.
60s:1d
is one day's (24h) worth of minutes (24h * 60m/h * 60s/m) / 60s = 1440
.
10s:6h
is six hours of decaseconds (6h * 60m/h * 60s/m) / 10s = 2160
The resize filled in the gaps your new policy created (probably with 0s).
@gargnisha1605 and anyone else doing this for storage space, you can check your retention size per metric here: https://m30m.github.io/whisper-calculator/
Don't forget that every counter has 2 metrics (count and rate), and every timer has about 10 or so.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi I used the following command to change the retention policies of my existing metrics:
find ./ -type f -name '*.wsp' -exec whisper-resize {} 10s:6h ;
Before changing the retention policies:
find ./ -type f -name 'count.wsp' -exec whisper-info {} ;
maxRetention: 86400
xFilesFactor: 0.5
aggregationMethod: average
fileSize: 17308
Archive 0
retention: 86400
secondsPerPoint: 60
points: 1440
size: 17280
offset: 28
After changing the retention policy from 60s:1d to 10s:6h, my file size has increased.
find ./ -type f -name 'count.wsp' -exec whisper-info {} ;
maxRetention: 21600
xFilesFactor: 0.5
aggregationMethod: average
fileSize: 25948
Archive 0
retention: 21600
secondsPerPoint: 10
points: 2160
size: 25920
offset: 28
I have changed the retention policy to clear some space from graphite server, but wsp file size has increased after whisper-resize. Can any body guide my how to clean whisper data.