mmgaggle

Red Hat Ceph Storage 3.x

Performance and Sizing Guides

• Micron® 9300 MAX NVMe™ SSDs + Red Hat® Ceph® Storage for 2nd Gen AMD EPYC™ Processors
• Micron® 7300 MAX NVMe™ SSDs + Red Hat® Ceph® Storage for 2nd Gen AMD EPYC™ Processors
• Dell EMC Ready Architecture for Red Hat Ceph Storage 3.2 Cost Optimized Block Storage Architecture Guide
• Red Hat Ceph Storage on Dell EMC servers Object storage performance and sizing guide
• [Dell EMC Ready Architecture for Red Hat Ceph Storage 3.2 Performance Optimized Block Storage Architecture Guide](https://www.delle

wido

#!/bin/bash
# For each running OSD query the BlueStore DB size and entries and calculate avg size per entry
#
# Author: Wido den Hollander <wido@widodh.nl>
#

for OSD_ID in $(find /var/run/ceph -name 'ceph-osd.*.asok' -type s -printf "%f\n"|cut -d '.' -f 2); do
    DB_USED_BYTES=$(ceph daemon osd.$OSD_ID perf dump|jq '.bluefs.db_used_bytes')
    BLUESTORE_ONODES=$(ceph daemon osd.$OSD_ID perf dump|jq '.bluestore.bluestore_onodes')
    echo "osd.$OSD_ID: db_used_bytes=$DB_USED_BYTES bluestore_onodes=$BLUESTORE_ONODES db_entry_size=$(($DB_USED_BYTES / BLUESTORE_ONODES))"

stevenringo

| Title | Description

robbat2

Ceph StaticSites Configuration, with HAProxy & SNI

An instructional document by Robin H Johnson robin.johnson@dreamhost.com. I wrote much of the staticsites functionality of Ceph-RGW, during during late 2015 and early 2016, based on an early prototype by Yehuda Sadeh (yehudasa). It was written for usage at Dreamhost, but developed in the open for community improvement.

It is fully functional as of Jewel v10.2.3 plus PR11280 (ceph/ceph#11280). Prior to that, neither the non-CNAME nor CNAME-to-service modes will function correctly.

These configuration files represent how to quickly set up RGW+HAProxy for staticsite serving. I've tried to make them more readable, without leaving out too many details. You are strongly recommended to run a seperate RGW instance for staticsites, on a DIFFERENT outward-faciing IP than your normal instance (and in fact, certain functionality is not supported without it).

In place of using HAProxy, you could run the second rgw instance on port 80,

cernceph

frontend cs3.cern.ch-frontend-ssl
  bind ipv4@:443,ipv6@:443 ssl no-sslv3 crt /etc/haproxy/cert.pem verify none
  acl ha_stats url_beg /stats
  acl pathstyle_buckets hdr(host) -i cs3.cern.ch
  capture request header User-Agent len 256
  capture request header Host len 128
  http-request set-var(req.bucketname) path,word(1,/) if pathstyle_buckets
  http-request set-var(req.bucketname) hdr(host),regsub(.cs3.cern.ch,) if ! pathstyle_buckets
  http-request set-header X-Debug-Bucket %[var(req.bucketname)]
  timeout http-request 5m

rafaeltuelho

My Openshift Cheatsheet

Project Quotes, Limits and Templates

• Cluster Quota

oc create clusterquota env-qa \
    --project-label-selector environment=qa \
    --hard pods=10,services=5
    
oc create clusterquota user-qa \

wmealing

To limit a CPU to a certain C-state, you can pass the processor.max_cstate=X option in the kernel line of /boot/grub/grub.conf.

Here we limit the system to only C-State 1:

    kernel /vmlinuz-2.6.18-371.1.2.el5 ... processor.max_cstate=1

On some systems, the kernel can override the BIOS setting, and the parameter intel_idle.max_cstate=0 may be required to ensure sleep states are not entered:

ashrithr

Installing Graphite:

Graphite does two things:

1. Store numeric time-series data
2. Render graphs of this data on demand

What Graphite does not do is collect data for you, however there are some tools out there that know

tnolet

#!/bin/bash
# Perform installation as root
# Install prereqs

yum -y install libcurl libcurl-devel rrdtool rrdtool-devel rrdtool-prel libgcrypt-devel gcc make gcc-c++

# Get Collectd, untar it, make it and install

wget http://collectd.org/files/collectd-5.4.0.tar.gz
tar zxvf collectd-5.4.0.tar.gz

macintux

• https://ferd.ca/a-distributed-systems-reading-list.html
• http://the-paper-trail.org/blog/distributed-systems-theory-for-the-distributed-systems-engineer/
• https://github.com/palvaro/CMPS290S-Winter16/blob/master/readings.md
• http://muratbuffalo.blogspot.com/2015/12/my-distributed-systems-seminars-reading.html
• http://christophermeiklejohn.com/distributed/systems/2013/07/12/readings-in-distributed-systems.html
• http://michaelrbernste.in/2013/11/06/distributed-systems-archaeology-works-cited.html
• http://rxin.github.io/db-readings/
• http://research.microsoft.com/en-us/um/people/lamport/pubs/pubs.html
• http://pdos.csail.mit.edu/dsrg/papers/
• http://scalingsystems.com/2011/09/07/reading-list-for-distributed-systems/