title: Ceph too many pgs per osd: all you need to know
body: <p>I am getting <em>both</em> of these errors at the same time. I can't decrease the pg count and I can't add more storage. </p>
  
  <p>This is a new cluster, and I got these warning when I uploaded about 40GB to it. I guess because radosgw created a bunch of pools.</p>
  
  <p>How can ceph have too many pgs per osd, yet have more object per pg than average with a too few pgs suggestion?</p>
  
  <pre><code>HEALTH_WARN too many PGs per OSD (352 &gt; max 300); 
  pool default.rgw.buckets.data has many more objects per pg than average (too few pgs?)
  
  osds: 4 (2 per site 500GB per osd)
  size: 2 (cross site replication)
  pg:  64
  pgp: 64
  pools: 11
  </code></pre>
  
  <p>Using rbd and radosgw, nothing fancy. </p>