Limits to Growth
October 14, 2009
I’ve talked about concerns about resource constraints and population control before on this blog but that’s been in the context of fuel and food resources for everyone on the whole planet. I’d like to talk about limits to growth with regard to fedora.
Today rawhide is showing 15,131 packages. The primary sqlite metadata is 41M uncompressed, 9.7MB compressed.
That’s a pretty serious number on both counts.
Each pkg is roughly 3K in primary, between primary and filelists the number comes out as about 8k per pkg.
Not a towering number but one we have to think about and keep in mind as we grow. Not only that number but also the disk space we use for cvs, lookaside cache, mirrors, koji, the processing time for building all those and the overhead of keeping track and riding herd over all the users/contributors who are maintaining all these pieces.
Now, we can add more infrastructure and have more layers to help deal with the growth but we’re way beyond a human-scale operation anymore. Any one person is not going to be able to keep track of everything going on by themselves. Even with tools the management level is too chaotic to create a structured view of it. To know where everything is.
So the question I have is this: at what point do we think about this and take action? Anyone who says ‘never’ gets a remedial lesson in entropy.
And the follow on question: If it were up to you, how would you do it?