19 Posts tagged with scaling
HSCALE - Horizontal Scaling for MySQL
Abstracts partitioning outside of the application layer into a MySQL Proxy module. Not production ready yet, but watch this space.
Yaws
Yaws is a HTTP high perfomance 1.1 webserver particularly well suited for dynamic-content web applications. Yaws is entirely written in Erlang.
sudo gem install starling
Starling is a light-weight persistent queue server that speaks the MemCache protocol. It was built to drive Twitter's backend, and is in production across Twitter's cluster.
Google Code for Educators - Google: Cluster Computing and MapReduce
Video lectures and related course materials from Google on Cluster Computing and MapReduce
skynet
Skynet is an open source Ruby implementation of Google’s Map/Reduce framework, created at Geni.com. With Skynet, one can easily convert a time-consuming serial task, such as a computationally expensive Rails migration, into a distributed program running
sparrow
Sparrow is a really fast lightweight queue written in Ruby that speaks memcached. That means you can use Sparrow with any memcached client library (Ruby or otherwise). Sparrow was inspired by Twitter's Starling.
Beanstalkd
beanstalkd is a fast, distributed, in-memory workqueue service. Its interface is generic, but is intended for use in reducing the latency of page views in high-volume web applications by running most time-consuming tasks asynchronously.
ONLamp.com -- Advanced MySQL Replication Techniques
Great example of circular replication using MySQL 5.x. For the next upgrade.
Jake@Nitobi » Blog Archive » RobotReplay and Rails on Amazon EC2
"Don’t forget actually deploying changes to your app. Capistrano is great, awesome, wicked, but needing to rewrite your deploy.rb as you add and remove servers on EC2 is teh sux." I know, I'm working on it :).
A bunch of presentations on scaling websites: twitter, Flickr, Bloglines, Vox and more.
If you haven't seen any of these, take some time and take a look at them all. Great info about building scalable web services.
Event Driven Mongrel and Swiftiply Proxy
"This is big news people. This thing makes shit faster and more stable under load."
Largest production memcached install?
Great thread with input from some of the heaviest memcached users out there
Vitamin Features » Serving JavaScript Fast
Nice article covering some very useful techniques for forcing web clients to cache javascript, css, and image assets.