Jesse Newland

35 Posts tagged with amazon

Running MySQL on Amazon EC2 with Elastic Block Store

This tutorial describes one approach to using Amazon EC2's Elastic Block Store (EBS) as a persistent storage mechanism for a production MySQL database server, including snapshot backup and restore.

AWS Premium Support is teh awesome

AWS Premium Support is teh awesome

Amazon Web Services Premium Support

AWS Premium Support is a one-on-one, fast-response support channel to help you build and run applications on AWS Infrastructure Services.

AWS Service Health Dashboard

up-to-the-minute information on AWS service availability

Persistent Storage for Amazon EC2

Coming soon. All signs point towards this being powered by LVM. Awesome.

scalr

Scalr is a fully redundant, self-curing and self-scaling hosting environment utilizing Amazon's EC2.

Amazon EC2 Availability Zones

'Amazon EC2 now provides the ability to place instances in multiple locations. Amazon EC2 locations are composed of regions and availability zones.'

Amazon EC2 Elastic IP Addresses

'Elastic IP addresses are static IP addresses designed for dynamic cloud computing. An Elastic IP address is associated with your account, not a particular instance, and you control that address until you choose to explicitly release it'

backup_fu Makes Amazon S3 Backups Redonkulously easy

Announcing Thrudb EC2 Public AMIs

EC2 instances with Thrift, Thrudb, memcached, Spread and CLucene configured

DeHorrible: RESTifying SimpleDB

DeHorrible is a Rails proxy that RESTifies SimpleDB. Or if you insist, GETStifies your resources to use SimpleDB. Either way, it will keep your sensibilities intact.

Amazon SimpleDB

I got word that this was being worked on at an Amazon event several months ago. Good to see it released!

RubyWorks Production Stack on Amazon EC2

RubyWorks EC2 Capistrano Recipes

S3 Stat

S3 logging analyzer

Cache-Control Header for Amazon S3

Nice quick monkey patch to save some cash on your s3 bill when used with attachment_fu

Thumbnail

A Ruby wrapper for the Amazon Web Services Alexa Site Thumbnail Service REST API, which provides website thumbnail images on demand for a small fee ($0.20/1000).

Switching… » Backup using S3 from Amazon

If Time Machine fails, I'll use this, thanks.

Amazon Web Services Blog: Amazon EC2 Gets More Muscle

Now EC2 instances come in 3 sizes - 1.75 GB of RAM and 1 EC2 Compute Unit, 7.5 GB of RAM and 4 EC2 Compute Units, or 15 GB of RAM and 8 EC2 Compute Units. Prices are 10, 40, and 80 cents an hour, respectively.

Amazon Web Services Blog: Amazon S3 At Your Service

Amazon commits to 99.9% uptime for S3

Jake@Nitobi » Blog Archive » RobotReplay and Rails on Amazon EC2

"Don’t forget actually deploying changes to your app. Capistrano is great, awesome, wicked, but needing to rewrite your deploy.rb as you add and remove servers on EC2 is teh sux." I know, I'm working on it :).

Capazon 0.2 Released - Capistrano 2.0 Compatible

Capazon 0.2.0 is out. There’s only one new feature: support for Capistrano 2.0. There’s no backwards compatibility. If you’re still on Capistrano 1.4.x, please don’t upgrade. It won’t work.

To update Capazon:

  • gem install capazon

Changes

Capistrano 2.0 has support for Rake-like namespaces, so I’ve moved all tasks provided by Capazon to the ec2 namespace:

$ cap ec2:describe_images
  * executing `ec2:describe_images'
IMAGE   ami-0386636a    rbuilder-online/nuxleus-1.3-x86_9327.img.manifest.xml  099034111737     available       true
IMAGE   ami-0683666f    rbuilder-online/fedoracore6-1.0-x86_9677.img.manifest.xml       099034111737    available       true
[...]

To call these tasks from another namespace in a Capistrano recipe:

namespace :whatever do
  task :something_cool do
    [...]
    ec2.describe_images
    [...]
  end
end

Capistrano 2.0

Turns out updating extensions to work w/ Capistrano 2.0 is extremely easy. Just replace blocks like this:

Capistrano.configuration(:must_exist).load do
  task :take_over_the _world do
    [...]
  end
end

...with this:

Capistrano::Configuration.instance.load do do
  task :take_over_the _world do
    [...]
  end
end

For more on upgrading your recipes to Capistrano 2, head over to the upgrade guide on Capistrano’s new website or this post on NubyOnRails. Happy capifying!

Amazon Web Services: Start-Up Seattle Notes

Last Thursday’s Start-Up Seattle event put on by the Amazon Web Services Team and Medrona Venture Group was an enlightening look at the endless possibilities Amazons Web Services present to small companies. Even though I’m fairly familiar with the inner workings of Amazons Web Services – this blog is hosted on an EC2 instance, and I recently released Capazon, a Capistrano extension library to manage EC2 instances – this event shed new light on how much they mean to the internet.

Jeff Barr, Amazons Web Services Evangelist, revealed that in Amazon’s research, engineers at small web-based companies revealed that they spent only 30% of their time developing features unique to their product. The other 70% was spent doing “undifferentiated heavy lifting”: buying and configuring hardware, dealing with data centers, implementing load balancing solutions, and dealing with growth issues. With these issues being handled by Amazons Web Services, small companies are able to focus more of their time on their product’s unique features instead of repeating the work of others throughout the world.

This, in effect, shifts downward the cost of starting a new company, or cycling the improvement loop in an existing company. There’s no hardware to buy, no hard drives to swap, no data centers to visit – only time spent on the core product itself.

Andy Jassey, Amazons Web Services Senior Vice President, revealed something very interesting: Amazon is no longer offering these services with excess capacity at Amazon’s data centers, rather, they are actively purchasing new hardware dedicated to Amazons Web Services. “We’re going to scale Amazons Web Services as big as users demand”, he said in response to a question pertaining to the capacity Amazon has to offer.

I also had a great chat with Matt Garman, Amazon Web Services Product Manager, during the wine tasting after the event.

I emerged from this event with pages and pages of notes detailing how LexBlog could use Amazon Web Services for future product offerings, and even to replace a good bit of our current hardware. Events like these are few and far between, and I consider myself very lucky to have been able to attend.

muckOS

muckOS (muck-oh-ess) is a collection of tools being built to take advantage of Amazon EC2, S3 and SQS. The goal is to create and manage elastic, self-healing clusters for applications.

A MySQL Storage Engine for AWS S3

Not yet feature complete, but getting there. This is awesome.

The Start-up Project - Seattle

Amazon Web Services and Madrona Venture Group invite you to an exclusive half-day event exposing Amazon's best unkept secret: Amazon Web Services (AWS). I'll be there.

Capazon - Capistrano Meets Amazon EC2

UPDATE: For those looking for Capistrano 2.0 support, check out Capazon 0.2.0

Just a quick note to announce Capazon 0.1.0, a Capistrano extension library to manage Amazon EC2 instances. If you are familiar with Capistrano and have an Amazon EC2 account, give it a whirl:

  • gem install capazon
  • Edit your your config/deploy.rb:
require 'capazon'

#AWS login info
set :aws_access_key_id, 'XXX'
set :aws_secret_access_key, 'X'

# Name of the keypair used to spawn and connect to the Amazon EC2 Instance
# Defaults to one created by the setup_keypair task
set :aws_keypair_name, "#{application}-capazon"

# Path to the private key for the Amazon EC2 Instance mentioned above
# Detaults to one created by setup_keypair task
set :aws_private_key_path, "#{Dir.pwd}/#{aws_keypair_name}-key"

#defaults to an ubuntu image
#set :aws_ami_id, "ami-e4b6538d"

#defaults to, um, default
#set :aws_security_group, "default"
  • $ cap describe_images
  * executing task describe_images
IMAGE   ami-0386636a    rbuilder-online/nuxleus-1.3-x86_9327.img.manifest.xml   099034111737    available       true
IMAGE   ami-08866361    rbuilder-online/test1-1.0-x86_9326.img.manifest.xml     099034111737    available       true
IMAGE   ami-1281647b    rbuilder-online/mw-tour-1.6.8-x86_9458.img.manifest.xml 099034111737    available       true
IMAGE   ami-1681647f    rbuilder-online/mw-tour-1.6.8-x86_9459.img.manifest.xml 099034111737    available       true
  • $ AWS_AMI_ID=XXXX cap run_instance

This release just scratches the surface of what I hope to accomplish with Capazon – my end goal is to provide a shared AMI as a companion to Capazon which will encapsulate some Rails deployment best practices.

Please report any bugs you may come across, and stay tuned for updates!

capazon

Capistrano tasks to manage Amazon EC2 Images.

Soylentfoo on Rocketboom, Amazon EC2

Soylentfoo and Tweet, a Twitter action for Quicksilver that I made some updates to, were shown for around 15 milliseconds in today’s episode of Rocketboom. This is both nothing and everything at the same time. Watch it here.

In other meta-news, earlier this morning I moved Soylentfoo from my Textdrive Mixed Grill account to a Amazon EC2 server (domu-12-31-34-00-02-4e.usma2.compute.amazonaws.com, to be exact). For those thinking of using EC2 as a Ruby on Rails host in the future, stay tuned for a release of Capazon, a Capistrano rubygem plugin that aims to make deployment of a Rails application to an Amazon EC2 instance a ridiculously simple process. I’m getting very very close to a release.

File Upload Fu

Mike Clark covers attachment_fu, Rick Olson's amazing file uploading plugin with drop-in support for using s3 as storage.

S3InfiDisk for EC2 | openfount

Wonder if this is fast enough to store MySQL tables on....

S3DFS for EC2 | openfount

"S3DFS is the product EC2 users have been waiting for - a true distributed file system for EC2, backed on S3." Woah. Maybe we don't need an XServe RAID...

Capistrano & EC2 Sitting in a Tree, K I S S I N G « Niblets….Simple. Less.

Here's one way to integrate Capistrano and Amazon's EC2. My way - Capazon - is coming soon.

zeroflux.org :: Web Clustering with Amazon EC2

Very nice tutorial detailing a web clustering setup at Amazon's EC2

Amazon Web Services Developer Connection : CentOS 4.4 Base Image

My blog will soon be moving to Amazon EC2, powered by one of these.

Amazon EC2 Ruby Gem

This ‘Amazon-EC2’ Ruby Gem is an interface library that can be used to interact with the Amazon EC2 system using the Query API.
next page »
What is this?