Negatendo.Net » Blog Archive » HOWTO Use Amazon EC2 for Bittorrent
http://negatendo.net/blog/2009/01/17/howto-use-amazon-ec2-for-bittorrent/

save

art up an instance of the 32-bit EC2onRails image:

"First of all, Amazon AWS rocks. it's a great, stable and not so expensive way to get your application up and running, but also ready for any disaster to come (Someone said Digg effect?). Getting your application on to Amazon EC2 is not as complicated as you think, managing and controlling your instances may require a professional system administrator, but i would recommend that anyway (except if you go and host your application on EngineYard than you are worry-free, but you'll pay.. ohh you'll pay for that sense of security)."

Amazon EC2 running Microsoft Windows Server® 2003 is a fast and dependable environment for deploying applications using the Microsoft Web Platform, including ASP.NET, ASP.NET AJAX, Silverlight™, and Internet Information Server (IIS). Amazon EC2 enables you to run any compatible Windows-based solution on AWS’ high-performance, reliable, cost-effective, cloud computing platform. Common Windows use cases include website and web-service hosting, high-performance computing (HPC) and data processing, media transcoding, distributed testing, ASP.NET application hosting, and any other application requiring Windows software. Amazon EC2 also now supports the SQL Server® Express and SQL Server Standard databases, and makes those offerings available to customers on an hourly basis.

amazon web services

We have just released four additional AWS public data sets, and have updated another one. In the Economics category, we have added a set of transportation databases from the US Bureau of Transportation Statistics. Data and statistics are provided for aviation, maritime, highway, transit, rail, pipeline, bike & pedestrian, and other modes of transportation, all in CSV format. I was able to locate employment data for our hometown airline and found out that they employed 9,322 full-time and 1,122 part-time employees as of the end of 2007. In the Encyclopedic category, we have added access to the DBpedia Knowledge Base, the Freebase Data Dump, and the Wikipedia Extraction, or WEX.

amazon

The goal is to make cloud computing less mysterious by helping people through the process of setting up a server on Amazon EC2.

"AppScale is an open-source implementation of the Google AppEngine (GAE) cloud computing interface. AppScale enables execution of GAE applications on virtualized cluster systems. In particular, AppScale enables users to execute GAE applications using their own clusters with greater scalability and reliability than the GAE SDK provides. Moreover, AppScale executes automatically and transparently over cloud infrastructures such as the Amazon Web Services (AWS) Elastic Compute Cloud (EC2) and Eucalyptus, the open-source implementation of the AWS interfaces."

Open source google app engine implementation, supports Xen, extending to GAE, EC2

A BSD-licensed implementation of Google App Engine. Roll your own cloud computing platform.

The AWS Toolkit for Eclipse is a plug-in for the Eclipse Java IDE that makes it easier for developers to develop, deploy, and debug Java applications using Amazon Web Services. With the AWS Toolkit for Eclipse, you’ll be able to get started faster and be more productive when building AWS applications.

Because this is just too cool!

There's a growing trend to provide some pretty awesome IT services over the internet. Seems to me that's the way it will mostly be in a decade's time - or less.

Amazon Elastic MapReduce is a web service that enables businesses, researchers, data analysts, and developers to easily and cost-effectively process vast amounts of data. It utilizes a hosted Hadoop framework running on the web-scale infrastructure of Amazon Elastic Compute Cloud (Amazon EC2) and Amazon Simple Storage Service (Amazon S3).

Who needs infrastructure? Keep your data somewhere else. Process your data somewhere else. You can now run your small data business out of your garage. Just photoshop a nice office for the investors.

Experiences deploying a large-scale infrastructure in Amazon EC2 At OpenX we recently completed a large-scale deployment of one of our server farms to Amazon EC2. Here are some lessons learned from that experience. Expect failures; what's more, embrace them Fully automate your infrastructure deployments Design your infrastructure so that it scales horizontally Establish clear measurable goals Be prepared to quickly identify and eliminate bottlenecks As you carefully watch various indicators of your systems' health, be prepared to.... Play wack-a-mole for a while, until things get stable

Cloud computing refers to the utilization of shared, elastic resources and processing power accessed via the Internet. In some ways, it hails the reversion to the golden age of time-sharing but with significant improvements to the distribution philosophies underlying the delivery infrastructure. So, analogously, we now have the shared wonders of Hyde Park, where everyone and anyone can chill on the bench, throw some Frisbee, instead of having to financially pool money to buy a private park to shoot rabbits. What is a cloud? Developers today can avoid scalability and availability worries in case their site turns into the next big thing by developing upon the cloud. Traditionally, a typical web application stack will look like that on the left below: image1 Cloud-based development involves in some sense, the outsourcing, of various parts of the application out of the server and into the cloud. So instead of storing images, videos and other objects in the file system, they are store

php amazon aws tutorial s3

While Amazon Web Services (AWS) may seem like an unusual service for an online retailer, AWS is actually a natural progression for a company as seasoned at providing rock-solid internet applications as Amazon. Over the years, Amazon has cultivated a tremendous amount of knowledge around what it takes to build and maintain a successful, highly scalable web application. Fortunately for the rest of us, they've made this knowledge available to all developers via AWS.

So Amazon will be in the web services business for the foreseeable future. Now that we've established that learning more about AWS is not a risky investment of time, let's focus on Amazon's Infrastructure Services -- EC2, Amazon S3, SQS, SDB and EBS -- that make up the core of what some within AWS refer to as "undifferentiated heavy lifting." All of these services are available via both REST and SOAP interfaces. (We'll touch on both in this article, but we'll concentrate on the REST and REST-like Query approaches. ) A growing number of language specific toolkits are available for these services, so you can feel comfortable basing an architecture on AWS given its language-agnostic foundation. The knowledge that you can ramp up 200 servers in five minutes if you need them may be a liberating experience for you -- in the days before AWS, system architects had to worry about handling rapid scale with "hot spares" and other expensive on-hand capacity that often sat idle until the day...

Amazon's Elastic Computing Cloud (EC2)

"how to get started with EC2, use Chef to prepare the server for rails apps, and then use Capistrano to start up a sample rails app"

Below I describe how to get started with EC2, use Chef to prepare the server for rails apps, and then use Capistrano to start up a sample rails app! It's really pretty easy!

Chef

Good starter tutorial for getting Chef going on an EC2 node.

And this is what we wanted a year ago. At least.

define

SpringSource Cloud Foundry

Spring等で作成したJavaアプリを、クラウド上で動作させるツール

The first self-service, pay-as-you-go, public cloud deployment platform for full-feature Java web aplications that unifies the entire build, run, and manage application lifecycle for Java. Cloud Foundry offers complete application lifecycle management for running Spring, Grails, and Java web applications.

SpringSource Cloud Foundry is the first self-service, pay-as-you-go, public cloud deployment platform for full-feature Java web aplications that unifies the entire build, run, and manage application lifecycle for Java. Cloud Foundry offers complete application lifecycle management for running Spring, Grails, and Java web applications by integrating the world's most popular Java web application technologies into an enterprise Java cloud platform that takes full advantage of the power of elastic cloud computing.

Amazon Virtual Private Cloud (Amazon VPC) lets you create your own logically isolated set of Amazon EC2 instances and connect it to your existing network using an IPsec VPN connection. This new offering lets you take advantage of the low cost and flexibility of AWS while leveraging the investment you have already made in your IT infrastructure.

@igrigorik: "cool, amazon launches "virtual private cloud" service @ http://bit.ly/w2z6d" (from http://twitter.com/igrigorik/status/3556113445)

Really quickly get an Amazon EC2 instance up and running Open Street Map.

Tile Drawer makes designing and hosting custom maps simple and straightforward. The project lets anyone run their own OpenStreetMap server in the cloud with one-step configuration and zero administration.

Create own EC2 openstreetmap tile generator

The project lets anyone run their own OpenStreetMap server in the cloud with one-step configuration and zero administration.

In this tutorial I'll show you how to setup and use Amazon's Web Services S3 and CloudFront to decrease website load time as well as show the performance differences.

Amazon Relational Database Service (Amazon RDS) is a web service that makes it easy to set up, operate, and scale a relational database in the cloud. It provides cost-efficient and resizable capacity while managing time-consuming database administration tasks, freeing you up to focus on your applications and business. Amazon RDS gives you access to the full capabilities of a familiar MySQL database. This means the code, applications, and tools you already use today with your existing MySQL databases work seamlessly with Amazon RDS. Amazon RDS automatically patches the database software and backs up your database, storing the backups for a user-defined retention period. You also benefit from the flexibility of being able to scale the compute resources or storage capacity associated with your relational database instance via a single API call. As with all Amazon Web Services, there are no up-front investments required, and you pay only for the resources you use.

Amazon Relational Database Service (Amazon RDS) is a web service that makes it easy to set up, operate, and scale a relational database in the cloud. It provides cost-efficient and resizable capacity while managing time-consuming database administration tasks, freeing you up to focus on your applications and business.MySQL

Amazon Relational Database Service (Amazon RDS) is a web service that makes it easy to set up, operate, and scale a relational database in the cloud. It provides cost-efficient and resizable capacity while managing time-consuming database administration tasks, freeing you up to focus on your applications and business. Amazon RDS gives you access to the full capabilities of a familiar MySQL database.

やり方、やりかた

■ <Message>The request must contain the parameter Signature.</Message>

000&ItemId=0679722769&Opera

Amazon APIを使うための情報

Django with Mysql and Apache

using AWS

Easy web interface to public Amazon S3 buckets. Handy if you want to share files with people.

Amazon CloudFront

The Ubuntu and Debian EC2 images published on http://alestic.com allow you to send in a startup script using the EC2 user-data parameter when you run a new instance. This functionality is useful for automating the installation and configuration of software on EC2 instances.

自宅サーバ時代の構成から始まって、どこが問題だったのか、なぜEC2に移行したの、EC2での構成、問題点、費用ほか。

EC2 事例。コストや特徴など。

is this supposed to be a joke - http://aws.amazon.com/importexport/

How the Amazon Web Services deal with importing and exporting large volumes of data to/from the cloud.

Import large data sets via snail mail into Amazon S3 storage.

protocol=http, lb-port=80, instance-port=80

http://leadthinking.com/42-aws-elastic-load-balancer-tutorial http://docs.amazonwebservices.com/ElasticLoadBalancing/latest/DeveloperGuide/ http://elwoodicious.com/2009/11/23/ec2-elastic-load-balancing-for-fun-and-profit/ http://af-design.com/blog/2009/07/15/3-amazon-elastic-load-balancer-tips/ http://ajohnstone.com/archives/ec2-tools-installation-ami-api-elastic-load-balancing-elb-and-cloud-watch/ http://topsy.com/tb/leadthinking.com/42-aws-elastic-load-balancer-tutorial http://lixconsulting.blogspot.com/2009/10/aws-setup-load-balancer.html http://docs.amazonwebservices.com/ElasticLoadBalancing/2009-05-15/DeveloperGuide/

adding elb to amazon servers

load balancing

You can load balance your Mysql cluster – however ELB is outside Amazon’s firewall and isn’t integrated with it. This means that to load balance Mysql you need to open it up to the world and rely on strong credentials to keep your data secure, rather than firewall rules.

We’ve been using the new Amazon Load Balancers (ELB) for Socialmod, and since there’s not much information out there on the subject, I thought a blog post would be in order.

Jollat is a cross-platform graphical client for Amazon Web Services (AWS). It let's you manage Simple Storage Service (S3) and Elastic Compute Clouds (EC2) on the Mac, Windows or Linux. The services are integrated into an easy-to-use GUI, enabling you to do complicated tasks with the simple click of a button. All this for less than the monthly fee of a small instance!

Today we’re announcing the availability of the Web-based AWS Management Console, which in this first release provides management of your Amazon EC2 environment via a point-and-click interface. A number of management tools already exist: for example a popular Firefox extension known as Elasticfox; however as you read more of this post I believe you’ll agree that the new console is compelling--especially when it’s time to log in as a new AWS developer.

Amazon Simple Notification Service (Amazon SNS) is a web service that makes it easy to set up, operate, and send notifications from the cloud. It provides developers with a highly scalable, flexible, and cost-effective capability to publish messages from an application and immediately deliver them to subscribers or other applications. It is designed to make web-scale computing easier for developers.

Amazon SNS is a shot across Twitter's bow: an event update API is a critical component in an Internet of Things >> http://j.mp/9cpSVb

Good discussion of the advantages and trade-offs

A few months ago I talked about our plans to create and offer a service for content delivery. That service is called Amazon CloudFront and it is ready now!Like all of our other services, CloudFront was designed with ease of...

A few months ago I talked about our plans to create and offer a service for content delivery. That service is called Amazon CloudFront and it is ready now!

content delivery network

A few months ago I talked about our plans to create and offer a service for content delivery. That service is called Amazon CloudFront and it is ready now! Like all of our other services, CloudFront was designed with ease of use in mind from the very beginning. There are no minimum usage commitments, no monthly fees, and no need to even talk to us.

Using Amazon EC2 Metadata as a Simple DNS

I use the amazon metadata for creating /etc/hosts and do this on a cron schedule. This does everything I need. Instead of fancy DynDNS tricks or having to run and manage an internal DNS server I just have a ruby script that looks at the metadata ec2 to build /etc/hosts. It's easy. To set it up yourself and try it all you need are 3 easy steps. Step 1- Start each of your instances with unique named key that matches what you want their internal hostname to be. Such as "onion" or "potato" or whatever you want to call them. Step 2- Make sure you have ruby, rubygems and amazon-ec2 (rubygem) installed. Then create a ruby script in /usr/local/sbin/hosts that has the following:

"I use the amazon metadata for creating /etc/hosts and do this on a cron schedule. This does everything I need. Instead of fancy DynDNS tricks or having to run and manage an internal DNS server I just have a ruby script that looks at the metadata ec2 to build /etc/hosts."