Cloudcamb notes

Cloudcamb

Here are the notes I mananged to make at CloudCamb, which was organised jolly well by Matt Wood (MZA on twitter).

Simone Brunozzi, Technical Evangelist, Amazon Web Services (simon on twitter)

Cloud computing helps answer the ‘prediction problem’ – knowing what your tech needs will be in the future

Need to expand to take advantage of an opportunity

What about periodical demand?

Results in extra cost and delays

lack of power and flexibility in infrastructure

Cloud computing allows a business to: focus on your skills, limit cap ex, scale quickly, reliable, innovate and save money

Principles of AWS: cloud computing, easy to use, secure, flexible, on demand, pay per use, self service, platform agnostic

Services: include S3 – storage, EC2 – virtual server, Cloudfront – content delivery, Database – SimpleDB

By end 2007 AWS were using more bandwidth than all Amazon retail sites put together. S3 objects (basically, files hosted) 800m in q3 2003, 29bn q3 2008

Cloud computing suits cloud computing. No upfront investment, cost effective, follow your success, shorter time to market

AMAZON S3 – Smugmug.com saved $500k pa using S3 (ie just by moving storage of files). Scalable online storage, cheap & reliable, simple APIs (REST, SOAP)

AMAZON EC2 – Vitual servers on demand, from $0.10 per hour, Linux, Windows, OpenSolaris all available. Elastic IP , Elastic Block store, availability zones, SLA 99.95% Licences for software can be paid for by the hour. Animoto Feb 08 80 ‘instances’ of EC2. Then launched facebook app went up to over 3500 by April. Would have been impossible to scale like that traditionally.

AMAZON CLOUDFRONT – Improve content delivery through caching. Easy setup, no committment, 8 locations in US, 4 in europe, 2 in Asia. Elastic and reliable. Tiered pricing.

AWS offers: fault tolerance, scalability, rapid innovation possible, no barriers of adoption, better pricing model, no upfront investment, faster time to market, choice, partners

Who uses? NY Times, Nasdaq, Washington Post, Linden Labs, amongst others

Future: operational excellent, security, certification for developers, international expansion, management console, load balance, auto-scaling, monitoring

EC2 now available in europe – though no Windows stuff

Amazon yet to not be able to provide service to a customer

Toby WhiteInkling Software (tow21 on twitter)

Toby is talking about ‘Running a startup in the cloud’

All of Inkling’s servers run on EC2. But cost so far has been more than traditional servers, but that is not what matters. S3 is cheap, EC2 less so.

Ease of use – Inkling have few staff, have better things to do than server admin

Amazon makes process very easy, setting up new instances etc. Scriptable, repeatable and testable. Version controlling of AMIs. Forces you to consider these issues, which is a good thing.

Karim Chine – Computational e-Science in the Cloud: towards a federative and collaborative platform

Karim started by showing just how easy it is to use Amazon EC2. ElasticFox is an FF extension that helps manage the service.

There is a lot of science in this particular talk. I’m not sure I can keep up. It’s something about reproduceable computational results. I think. Just read this, if you want to know more.

Seriously, though, some of the stuff I understood about this show that the ability for people involved in scientific projects to collaborate over the internet in this way is superb, and the technology is clearly pretty innovative, not to mention hugely complicated. Given that I am attending a meeting in a building called the Centre for Mathematical Sciences, I would imagine that a lot of other people here would know a lot more about this than me.

Cloudcamb, 17th December 2008

This is why I moved to Cambridge – stuff like CloudCamb happening on your doorstep:

All are invited to attend the first Amazon Web Services user group in Cambridge, on Wednesday 17th December. Learn more about getting started from the experts, or discuss your own use of Amazon Web Services with like minded start ups, businesses, scientists and entrepreneurs.

More details at the CloudCamb site.

Amazon MP3 is go in the UK

Amazon have been selling downloadable MP3s in the States for a while now, and finally you can get them in the UK.

Amazon MP3

For those currently getting their legal digital music from the likes of iTunes, you should find the prices at Amazon much more to your taste!

Amazon also claim their downloads are DRM free, meaning you can use them on whatever software or playing device you like, and you can burn CDs to your heart’s content.

Lovely.

Trust in Web 2.0

Danah Boyd writes a post about a rather worrying occurence: a friend who had their Google account taken away from them:

Earlier this week, an acquaintance of mine found himself trapped in a Kafka-esque nightmare, a nightmare that should make all of us stop and think. He wants to remain anonymous so let’s call him Bob. Bob was an early adopter of all things Google. His account was linked to all sorts of Google services. Gmail was the most important thing to him – he’d been using it for four years and all of his email (a.k.a. “his life”) was there. Bob also managed a large community in Orkut, used Google’s calendaring service, and had accounts on many of of their different properties.

Earlier this week, Bob received a notice that there was a spam problem in his Orkut community. The message was in English and it looked legitimate and so he clicked on it. He didn’t realize that he’d fallen into a phisher’s net until it was too late. His account was hijacked for god-knows-what-purposes until his account was blocked and deleted. He contacted Google’s customer service and their response basically boiled down to “that sucks, we can’t restore anything, sign up for a new account.” Boom! No more email, no more calendar, no more Orkut, no more gChat history, no more Blogger, no more anything connected to his Google account.

Maybe no-one should rely on just one company to do everything for them. I really only rely on Google for my email, but even if just that disappeared, I’d be seriously pissed off. Again, this is one of the anti-web2.0 arguments: relying on these third party services is all well and good, but what happens when something goes wrong? How can we trust these people with our data, our information, our identities?

This week saw some outage on Amazon’s S3 and EC3 services. Many people might think of Amazon as just a supplier of books and CDs, and a whole lot of other stuff. But they also offer services for people who run websites, hosting and that sort of thing. It’s used by an awful lot of Web 2.0 startups, because it means they don’t have to even buy a server to start a company – let Amazon handle the headaches for a monthly fee.

But when this giant back-end, if you’ll excuse the unpleasant image, goes down, what’s left? For those of us that are trying to sell the web 2.0 and social media dream, what’s left is potentially a face covered in egg. We need to have confidence that the ideas and approaches we want people to take up are going to work 99.999999r% of the time. Especially when we are talking government, and public services, where stuff really has to work (though to be fair it often doesn’t).