Fuzed. Erlang and Rails, Sittin in a Tree. Dave Fayram & Tom Preston-Werner

Transcription

1 Fuzed Erlang and Rails, Sittin in a Tree Dave Fayram & Tom Preston-Werner

2 github.com/ KirinDave/ fuzed

3 If humans can land robots on Mars, then there is no reason we can t make a fast Ruby. Evan Phoenix

4 Phoenix

5 But no matter how fast Ruby is...

6 ...we will always need a way to scale it!

7 Traditional Scaling

8 internet mongrel

9 internet nginx mongrel mongrel mongrel

10 internet nginx mongrel mongrel mongrel mongrel mongrel mongrel mongrel mongrel mongrel

11 internet load balancer nginx nginx

12 What happens if a machine fails?

13 What happens if you need to add more hardware fast?

14 What happens if you have a mixture of very fast and very slow pages?

15 What do you do about a staging setup?

16 How do you deal with scaling in a flexible cloud (like EC2)?

17 What happens if you change your environment (e.g. from EC2 to a colo facility)?

18

19 Real Time Cluster Assembly

20 ...

21 Fuzedvantages

22 What happens if a machine fails? It will automatically be taken out of rotation, and rejoin once back up.

23 What happens if you need to add more hardware fast? No configuration changes necessary. Just add more nodes.

24 What happens if you have a mixture of very fast and very slow pages? Fuzed uses next available resource queuing. Not a problem.

25 What do you do about a staging setup? Run multiple versions of your app in the same cloud!

26 How do you deal with scaling in a flexible cloud (like EC2)? Please. Fuzed was MADE for a dynamic cloud environment.

27 What happens if you change your environment (e.g. from EC2 to a colo facility)? Change a few hostnames in startup commands. Done.

28 Insanely Flexible or, what I like to call Multiple Dimensions of Horizontal Scalability

29

30 master

31 faceplate master faceplate

32 faceplate master faceplate

33 faceplate faceplate master faceplate faceplate

34 faceplate faceplate master faceplate faceplate

35 Things Fuzed Does Not Help You With

36 Scaling your Database DB DB DB DB

37 Scaling your Database bummer dude! DB DB DB DB

38 Raw Speed SWEET

39 Basic Fuzed Architecture

40 master

41 faceplate master

42 faceplate master resource_manager

43 resource_manager faceplate master

44 details resource_manager faceplate master

45 master resource_manager pool faceplate

46 master resource_manager pool faceplate

47 internet master resource_manager pool faceplate

48 internet master resource_manager pool faceplate

49 internet master resource_manager pool faceplate

50 internet master resource_manager faceplate pool

51 internet master resource_manager faceplate pool

52 internet master resource_manager faceplate pool

53 internet master resource_manager faceplate pool

54 internet master resource_manager faceplate pool

55 internet master resource_manager faceplate pool

56 internet master resource_manager pool faceplate

57 Chassis Like the River Styx only where Erlang is the Earth and Ruby is Hades. Wait that came out wrong.

58 Rails Chassis class RailsHandler < Chassis kind "rails" handle(:handle_request, :request) do args $handler.service(args[:request]) end end

59 Rails Chassis class RailsHandler < Chassis kind "rails" handle(:handle_request, :request) do args $handler.service(args[:request]) end end

60 Request (rack-style) { "SERVER_NAME" => "frontend_responder", "HTTP_USER_AGENT" => "Mozilla/5.0 Firefox/3.0", "HTTP_ACCEPT_ENCODING" => "gzip,deflate", "PATH_INFO" => "/main/go", "HTTP_HOST" => "localhost:8080", "HTTP_ACCEPT_LANGUAGE" => "en-us,en;q=0.5", "REQUEST_PATH" => "/", "HTTP_KEEP_ALIVE" => "300", "HTTP_VERSION" => "1.1", "HTTP_ACCEPT_CHARSET" => "ISO ,utf-8;q=0.7,*;q=0.7", "SERVER_PORT" => nil, "Cache-Control" => "max-age=0", "QUERY_STRING" => "", "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8", "HTTP_CONNECTION" => "keep-alive", "REQUEST_METHOD" => "GET", "rack.input" => #<StringIO:0x238cc1c>, "rack.errors" => #<IO:0x2f7c4>, "rack.run_once" => false, "rack.url_scheme" => "http", "rack.multiprocess" => false, "rack.multithread" => true, "rack.version" => [0, 1] }

61 Response (yaws-style) [:response, [[:status, 200], [:allheaders, [[:header, "Server", "YAWS + Fuzed 0.0.1"], [:header, "Content-Type", "text/html; charset=utf-8"], [:header, "Cache-Control", "no-cache"], [:header, "Connection", "close"], [:header, "Content-Length", "4"]]], [:html, "done"]]]

62 Chassis is a language agnostic construct Lisp Ruby Python Scheme Befunge C

63 Oh, you need a scalable JSON server too?

64 Bonus Demo!

65 ...

66 require 'chassis' class AdderNode < Chassis kind "calculon" handle(:add, :arg1, :arg2) do args args[:arg1] + args[:arg2] end handle(:crash) do args raise "You asked me to crash, so I did." end end

67 What s next?

68 Eliminate the master as a single point of failure master master master master

69 Additional dispatch details URL paths HTTP headers Error handling (flexible strategies)

70 More Chassis Modules We love contributions!

71 In summary

72 Fuzed is: Your secret scalability weapon!

73 Thanks to our employer Powerset

74 Questions?