Mystery Tire vs Civic




This happened this past Saturday while we were on our way to get some lunch. I was accelerating on the on-ramp of the freeway near our house when I saw this huge tire come rolling downhill. It was heading towards the shoulder so I kept moving straight, thinking to myself, "Damn, I'm glad I'm going to make it past that thing without hitting it." Alas, it hit something on the side that caused it to ricochet towards us. Tire versus Civic...tire wins.

So I think we've come up with our shopping list after the 2 month evaluation period. I'll try to post some shots of us building the whole data center so y'all can pretend you're also working for one of the funnest (yeah that's a word) companies around. So here's what we're going to get...

Citrix NetScaler 9010

I know it seemed like we were leaning towards the Big-IP, but in truth our evaluation showed that both devices are equally good. The Big-IP has the advantage of being able to use iRules to do some pretty creative things at the site edge before it passes anything back to the servers. The NetScaler had the advantage of very trivial remote web logging setup, software that is very IOS-like and therefore would be easy to learn for any NetAdmin who knows Cisco, and very good word-of-mouth recommendations. This isn't taking anything away from the Big-IPs. I still like them and would recommend them to anyone.

Force10 C300

So I don't know that much about Force10 but I have had some experience administering Cisco 6500 series switches, which this thing presumably is competing against. They look the same, I'm sure the software is pretty similar too. I've heard anecdotal evidence that these outperform the Cisco's, but in reality, anything is going to be better than the POS Dell PowerConnect switches we are currently forced to use now. This C300 has 336 10/100/1000 Mbps Ethernet ports which is perfect for our phase 1 plans (about 60 hosts with 3 network interfaces in use). I'm a NetAdmin-in-training and I actually find it more enjoyable to work with network devices than systems so I really can't wait to get my grubby little paws on this bad boy.




3Par Inserv S400



So I've never heard of 3Par until our Ops lead joined the team. He used to work for 3Par a few years ago and it might seem like we're picking this product over the likes of NetApp, HDS, or EMC because of that reason...but after visiting 3Par's lab and having a few meetings with the other vendors it really became a no brainer decision. 3Par wasn't the cheapest solution, but in terms of performance, ease of use, and customer support they beat everyone else we checked out. This was actually the most controversial (although I use that term very lightly) item when we were discussing the data center project with the Engineering team. We currently have a very distributed, DAS (Direct Attached Storage) environment and it's understandable that they were a bit hesistant when we said that we could move away from all the local hard drives and just use centralize storage. From an administrative standpoint it's a no-brainer. From a performance standpoint, it took some convincing but in the end we all agreed that our systems would perform no lesser (and possibly better) with centralized storage. We'll use DAS for certain situations of course.




Sun Netra X4200


So we decided on Sun to host our site. It was between Sun and HP. Both are great systems (especially compared to Dell) but the clincher for us was remote management capabilities. HP's ILO is great, but would cost us an additional $300 per server to give us what Sun was including in the base price. The sun boxes are very well manufactured. At my last job I administered Linux on Dell PowerEdges for 5 years and the Sun just blew me away when it came to how it was engineered. The Netras will power all our front-end servers.

Sun Fire X4600


And the Fire will power our back-end servers and also host some VMs. This bad boy is the toy that still makes us all giddy like a school girl. Besides the fact that it has 8 dual-core Opterons (and is quad-core ready) and 32 GB of memory (up to 256 GB), it's the most well-engineered machine I've ever laid my hands on. It looks like a solid piece of metal and it feels like it too. We' re going to try running 16 instances of our front-end code (Apache / PHP) and benchmark it. I'll post more info on our results later.

Damn, this dude can sing...

A co-worker / friend of mine, Invisible Programmer, enlightened me with the magic of Guthrie Govan. This kind of reminds me of Steve Vai when I listen to it (but not when I look at him, hehe).

Can anyone think of a better caption?

NetScaler versus Big-IP Bake-off

Introduction

I spent several days with the Citrix NetScaler and F5 Big-IP. I have used Big-IPs in the past, although it was the 4.x software version which is much different than the current 9.x version. This gave me a small advantage with the Big-IP initially. I've administered Cisco devices also, and the NetScaler CLI felt a lot like Cisco IOS, so initially I think both were equally comfortable to administer. When all you need is to be able to create a virtual IP and balance traffic to your back-end servers, both products can do the job easily and for the most part have equal features in that category. I think the Big-IP has the advantage of being able to use iRules to do things at the edge of the site that we may or may not need now, but would be a nice-to-have for future configurations. F5 also has a useful user community site (DevCentral) and Knowledgebase (Ask F5). Citrix has user forums too, but it didn't seem nearly as informative. Most of their site seems to be focused on Xen.

Load Balancer Observations

The NetScaler uses a Java applet driven GUI which is mostly nice, but using Firefox and Apple's JRE introduces some quirky display issues. Sometimes the page is totally blank and you need to refresh which usually kicks you out and makes you log back in.

The Big-IP GUI is driven by JSP pages and felt "quicker" when navigating through different sections.

The NetScaler interface is very easy to navigate and finding things is simple.

The NetScaler Dashboard looks nicer and some useful info. I wish there was a way to drop more graphs on the page.

The embedded Help sections on the F5 are very convenient.

The PDF documentation for the NetScaler is well written and easy to follow. It would have been nice to see some of the info embedded in the interface like the F5 has.

The Big-IP graphs are actually more informative in my opinion. Being able to see connections in real-time is a real plus.

I like the fact that the Big-IP is running a Linux kernel (albeit an old one) and has GNU tools. Makes it easier to administer for a Linux SysAdmin. Also, the documentation is in man pages, so if you want to know everything you need to know about creating a new virtual server, it's as simple as typing 'man virtual'.


The other advantage of a GNU/Linux environment is that you can actually use sed to do things like globally replace a string in your config file to quickly and easily change something site-wide.

There is a good example of how this is useful. I had to change the self IP address of the external interface and make it internal, but it was not obvious through the GUI or even through bigpipe. Editing the bigip_base.conf file was super easy though.

The CLI on the NetScaler (as mentioned above) feels very IOS-like and was pretty easy to go from a Cisco device, to a Foundry device, to the NetScaler without having to think about what you're doing. The Big-IP uses "bp" commands that take a little getting used to, but after an hour of repetition it's equally easy to administer on the command-line. The built-in documentation (man pages, natch) on the Big-IP is very useful. The NetScaler does the IOS "tab-tab" thing to assist when you've lost your way.

The multiple Gigabit interfaces on the Big-IP would be useful for internally used clustered Web apps that need to be on separate subnets. I don't think we're there yet, but it would be nice to have that option.

The NetScaler has a remote web logging feature that is extremely easy to setup. You install an agent on your logging host via RPM and then enable remote logging on the NetScaler and it's done. The Big-IP can probably handle logging via an iRule, however we didn't get to that question when their system engineer was out last time and searching on DevCentral didn't pull up anything readily.

Simple to configure Cacti graphs on Big-IP, there was even a how-to on F5's site. The graphs allow you to monitor connections per second per virtual server (try doing that on the Foundry). The SNMP MIBS are readily available within both the Big-IP and NetScaler GUI.

Both products offer an API solution so we can write custom applications that can interface with the load balancers. The NetScaler offers this within their GUI, along with the documentation. F5 offers it's API called iControl, along with an SDK, both freely available on their site. There's also an iRules editor (Windows only) that is like an IDE for iRules. It's very useful for quickly writing complex iRules from scratch and has a built-in syntax checker. Both APIs use standard XML / SOAP. The NetScaler provides a few examples in different languages to get you started, but F5's community is again useful in providing a dynamic forum where more than just examples are posted.

So we're evaluating the Sun Fire X4600 and Netra X4200 this month, along with the HP ProLiant DL365. The ProLiant and the Netra are pretty decent boxes, and would be excellent workhorses for your front-end app. The X4600 is what we're drooling over however. With the ability to power 8 dual-core Opterons (and quad-core when they're available), and 256 GB of memory, this baby is begging for virtualization. It's nice that we're also evaluating both Citrix XenServer and VMware ESX 3.5 this month too. Whoo hoo!

The Fire X4600 has a very nice modular design. You can buy it with 2 to 8 modules and each module holds a dual-core processor and up to 32 GB of memory. Ours only has 8 dual-core procs and 32 GB's of memory total, but that is more than enough for what we're planning on testing it with. Here's a closer look at the module.



That big copper heatsink sits on top of the CPU.

I'm not quite sure what this guy was thinking, but clearly Canadians are crazy.

So a friend introduced me to the magical genius that is Mark "Bill" Bailey. If you haven't seen any of his stand-up comedy, here's a taste of what he does...brilliant!



You can buy his CD's and DVD's at his official online store.

My Dad just sent me a link to a YouTube video of this amazing R/C helicopter pilot doing a run. The video speaks for itself.




I remember my dad buying me an R/C helicopter (two in fact, as one had an unfortunate accident) when I was a kid. It was one of the most exhilarating times I've ever had growing up. I was a horrible pilot because I knew how much the thing cost and was petrified with fear that I'd crash it. The fear mixed with excitement like nitro and methane every time I'd hear that little motor start up. I've been to a couple of R/C helicopter events since then (although I've never seen anyone as crazy as this Alan Szabo Jr guy). If you haven't seen one in person, I highly recommend checking one out.