Microsoft just announced major changes to the Microsoft Certified Master of SQL Server program. I’m excited about the new direction of the program, although I’m a little biased – I helped with the program’s changes to reach the right audience.

The Original Microsoft Certified Master Program:

• $18,500 entry fee for 3 weeks of training (and possibly certification)
• MCITP: Database Developer 2008 and MCITP: Database Administrator 2008 required first
• You had to show up onsite in Seattle for 3 weeks straight
• Three written multiple-choice exams onsite during the training
• One six-hour final lab

This setup had a few problems. It was tremendously expensive – both in terms of the entry fee and the 3 weeks of downtime. It was hard to schedule 3 weeks off in a row even if you had the vacation or your company was willing to eat that expense. You might not have needed all 3 weeks of training, and you might not have been able to travel around the world to get it.

Bottom line – having the training and the certification as an all-in-one package just didn’t scale, and that’s evidenced by the fact that only a handful of us outside of Microsoft were able to pull it off. I know a lot of people who are more technically qualified than I am, but they couldn’t justify the Master program. So how could we get more qualified people to be Masters?

The New Microsoft Certified Master Program:

• MCITP: Database Developer 2008 and MCITP: Database Administrator 2008 still required
• Certification and training is totally separate
• Initial written multiple-choice exam – $500, and can be taken at Prometric testing centers around the world
• 6-hour lab exam – $2,000, and can be taken at select secure Prometric testing centers around the world

The two biggest barriers to entry – a huge initial price tag and 3 weeks of lost work time in Seattle – are now gone! It’s now easier to prove that you’re a Microsoft Certified Master of SQL Server. (Note that I did not say it’s easier to be one, because it’s still very, very, very tough.)

Since the training is now separate, it’s up to you how much training you want to get, and who you want to get it from. If you’re already an expert on some subject areas, maybe you’ll only get training on the areas where you’re weak. Perhaps you’ll choose to get the training in chunks – one week’s worth this year, one week’s worth the next year, and then make a run at the exam. I would advise trying not to pass the lab exam cold, because this is most definitely not the MCITP.

To help you get up to speed, Microsoft partnered with SQLskills to provide dozens of hours of video training online completely free. Bob Beauchamin, Kimberly Tripp, Paul Randal, and I recorded some of our best presentations on internals, CLR, storage, performance tuning, and more. You can watch our free Microsoft Certified Master online courses all in the comfort of your cubicle. (That link may not be live yet – check again later in the day.)

If you want more personal, interactive training, you’ll be able to get it from more places. I’d argue that you still want to get it from the most qualified, highest rated trainers around. You want to get it from people who aren’t just experts at training – you want your instructors to be hands-on consultants who live this work every single week. When we’re not training or helping the community, we’re consulting in some of the toughest environments around. Yes, of course I mean SQLskills – we’re offering a series of events around the United States in 2011 to give you Microsoft Certified Master approved training. We’re the only trainers that have been involved with the MCM program from the very first rotation, and we’re the best people to help you achieve the highest level of technical certification on SQL Server. You can check out our upcoming SQLskills Immersion Events here.

I really passionately believe in where the MCM program is going. There’s going to be more people recognized as Masters, and that’s a good thing, because there’s a lot of really qualified people out there. I’m not worried about the MCM becoming the next MCITP – a certification seen as having too low of value due to the braindump factor – because I was a contributor to the new MCM program. It’s a seriously high bar to pass, but I believe a lot of you can do it.

Brent Ozar

Brent specializes in performance tuning for SQL Server, VMware, and storage. He's one of the very few Microsoft Certified Masters of SQL Server, a published author, and a Microsoft MVP. He likes travel, Jeeps, Apple gear, jokes, and writing about himself in the third person. Read more and contact Brent.

Website - Twitter - Facebook - More Posts

If the DBA answer is always, “It depends,” how can Microsoft test DBAs?

Six of the SQL MCM R8 guys

Every week of the MCM program, attendees take a multiple-choice test. Afterwards, we gathered in the hallways and vigorously debated our answers. We agreed about most of the questions, but we had loud discussions about the pros and cons of a dozen of the test questions. The test really forced us to evaluate a lot of options. How many answers are right? Sometimes they tell you to pick three – and sometimes they don’t. Sometimes it’s up to you to figure out how many answers are right. I adore tests like that because they don’t give you any help, and they make you prove things for yourself. You’d better be right, too, because there’s no partial credit for halfway right answers. Time to be a master, as the posters in the classroom say.

The questions don’t involve regurgitating memorized syntax, either. Sure, some of ‘em can be figured out by the covered material, but most of them required you to put one and one together. It wasn’t just about knowing what the book says – it was knowing what the book DOESN’T say, and justifying your rationale. Every question has a comment area, and during the tests, keyboards were clacking away. I put comments on at least a quarter of my answers, saying things like, “I picked B, but only because you didn’t say you needed HA. You should have HA for this, which means you need D, not B.” I went way, way out of the way to back up as many of the answers as possible. The tests are graded by real, live human beings. More on that in my next post.

I passed all 3 exams on my first try, and I’m really proud of that. Before I got to the Microsoft campus, I was worried about the exams, not the final six-hour hands-on lab. I was so afraid of failing the tests that I studied my brains out every night for those rather than spending time with lab scripts. Attendees can bring their scripts and documents to the lab, plus use the web, so how hard could it be?

The Final Lab

Simon Sabin (Blog – @Simon_Sabin) noticed all the studying I did during the last 3 weeks and asked me if it was possible to cram your way through the MCM. First, there’s an interview process before you even get accepted to the MCM, and you can’t cram for that. But for the sake of argument, let’s just say you fake your way through the interview, and you cram your way through the exams – there is absolutely no way to cram your way through that lab.

The lab was the best simulation I’ve ever seen of what it’s like in real life. The CIO’s standing behind you, asking you why the system’s not up yet, and why it’s not as fast as he wants it to be. The MCM lab is like the last question on Who Wants to Be a Millionaire when you’ve already used up all your lifelines. You don’t get the 50/50 option, you don’t get to phone a friend, and Regis wants to see how much you really know. The final lab on Saturday was the toughest IT experience of my life, and I’ve been through some serious nastiness. Obviously I can’t say specifics about what the lab involved, but I’ll do my best to walk the line.

As a DBA, sometimes people want me to do things that I’m not comfortable with. Sometimes they want to use SQL Server in ways that don’t make sense, like looping through records individually and doing CPU-intensive processing on them. Sometimes they want to use features I’ve never touched before, and I pad more time into my project timelines in order to get comfy with those features. Sometimes they want to combine features in ways that I’ve never thought of. I try to deal with these requests in a way that keeps the project moving forwards on time with the least amount of risk.

In the MCM lab, you don’t get the luxury of finding a common ground between what the client needs and what you’re personally capable of delivering. The client needs something, and they don’t care how SQL Server works. They don’t care if you’re comfortable. You’d better strap in and get the job done, cowboy.

At 11:30 AM, I got a several-page business requirements document that was more thought-out than what I usually get from clients, but in a very similar style. It was as if someone had parachuted in before me, interviewed the client, done a lot of the requirements gathering, and handed it off to me. It wasn’t perfect – but it was still better than what I usually get from managers. I took about five minutes to read it, formulate a game plan, and then got started working. I had a list of about half a dozen things I needed to accomplish in the client’s lab environment. I had to build some things, I had to adapt some things that were already in place, and I had to fix some things.

My heart sank as I realized what I’d have to do by 5:30 PM. I understood the business needs behind every single task I needed to do. I have big philosophical objections to doing some things in SQL Server, but not this stuff. It was all a match made in heaven – but I just didn’t know how to do some of it. They had completely legit business needs, but I couldn’t directly match some of those needs to anything in the SQL Server toolbox. It wasn’t like I could open SSMS, right-click on a few things, tweak some obscure parameters, and deploy a solution.

Or could I? As I built my list of tasks, I was absolutely positive that I was missing some obvious features or some simple DMVs. I kept thinking, “I’m gonna be so pissed afterwards. I’m going to be the only guy here who didn’t know about the Magic Beans feature that automagically does this stuff for me. I’m gonna be the only moron who rolled his own solutions out of duct tape, lint, and Cheesy Poofs.” We had access to the web, so I spent maybe two minutes searching for solutions, but came up empty. I figured out immediately that the MCM team has put a heroic amount of work building a test that simulates real client work, yet requires answers that you can’t find in Google. I will never breathe a word of the final lab contents because I think it does such a phenomenal job of gauging truly master-level expertise.

Getting Things Done

Whether you’re doing a lab or a real-life project, you have to design for the time you have. Artists ship. But should you:

• A. Plan to be 100% done with 50% of the tasks
• B. Plan to be 50% done with 100% of the tasks
• C. Plan to be 100% done with 100% of the tasks

When someone else sets your deadline and your tasks with non-negotiable limitations, you need to decide whether you want to shoot for A or B. In the case of the MCM, I took approach B. I wanted to show that I was capable of doing everything the client needed, and that I knew what best practices were, but I just didn’t have the time to do it according to best practices.

For example, when I’m importing data from a file, ideally I want to know what the real field definitions are. Sure, today the longest value in the LastName field might be 40 characters, but what if the next batch has someone with a 60-character last name? I don’t want my processes to break. However, finding this out can take time, and the cost of being technically perfect is high. In situations like that, I might make LastName a varchar(100) and call it a day. Anytime I made a compromise in the interest of time, I added it to my running task list in Notepad. If I had the choice between doing something perfectly or doing it MacGuyver style, I did it MacGuyver, then made myself a note to come back and clean it up.

Even the seemingly easy tasks were hard. This was no point-and-click GUI-fest, and canned scripts didn’t help much. I brought dozens, maybe hundreds of scripts that I’ve used in the past. I think I only used two, and they only saved me maybe fifteen minutes, max. The rest of the time, I was banging out keystrokes, testing my work in TempDB first, and hoping like hell that it all worked when I tried it with the client’s stuff.

I finished the MacGuyver round after 4 hours, and then circled back to clean up some of my work. I walked out with about 30 minutes left because I’d gotten to the point where I didn’t want to touch anything else lest it break. My solutions worked enough that I was comfortable defending them. I could have built more, but in doing so, I stood a pretty high chance of breaking something. I turned in my solutions along with my laundry list of things I’d love to do if the client would be willing to give me a week.

After The Lab

I walked out and called Erika. I was glad I got voicemail, because I was on the verge of crying. I could barely keep control of my voice when I left her a message. I was exhausted, I was proud of what I’d accomplished, and I felt like I couldn’t possibly have done any better given the skills I’ve gathered over the years. I was still sure I was missing something obvious, because there was no way candidates could be asked to this much work in 6 hours.

As the other attendees came out, the experience was nothing like the post-written-exam discussions we’d had. Rather than debate the merits of our solutions, we all tried to rationalize each others’ solutions. We didn’t want to promote why our idea was right – we wanted to figure out what the other people had done, and learn from their approach. There were no easy buttons, no quick solutions. As we spoke, we were horrified to discover that we’d overlooked or overthought various pieces. Several of us (myself included) built out whole wings of stuff that we thought were a good idea, but weren’t technically required by the client. I was awed by the work of my classmates, who came up with really brilliant ideas and features.

Here’s the part that really got me: everybody I talked to pulled off Mission Impossible. We actually did most of the stuff we needed to do in the time allotted. I’m pretty sure one guy even pulled off 100% of the tasks to 100% quality, too, and I stand in awe of his skills. As the MCM blog announces new Masters, I’ll be the first person to sing their praises. Forget the certification – there were candidates who I would hire in a heartbeat because they’re so skilled.

The non-disclosure agreement really sucks because I can’t tell you how incredibly difficult that lab was, yet so perfectly in tune with the DBA experience. If you’re a production DBA or a consultant who doesn’t freak out when someone comes running into your office with a tough challenge, you can pass this. If you enjoy tracking down difficult problems and reverse engineering things to make them do what you want, you can pass this. It’s not gonna be easy, but your job isn’t easy either. There were parts of the lab that we wish would have been even harder to show off our particular skill sets, but they would have required making the lab longer – and remember, we didn’t even finish the work we’d already been given.

Passing the exam shows you know what’s in the book. Passing the lab shows you know what to do when the book runs out of pages.

Even in this seriously talented group of candidates, we all missed things. As we poured our hearts out over beers, many of us wished we could have another go at the same lab just to time ourselves and see if we could do it better. A lab like this really shows who’s in it for the technical challenge, for the internal pressure, and the excitement. We were very, very, very hard on ourselves, and one guy said it best: “If I was the instructor, I’d fail me. I expected better.” So many of us just aren’t satisfied with our skills and our results no matter how good they get. We always want more, and we never stop pushing.

But that’s how we ended up in the Master program.

What It Takes to Pass the MCM

Microsoft Certified Masters don’t know everything – but then, you can’t. There’s too many parts in the SQL Server box, and no one human being can know how all of them work. New features come out faster than you can learn them all, so you have to be able to prioritize. And even if you know them all, it’s not enough, because things outside of SQL Server are just as important. A couple of years ago, I got into SAN administration and virtualization to make myself a better DBA, and now I’m looking forward at other technologies to improve my DBA skills too.

There is no sharply defined guide to database administration – or any job – with a first page and a last page. The act of “working” is a morphing set of tasks that isn’t limited, and even the act of building the task list is part of the art. Being a Microsoft Certified Master is about being able to recognize what’s important for you to know, knowing the bejeezus out of that stuff, and just as important, being able to quickly figure out the parts you don’t know. It’s more than knowledge, more than training, more than task management, more than priorities – it’s the sum of all those, and how they make you a better SQL Server professional on the whole.

So as hard as it was, I’m very proud to say I passed the exams and the lab on my first try.

I’m a Microsoft Certified Master for SQL Server.

Brent Ozar

Brent specializes in performance tuning for SQL Server, VMware, and storage. He's one of the very few Microsoft Certified Masters of SQL Server, a published author, and a Microsoft MVP. He likes travel, Jeeps, Apple gear, jokes, and writing about himself in the third person. Read more and contact Brent.

Website - Twitter - Facebook - More Posts

There’s something really exciting about walking into Microsoft each morning.  I know it sounds cheesy, but I get the feeling that really cool things are happening all over the campus.  Love ‘em or hate ‘em, Microsoft builds things that touch our everyday lives, and this is where it’s happening.  I know a lot of Microsoft employees that I really, really respect for their knowledge, community efforts, and personalities.

And for three weeks, I’m surrounded by ‘em.

My MCM training is taking place in Building 40 on the Microsoft campus.  I’m staying at the Homestead Suites only a block away, and I’d highly recommend it to any attendees.  It’s way cheaper than everything else in the immediate vicinity – around $75/night compared to $150/night for real hotels like the Courtyard or Residence Inn.  The advantage of staying so close is that you don’t have to fight traffic.  During the MCM, you’re going to treasure every minute you can spend studying (or relaxing).  If you’re willing to drive 20 minutes each way in traffic, though, you can cut your hotel bill to around $50/night and get a hotel with a warm breakfast each morning.  That drive might not be so bad, though.

Rooms in the Homestead have a little kitchen with fridge, stove, and a microwave, so I stocked up on basic breakfast & dinner food when I arrived.  That turned out to be a bad idea – every day after class, I really like driving a few minutes to a nearby restaurant just to get out for a while.  The Homestead isn’t exactly welcoming, and it’s tough enough to get psyched up for an evening of studying.  If you stay farther away, then take a 15-20 minute drive from Building 40 to a hotel, you can hit a restaurant on the way in & out.  You’ll have a better frame of mind at a little higher expense.

The Homestead has a small laundry room, but I drop my clothes off at a nearby laundromat.  They’ll wash & fold your clothes for a fixed rate by the pound of clothes.  It costs 3-4x more than doing it yourself, but you don’t have to wait around for a free machine, and you can spend that time studying instead.

No matter where you decide to stay, bring an Ethernet cable.  Hotel WiFi is a gamble, and you can often get better performance via hard wiring.  The Homestead’s WiFi in particular is horrible, often dropping connections outright, but the network via jacks in the kitchen is rock-solid and quite quick.

The Homestead’s pretty quiet, but the walls are wafer thin.  Even in quiet hotels, though, I sleep way better with a white noise generator.  At home, I use a Marpac SleepMate, which uses a spinning plastic tube to generate whooshing air sounds.  It’s very soothing, and it masks background noise extremely well.  Sometimes in hotels, I can get away with just turning on the air conditioning fan to get white noise, but in places like Seattle, that doesn’t work.  Leaving the fan on means you don’t get heat or AC, and Seattle hotel rooms in winter get cold enough to hang meat.

On the road, I use the $1 Ambiance iPhone app, which plays background noise through the phone speaker.  You can choose from hundreds of noises, and my favorites are Brown Noise (no poop jokes), Powerful Waterfall, and Rain on a Tent (not to be confused with Snakes on a Plane.)  Ambiance has two downsides – it runs your phone battery down, so you need to run it on a charger.  It’s not as all-encompassing as the Marpac – recorded noise just doesn’t seem to do as well as whooshing air when it comes to masking noise.  I still recommend it highly though.

Killing Us Softly

If you don’t like studying in the hotel room, you can spend as much time as you want in Building 40.  On the first day, MCM candidates get badges with 24/7 access to the building.  The classroom is stocked with an abundance of the finest snack foods imaginable.  Want something to drink?  The kitchens all have Starbucks coffeemakers and fridges stocked with sodas, fruit juices, and energy drinks.  Carbohydrates will not be an issue – well, at least the lack of ‘em won’t be an issue.  I think I’ve gained five pounds already.

Non-Microsoft staff don’t get WiFi access.  You can bring your laptop, but either bring a data card or be prepared to use the in-desk computers to access the web.  Bring a giant thumb drive (at least 8GB) to copy materials from the lab to your machine.

Some of the labs are delivered in VPC format, so install Microsoft Virtual PC ahead of time on your computer.  If you can’t run VPCs on your laptop, consider upgrading your laptop – it’s cheap relative to the cost of the MCM.  You can skip using the VPCs, but you’ll be missing out.  Apple users – this means you need to install Boot Camp with at least 20GB free space so that you can boot into Windows, then copy the VPC to your local drive and run it from there.

The MCM signup material says that laptops will be provided, and they are, but you don’t want to use them.  They’re garbage.  Same with the computers built into the desks – mine said Optimized for Windows XP, and even that was a stretch.  Mine didn’t have the VT extensions on the processor, so I couldn’t even use it for VPCs.  To add injury to insult, the desk computers have CRTs embedded in the desktop, and you’ll bang your knees against the display every time you use the desk.  By the end of the first week, most of the attendees were sitting sideways at their desk just so they could use their laptop without bruised knees.

If you’ve got friends to visit in Seattle, do it before the MCM begins.  You can’t predict what time you’ll get out of class each afternoon, and when you do, you won’t be fit for human companionship.  Your brain will be battered even more than your knees.  Don’t plan on doing it after the last day, either.  By the end of this, you’ll be dying to get home to your own bed, to eat food out of your own fridge, watch your own television, and hug your loved ones.

Speaking of loved ones, I need to blog about the bonds you build with your fellow MCM candidates.  You really go through hell, and you learn a lot about people by the kinds of questions they ask (and the answers they offer) during three weeks of nonstop in-depth technical training.  More on that later.

First I’ve got a test to take.  (sigh)  Here comes Number Two.

Brent Ozar

Brent specializes in performance tuning for SQL Server, VMware, and storage. He's one of the very few Microsoft Certified Masters of SQL Server, a published author, and a Microsoft MVP. He likes travel, Jeeps, Apple gear, jokes, and writing about himself in the third person. Read more and contact Brent.

Website - Twitter - Facebook - More Posts