Objective
I’ll admit it: my résumé doesn’t stand out. I’ve had some great internships, but also a tendency to work for companies that aren’t (yet!) household names. And though I’m doing fine academically, it’s not well enough to stand out on my marks alone.
On the other hand, my blog lets me stand out. I’ve had a few opportunities to meet and interview with some great people and companies because they read my blog. Naturally, then, the primary goal of my résumé is to get people to visit my blog. Since I don’t quite have the audacity to make my résumé a note telling people to visit my blog, I’m faced with the problem of how to optimize my résumé to ensure people see my blog. That’s where this experiment comes in.
Methodology
I started thinking about variables in my résumé that could affect the rate at which people viewed my blog. I narrowed it down to three that I could easily test.
The first is the length of the résumé. My friends Rajesh and Shams are adamant about keeping their résumés down to a single page. Their arguments are sound, but I wanted to see if the data would back up their beliefs. I created a “short” version of my résumé which I squeezed into one page by omitting the Awards section and removing some skills.
Second, I wanted to know how my grades affected the résumé. Obviously I couldn’t start making things up, but since my major average differs from my overall average by a good margin, I had two numbers that I could use truthfully with a subtle change in wording.
Résumé variations with different grades
Finally, I wanted to test whether it pays to include social media links on the résumé. I chose GitHub, LinkedIn, and twitter as the links to test. GitHub was an obvious choice because it emphasizes my free-time projects. LinkedIn seemed like a good one to test, given that it is for professional networking. I chose twitter as another variation because I was curious to see what the reaction to a more personal social networking site would be. All résumés linked back to my blog as well. Finally, I had another resume which linked only to my blog, as a control group.
Résumé variation with a link to GitHub
In all, these three variations resulted in 16 unique résumés. Fortunately I didn’t have to create them all by hand. I was already using LaTeX for my résumé, using one of the elegantly typeset templates from The CV Inn as a base. I simply threw my latest résumé into a Mako Template and wrote some python code to spit out the 16 possible variations of the LaTeX code. Then I used pdflatex to create pdf files. Since I was putting the résumés online, I made a landing page. To keep things simple, the landing page was just an image version of the résumé with a link to download the pdf, and just enough CSS to look presentable.
I wanted to track three things: how many people downloaded the résumé, how many people scrolled to the bottom of the landing page, and how many people visited my blog. The first I accomplished by logging downloads. The second I accomplished with jQuery and an Ajax callback. The third I accomplished with a tracking image, just like hit counters in the 90s. I used IP address and cookies to match up actions with the associated résumé.
The only remaining problem was how to get hundreds of people to see my résumé in a short period of time. Fortunately Google offered me $110 in AdWords credits as a Google Analytics user, so I took advantage of that and ran ads on Google searches. Here is one of the half-dozen variations I ran:
One of the Google ads I ran
Results
After less than a week, I managed to exhaust my AdWords budget and gather a fair bit of data. I wrote a few hadoop jobs with my new toy and then brought the data into R for analysis and visualization.
Length
As you might expect, the people who encountered the short resume were much more likely to scroll to the bottom. Just over half did, versus just under a third of those presented with the long resume. This makes sense because there is less to scroll through, but it was nice to have the data confirm my suspicions. Note that in the following graph, and all others in this post, the grey lines indicate the 90% confidence interval.
The short résumé also resulted in more downloads and blog views, but not enough to be statistically significant with the amount of data I collected.
Grades
The grades shown on the résumé didn’t affect any of the metrics I was measuring in a statistically significant way.
Links
I was surprised to find that the non-blog link shown on my résumé affected the frequency of click-throughs to my blog. Even adding a link to my GitHub profile more than halved the frequency of a clickthrough to my blog. LinkedIn and twitter were even worse.
I created a heatmap-like visualization from the relative significances of each link to each other. For example, the upper leftmost cell means that it is 97.2% likely that if a sufficiently large group of people were exposed to each of the LinkedIn and blog-link-only versions of my résumé, the group that saw the blog-link-only version would visit my blog more. Jesse E. Farmer has written more about the details of how this is calculated.
Oddly, the effect was reversed when you consider downloads rather than blog views. The résumés without any social media links were far less likely to be downloaded than those with. Even a résumé with a twitter profile did better than one without, though not by enough to be statistically significant.
The additional links also reduced the frequency of readers scrolling to the bottom of the page.
Conclusion
There are two main things I learned from this experiment. First, I’m going to keep social network links off of my résumé. Although they increased the download rate, they decreased visits to my blog. Since the latter is my priority, I’m not going to start adding social networks to my résumé.
Second, the short résumé did better in every way. However, the improvement in blog views was not statistically significant. For now, I’m keeping my online résumé at two pages, but I will use the one-page version in print.
There’s a number of disclaimers I should make here. For one, even if my findings are true of my résumé, they might not be true of other résumés. Maybe a change in layout would diminish the effect of linking to social media profiles, or make the longer résumé convert better. I should also point out that I have no way of knowing who my audience was. They probably weren’t all in a position to hire a programmer or data scientist, so the factors that make them visit my blog may or may not have the same effect on those who are.
And finally, a shameless plug. I’m looking for an interesting data science internship this fall (September to December 2010). If you’re doing cool things with data, I’d be glad to hear from you. My contact information is in the sidebar.
It would have been interesting to also measure resultant visits to your social media profiles. While a visit to your twitter or linkedin is not that useful, I got my current job primarily on the strength of my github.
I actually did measure this, by redirecting those links through my server. Unfortunately the clickthrough rates were too low for any statistically significant results.
Pingback: How One Data Science Student A/B Tested His Resume « Ed Lee's Blogging Me Blogging You | @edlee
this is an interesting exercice and I applaud the effort
but imho for job-hunting, what works best is first deciding in what industry and what technology you want to work on, then finding 2 or 3 companies in that industry where you best fit, and then do everything you can to get in there.
very efficient, especially if you are expert in a unique technology
my .02
+1
Stephan
Regarding the length of the resume, it seems that it would be relevant to know whether scrolling behaviour actually changed for the long version. For example, if your short resume is 2/3rds the length of the long resume, I’d want to know whether the length somehow changed how far the reader actually scrolled. Perhaps readers of the long resume tend to scroll past the 2/3rds mark, which means the long would have some advantages. For example, if the long version tends to be scrolled to the 5/6ths mark, then you could plan content accordingly and still present more than you would be able to in the short resume, even though readers tend not to scroll all the way to the bottom.
Paul. I Enjoyed this.
Why bother with a resume at all? Just point them to this blog post. If they cant see your potential, then they are not worth working for.
Maybe that was the plan from the beginning ;-)
Versus, not verses
Embarrassing, thanks.
But how many job offers did you get? :) I’d love to see the same type of experiment w/some unique email addresses so you could track how many people follow up.
I could also see this being a very cool resume service to offer. Give people a web form to fill out, then auto-generate a number of different formats. Maybe even track stats for a fee.
I got at least a couple dozen interview offers, but they were from the post, not the resumes directly. I did use a unique email address for each of the 16 variations, but not enough people contacted me for the data to be useful.
To me it makes sense that more links => fewer blog visits & more downloads. When the blog is the only link, people are more likely to follow it. When there are multiple links they will either (A) click only one of them—meaning fewer hits for the blog—or (B) skip the work of following multiple links, instead downloading the résumé for a (hopefully) concise overview of your qualification.
I also agree with Heri: online résumé posting is generally one of the least-efficient ways of finding a good job. In my experiences you get lots of noise from mindless recruiters; and very few of the really good recruiters even look online for candidates. They find people by asking people they trust.
Neat experiment, in any case. Thanks for posting it.
Wow, a guy who can geek on data AND he has a delightful personality! You’re going to go far Paul!
Good luck with your internship,
Donna
Pingback: La veille du week-end (huitième) | LoïcG
Excellent experiment Paul! I was considering creating a website with links to all my online profiles. I figure I am going to eventually get stalked/name checked on google by online recruiters anyway so why not make it easier for them and add links straight into a resume. Your post has enlightened me! Cheers :D
Excellent post. Nice job.
Regarding the scroll rate – Were your social network links near the top, where a user would not necessarily scroll down if they clicked on one? My experience is that people like to click on links, regardless of their importance, and perhaps this impeded the scroll percentage. Just a thought.
I LOVE this. Will you marry me?
Paul,
We recently had a senior executive named Malcolm Holt on the Gold Coast in Australia advertise himself on the radio looking for a job. He’d applied for over 400 jobs in the last 18 months and been knocked back every time and it caught my interest as he hadn’t taken care of the simple things. You’ve taken it to a whole new level by testing your resume & I think it is fantastic, good luck to you in the future.
Al.
This is an extremely interesting exercise – thanks for sharing the results with us!
Hi Paul,
Cool article. Interesting report.
Question.
* Did you use the R package
ggplot2to draw the histograms for the frequency distribution of the blog view rate by link? ( -or, did you just use the R base graphics?)Thanks,
+ Elliot
Wow, you actually did something tangible that career consultants wouldn’t even bother! And also, great blog man!