Are you good at conducting heuristic UX evaluations of websites? Do you love paying attention to the smallest of UX/UI details?
We’re seeking two full-time remote UX Benchmarkers for our benchmarking team.
Baymard Institute is an independent research organization, specializing in conducting large-scale e-commerce UX research. In this role you will be conducting extremely detailed heuristics UX evaluations of leading e-commerce sites – and your work will be published to and used by 10,000+ UX designers around the globe.
This position is relevant for people with a couple of years of UX-related work experience.
This is a remote full-time position that you can occupy anywhere. If you aren’t located in EMEA then 2-3 hours of daily overlap with Central European Time will be needed.
The Job
As a UX Benchmarker, you will be joining our team of 6 UX benchmarkers, who collectively are responsible for conducting Baymard’s
UX benchmark databases. 90% of the job will be:
- Analyzing the UX of leading e-commerce sites – this is performed as an extremely detailed heuristic evaluation using a proprietary system and workflow, where Baymard’s research catalog of 700+ e-commerce UX parameters is used as the weighted heuristic.
- Typically you will benchmark 30-60 different e-commerce sites across a subset of the user journey. For example, benchmarking 50 checkout flows for 2 months, using Baymard’s 100 checkout UX guidelines.
- The websites you will be benchmarking are not clients/you will not present each UX evaluation to a single client. Instead, your benchmark will be published to subscription platform Baymard Premium where it’s used by more than 3,000 paying customers (typically UX designers). It will also be partially published for free to our more than 100,000 public readers (here and here).
- Defining and developing new industry benchmarks, where you will perform a focused benchmark on a specific industry, e.g. an electronics-, apparel-, luxury-, grocery-, etc. benchmark (see example).
Depending on your qualifications, other roles will be possible over time.
Qualifications
We’re looking for the following qualifications for this role:
(7/7) Finding attention to detail exciting – in every benchmark, you will be rating 30-50 websites across 100-700 detailed UX parameters. Each of these 700 parameters then has 4-7 defined implementation nuances the evaluation must account for. This requires an extreme level of attention to detail and excitement for exploring the smallest UI nuances of a site. Frankly, you have to be a bit of a “details nerd”. Our best benchmarkers know all 700 parameters by memory. (This skill/personal trait is more important than a lot of UX knowledge)
(5/7) Rigor over time – while the typical benchmark project of 50 sites lasts just around 2 months (you’ll, therefore, roughly, benchmark on a new site every day) – the benchmarking process itself and the underlying UX research dataset doesn’t change that much. So the UX benchmarker role requires that you have a high degree of stability and will find it exciting to look for the same set of 700+ e-commerce UX nuances all year round (although applying that dataset to a very broad variety of sites).
(3/7) Some understanding of UX and user behavior – in this role, you will not conduct usability testing yourself with end-users, but rather be performing heuristic evaluations – analyzing the UX of a website across Baymard’s 700+ parameters/heuristics. This role will require some preexisting experience within UX or usability testing. But because the 700 UX parameters are created by our separate usability testing research team, you do not need extensive work experience within UX design or UX research – but a desire to learn and read 100s of pages of UX research findings will be needed.
(2/7) Good understanding of web-jargon – being able to describe the differences between ‘auto-complete’, ‘auto-fill’, and ‘auto-correct’ on the spot will be a necessity when documenting your findings to our readers.
Each of the above qualifications is weighted, 7 is the highest.
(Note that this is not a UX Designer or a Usability Testing research job. At Baymard we don’t perform any kind of client design or development work. So if you are looking for a UX designer role or a role with direct client relationships, this job is not for you. This is not a UX Researcher/Writer position either, so if you are looking to perform direct usability testing with end-users or want to write Baymard guidelines/articles, this job is not for you either. (Instead, sign up for our job alert as we do hire these types of roles from time to time).
Job Specs
- Salary: In accordance with qualifications, but typically in the range of EURO 30,000-42,000 per year before taxes, contributions, etc., and with 25 days of annual paid time off (invoiced as a contractor).
- Start date: August-September 2021.
- Location: this is a remote full-time position, but if you are not located in EMEA you need 2-3 hours daily overlap with Central European Time).
- Language: intermediary written and spoken English (non-native English is fine).
- Travel: is limited, expect only 0-2 weeks of travel each year (only when the COVID pandemic is over, obviously).
How to Apply
If you’re interested in this position please apply by sending the following documents:
- A cover letter (as a 1-2 page PDF) – describing how you fit the role and qualifications.
- A resume as (PDF file) – describing your background and past experience.
- Any samples or other documents; for example heuristic evaluations you’ve performed, UX-related articles you have written, designs you’ve created, etc.
Send the above to info+uxbenchmarker-2021@baymard.com
The deadline is July 20 2021 - but apply as soon as possible as we often process applicants on a rolling basis. There will be a 10 hour paid hiring test before any interview rounds.
Tip, if you want to prepare the best possible consider:
- familiarizing yourself with our UX Benchmark database,
- watching this video explaining Baymard’s research approach,
Sincerely,
Christian & the benchmarking team at Baymard Institute