3 steps of marketing measurement: Design, collect and measure
October 15, 2020To measure average speed of a car halfway through a given distance it is critical to design activities that account for this measurement objective. We want to take actions and measure their impact – scientifically.
More often we are interested in measuring the impact of our actions – and doing this scientifically requires some planning. To measure average speed (of a car) halfway through a given distance, we should mark the midpoint and should have a clock. To measure conversion through a print catalogue and to compare that against the same from a digital catalogue, the design of the catalogues should allow you to identify the source of conversion and should be able to differentiate between print and digital. While these measurement activities can be done in numerous ways, what is critical is to design activities that account for those measurement objectives.
Here is a three-prong construct to help designing marketing activities in order to effectively be measured.
Design to collect
Let’s take an example of measuring impact of a catalogue (print / digital) on customer conversion (buying). In some cases, a customer may see the print catalogue first and then jump to digital channels (e.g., uses an app to buy online). Ideally, these activities are to make the conversion (buying) easier for a customer. But that would also create ambiguity in terms of which activities to be attributed for conversion (in this example, print or digital catalogue). This introduces the concept of activities sequenced to drive a customer behavior in certain direction, also known to us as “customer journey.”
The role of analytics in designing these activities is critical. The design should include what is intended to be measured. This is where the third prong of the construct (measure) drives the first (design).
We have seen vanity URLs and unique 800 numbers used to handle this challenge. But those involve other issues – for example, cost of registering different 800 numbers, possible confusion to customers with different 800 numbers/URLs, losing catchiness and simplicity, etc.
With modern digital innovations, collecting parameters at digital channels for direct marketing is no longer a challenge. Many technological supports (software/platforms) do collect measurement parameters as out-of-the-box capabilities. There are other considerations here, but let’s hold those thoughts until we reach the third prong.
Collect to measure
An effective first prong of this construct would make this step (collect) simple and purely operational. This would then be nothing but populating a table with data for which structure was created in the first step. Alas, life is never so straightforward. Often we fail to design accurately, mostly due to ever-changing priorities and market dynamics, which leads to some retrofitting-type marketing activities. Since those activities could be tactical and opportunistic, we won’t further discuss them here, but we should consider that granularity of collected information and data is critical in bringing adoptability against the ex post changes in the measurement requirements.
However, a broader question would be, can we “time to market” the process of designing and deploying (collecting)? This can be substantially achieved by squeezing the time needed to design and closing the gap between design and deploy. Ideally, we should be able to design quickly based on the business objectives and deploy immediately once designed. (https://www.sas.com/sv_se/customers/ica-banken.html)
Measure to improve
Here is the piece of the puzzle that has gone through tremendous research and has significantly evolved in recent years. AI and machine learning based algorithms are also being used for attribution analysis. Storage capacity and processing speed are no longer constraints. Traditional methods like first touch or last touch attribution are not lucrative enough to modern marketers; they are now looking for algorithmic approaches. And why shouldn’t they – customers’ expectations are changing faster than ever, and businesses are competing for their attention. Any additional insight to recalibrate the customer engagement process would add significant value. My colleague Suneel Grover has blogged about some recent advancements in attribution measurement.
Quest of sophistication in this part creates newer challenges in designing the (sophisticatedly) measurable activities. Data scientists have developed attribution algorithms that go beyond the traditional rule-based and typical out-of-the-box methods. Someone willing to use more sophisticated algorithms to measure attribution needs to incorporate elements to collect in the design of the activities.
The whole cycle of our three-prong construct also requires us to follow the principle of agility and should support time to market. I would tend to call this something like “EMAP” – effective marketing attribution principles, which, in conjunction with the three-prong construct mentioned above, would be described as below:
- Flexibility to modify activities and metrics.
- Flexibility to post facto extend measurement and analysis.
- Total cycle time should be quick enough to be able to react based on analysis outcome.
Test and learn is another aspect that requires significant swiftness in the design and execution of marketing measurement but may not truly be categorized as attribution analysis. It was traditionally assumed that only basic measurement methodologies could be adopted in these cases, because added sophistication would delay the results. While this was true until few years ago, advancement in technology has allowed marketers to be detailed, analytically sophisticated and quick, all at the same time. Ball is now in marketer’s court, rather than technology department’s. Those technologies must be in place to enable automated measurement (and attribution) using analytical methods. Furthermore, based on the results, actions should also be automated, which may be picking the most effective variant of content or message.
Attribution analysis in the context of multichannel customer journey
This topic can be considered as an extension of this blog. While the above is not necessarily limited to single-channel marketing activity only, customer journeys across multiple channels and activities bring a lot of complexity into measuring effective attribution.