{"id":46246,"date":"2021-09-28T07:55:00","date_gmt":"2021-09-28T06:55:00","guid":{"rendered":"https:\/\/mediamakersmeet.com\/?p=46246"},"modified":"2021-09-28T09:42:34","modified_gmt":"2021-09-28T08:42:34","slug":"how-to-compare-data-analytics-tools","status":"publish","type":"post","link":"https:\/\/mediamakersmeet.com\/how-to-compare-data-analytics-tools\/","title":{"rendered":"How to compare data analytics tools"},"content":{"rendered":"\n

More and more publishers are asking us the same question: just how do you compare analytics tools? How do you know you\u2019ve got the most important things covered? What is good, and what is good for us?<\/strong><\/p>\n\n\n\n

So, based on the experience we\u2019ve gained in the last decade, we thought we\u2019d write a small guide.<\/p>\n\n\n\n

What not to do<\/strong><\/h3>\n\n\n\n

When comparing tools, there are a few things that can often go wrong<\/a>.<\/p>\n\n\n\n

When people find they\u2019ve made a bad decision, it\u2019s usually because only one department made the decision – and they didn\u2019t have a good checklist in place for what the company as a whole actually needs.<\/p>\n\n\n\n

Going for the cheap option (or the one everyone else has) can often be an expensive mistake too: often the buying process can be too one-dimensional and off-the-shelf, while looking simple, actually doesn\u2019t address the issues you need sorted.<\/p>\n\n\n\n

Keep in mind that although analytics are an important practical asset, they also have a deep strategic impact on an organisation as well. In this day and age, data is critical, and if it\u2019s a disaster it can have serious everyday and long-term consequences. And we don\u2019t mean the funny ones.<\/p>\n\n\n\n

Know yourself-categories<\/strong><\/h3>\n\n\n\n

To choose the right data analytics tool, you have to look in the mirror first. That means, first know thyself! Connect your buying plans to your workflow, technical depth, business strategy and use cases. Let’s run through the most important self-reflection categories:<\/p>\n\n\n\n

– Strategy and ambitions<\/strong><\/p>\n\n\n\n

We\u2019re always a bit surprised that this point needs to be made, but believe us, it does: it\u2019s extremely hard to pick data software when the overall strategy is unclear. So ask yourself: what is the business model? What are the shared success metrics? Do your people and your company show ambition in using insights, or is it a hygiene decision for now? Also, because you really don’t want to be switching your analytics every year, where does the company stand in 3 years’ time? Will you have outgrown the tool you\u2019re looking at then? Can it grow with you?<\/p>\n\n\n\n

– Use cases<\/strong><\/p>\n\n\n\n

Based on the strategy, what are the data and insights being used for? It might be the case that your editorial team isn\u2019t ready to create these yet, but it\u2019s worth getting a couple of use cases ready so you can ask the analytics company how they would support these situations, issues and challenges. Don\u2019t be afraid to ask questions about whether they have experience of these things with other clients. They should know – or be prepared to find out.<\/p>\n\n\n\n

– People and culture<\/strong><\/p>\n\n\n\n

We all know that culture eats strategy for breakfast, and this is especially true for media and marketing. So selecting a nice tool does not necessarily mean that it will be well used. It needs to be a good fit.<\/p>\n\n\n\n

Do you have data-hungry people in the newsroom, or are they implicitly telling you that they will not spend a lot of time on it because they ‘like their creativity’? Is it part of the culture to use data to improve, to justify actions, or to judge? And, while we\u2019re on the topic, who will be the users: management, editors, marketers, analysts? All of them? The answers to these questions mean a lot on the level of data detail, or the simplicity of the interface that might suit you best.<\/p>\n\n\n\n

– Your tech stack<\/strong><\/p>\n\n\n\n

Modern analytics tools don’t usually work in splendid isolation anymore – and that is a good thing. They will sometimes get numbers from your workflow systems, but they can also enrich your data. Know what data you have, what the quality is, and more importantly: what you are missing. Are the systems that are enabling the connection old and rigid, or modern and flexible? Tip: buying a good analytics tool can often save you money by replacing parts of that.<\/p>\n\n\n\n

– Budget<\/strong><\/p>\n\n\n\n

You have that secured right? And it is a simple and clear decision-making process? Everybody understands the business case, right? Thought so. Just checking.<\/p>\n\n\n\n

Ask the tool-categories<\/strong><\/h3>\n\n\n\n

Now, powered by all that self-knowledge, you are ready to ask the right questions to the analytics company you\u2019re interested in partnering with. We will give you a more detailed checklist later on, but they mostly fall into these main categories:<\/p>\n\n\n\n

– Company vision and culture<\/strong><\/p>\n\n\n\n

First of all, ask yourself: is the analytics company an organisational fit? Are you both funky, innovative, creative companies, or more serious? Do you have the feeling that the people behind the tool understand your use cases, your mission? Do they come from your industry? Do they have the values and the do-good philosophy that speak to your heart? During implementations, issues or advice sessions you will be in contact and it is important that it just feels right.<\/p>\n\n\n\n

Pay also attention to the mission of the product company. It is quite telling to see if they are just optimising and selling the tool, or whether they have an ambitious roadmap. What is the real difference between the diverse analytics companies in approach, and do you like that?<\/p>\n\n\n\n

– Data and channels<\/strong><\/p>\n\n\n\n

Of course, this is pretty basic stuff: what exactly do they measure? Which channel or story metrics will be displayed and do you really need that? It is important to avoid the \u2018black dog syndrome\u2019 here. While you might think you\u2019re both talking about the same animal, one could be thinking of a pitbull, and the other of a poodle. You don\u2019t want to discover this when it is too late. If it is crucial data, be as precise as possible in your definitions. And ask how the data is measured and collected.<\/p>\n\n\n\n

– Data flow and delivery<\/strong><\/p>\n\n\n\n

If you know your metrics, it is worthwhile spending some time on the actual delivery of data. This, in our experience, is where silly mistakes can be made.<\/p>\n\n\n\n

How realtime is realtime? Does the data refresh every 10 seconds or 5 minutes? Speed in essence is good, but can lead to its own inaccuracies and increased data costs. Does the system have an API to get data in your data lake, and when are the daily reports really ready to be received in your mailbox? Can the data be automatically placed in your internal communication channels or CMS? In the end, these variables will play an important part in your experiences with the analytics tool.<\/p>\n\n\n\n

– User interface, features and use cases<\/strong><\/p>\n\n\n\n

The way the data is served to users is the most underestimated aspect of analytics. While all the data is there, a boring or simply clumsy user interface can turn any newsroom off. Interfaces – especially if the newsroom uses it – should be tailored towards use cases, towards concrete decision making. Actionability<\/a> is the key word here – graphs, numbers, lists, they should all point to action. In the right place, to the right person, at the right time.<\/p>\n\n\n\n

Do you need data to be realtime, or rich and historical? Do you believe that notifications<\/a> can make a big difference in activating storytellers? To make predictions? It can be all kinds of things. But remember: the system should not only give you data or even insights, it should energize and empower your team to make things better.<\/p>\n\n\n\n

– Customisation, growth model<\/strong><\/p>\n\n\n\n

Maybe you have seen a really nice analytics tool, but it turns out to be really static. Chances are, it\u2019s a one-size-fits-all, and has no possibilities to align itself to your workflow or technology or culture. Think hard about which customisations are necessary, and if the system allows you to be in the driver’s seat. On that note, it can be a great asset if the tool can slowly grow with your organisation; start with simple features and gradually build up possibilities into a more advanced model? Can you take your team by the hand and save budget at the same time that way?<\/p>\n\n\n\n

– Security, privacy and safety measures<\/strong><\/p>\n\n\n\n

A SaaS solution can be funky but it always needs to be safe. Ask about security measures, hashed data and compliance with GDPR. Maybe your data cannot go out of Europe? Data will be the blood of your organization, don\u2019t cut costs on this aspect.
And also: if there\u2019s a disturbance, does the analytics company make the effort to recover the \u2018lost\u2019 data? The answer can be quite telling.<\/p>\n\n\n\n

– Implementation and onboarding<\/strong><\/p>\n\n\n\n

Media companies and marketing companies usually ask a lot about the implementation efforts. They are usually short on time, understaffed, and they don\u2019t want to depend too much on the goodwill of their tech departments. The technical implementation shouldn\u2019t be too complicated. Totally understandable, the code speaks first. But don\u2019t forget to ask questions about people. For example: do you get a lot of implementation assistance and are user training sessions included? You shouldn\u2019t feel like you\u2019re being left to get on with it alone.<\/p>\n\n\n\n

– Assistance<\/strong><\/p>\n\n\n\n

To some of you it might sound counterintuitive, but in the end, story data is all about newsrooms, strategy, and daily tactics. It is the business of people. And it can make all the difference if you know that you can count on each other. Is there extra advice or data science available, to make a more complex diagnosis on your performance? Can you call them in the middle of the night, if something is really off? Do they have e-learning? We always tend to think you can judge that by the amount of questions the analytics company asks you, to really bring that value.<\/p>\n\n\n\n

– Additional benefits<\/strong><\/p>\n\n\n\n

Next to these basic factors, some other benefits can be at play. Maybe the provider speaks your specific language or lets you cooperate with another strategic client of theirs. Sometimes it might be possible to be part of a lab setting<\/a>, where you can try out stuff and give more feedback in return for a lower price.<\/p>\n\n\n\n

– Roadmap<\/strong><\/p>\n\n\n\n

And if some of the stuff that you want isn\u2019t there, it might already be on the roadmap, so ask if it\u2019s part of the ideas they are working on – and if it isn\u2019t see if they\u2019ll consider adding it! Make a list of your need-to-haves and nice-to-haves and compare that to their roadmap. Please feel free to ask what’s in store for you. It might be an estimate, but in any case it will give you an interesting insight in the future of analytics.<\/p>\n\n\n\n

– Price model<\/strong><\/p>\n\n\n\n

This isn\u2019t just about what your budget will allow; it\u2019s also about the price model in general. Do you pay a flat fee license price or do the costs go up when you grow? What happens if your organisation wants to measure more brands or channels? Are more users automatically welcome? That could be a vital point as you are trying to include the whole newsroom or marketing department in the data strategy.<\/p>\n\n\n\n

– Pilot<\/strong><\/p>\n\n\n\n

After you have convinced yourself that this or that tool is the right one for you, a lot of digital publishers insist on doing a (paid) pilot or at least a trial period in the contract. Analytics companies that are confident about their product will not have an objection to that, so it can be a good idea to minimise some risks in adaptation, whether they\u2019re technical or cultural. But be mindful of the effort and money that goes into this. A couple of tips to be as efficient and effective as possible:<\/p>\n\n\n\n