Blazalek.com

Founders.pl · Episode 3 ·

Subject lines, sender names and tests before sending

For the English dub, select Settings → Audio track → English (US).

Episode summary

What does a subscriber see before opening a newsletter? Wojtek Blazalek joins Wiktor Cyrny to discuss sender names, subject lines and the risk of promising something the email never delivers. A design that looks good in Gmail can render differently in Yahoo or Onet. Wojtek suggests checking whether the message still makes sense with images turned off. An A/B test can show which version readers respond to, though a small sample makes it easy to mistake a chance result for a preference.

To check email deliverability before a campaign, Wojtek sends a copy to seed addresses at several mailbox providers. The results show where it landed in those accounts, including the main inbox, the promotions tab or spam. Sender reputation also depends on what happens after a customer leaves. If sales and marketing work from different lists, a former customer may keep getting offers and mark them as spam.

Host
Wiktor Cyrny
Guest
Wojtek Blazalek
Publisher
Founders.pl

Chapters

  1. 1:33 The subject line and sender name
  2. 3:04 Reading an email with images turned off
  3. 3:36 A/B tests and sample size
  4. 6:47 What can seed inbox tests tell you?
  5. 14:03 Sharing subscriber status across teams

Transcript translated from Polish

Edited for readability. Select a timestamp to hear the corresponding passage. Original auto-generated Polish captions (TXT)

  1. 0:00

    Wiktor Cyrny Wiktor Cyrny here. Welcome to the Founders studio. We’re joined by Wojtek Błażałek, an email deliverability expert. As you’ve seen in previous episodes, this field helps business owners reach their customers and get the results they’re looking for.

  2. 0:20

    Wiktor Cyrny It turns out there are a lot of moving parts in email that we can improve. There’s a lot we can do to get our messages where we want them to go. At the end of the last episode, we said we’d look at what the first sentence of an email should be. Is there a holy grail, a secret formula? How do we get readers to stop at our email when they have hundreds of others?

  3. 0:56

    Wojtek Blazalek I don’t think there’s a silver bullet. We can talk about things the market has found to work well. First of all, personalization. If you have details like a first name, last name, location or other information, using them definitely improves the chances that someone will respond to your message. I’d say that’s fairly common knowledge by now.

  4. 1:33

    Wojtek Blazalek The second important point is to give the email and its content some originality. The subject line is probably the single most important thing that can catch someone’s attention, or fail to. It shouldn’t be clickbait or make a false promise, because that will only work once.

  5. 1:50

    There’s also a little work to do on the From field: who’s writing to us? It’s worth personalizing it, as many brands already do, so you don’t hear from a clothing brand, for example, but from a human being, a specific person. “Kasia in marketing, to be specific.” “For example.” I think both practices are quite widespread now. It’s no secret, but that’s where I’d start.

  6. 2:31

    Wojtek Blazalek Then, once someone has opened the email, both the design and the content have to be appealing, and you need to test it before sending. Gmail, for example, handles most HTML email designs very well, but Onet and Yahoo have their limitations. Desktop email clients display messages differently too. That’s worth taking care of.

  7. 3:04

    Wojtek Blazalek One more point about sending content-rich emails. Mailbox providers block a lot of images these days, and readers have to choose to display them. Make sure the design looks good without them. I’d go for content that isn’t overloaded with images. As for the copy itself, you have creative license. It really depends on the industry.

  8. 3:36

    I’d really encourage people to run A/B tests. “What are A/B tests?” “Say we have a thousand recipients and we’re preparing a campaign. In an A/B test we prepare two versions for two samples. Five hundred people get one message, and the other five hundred get a slightly different one. We learn from which version works better and can use that knowledge in our next attempts, our next campaigns. The results vary considerably by industry.”

  9. 4:18

    Wojtek Blazalek People also run A, B, C, D tests with four or even five creative versions. But bear in mind that you shouldn’t draw conclusions if fewer than a thousand recipients see a particular version. So a thousand might have been a poor choice for my example. The point is not to draw sweeping conclusions from a sample that isn’t statistically reliable.

  10. 4:46

    Wojtek Blazalek Taken together, these techniques give us knowledge and let us learn from our own audience. But we’re talking about reaching B2C customers here, for instance in ecommerce, at a clothing brand. It’s a little different with business customers, such as the customers of software-as-a-service companies that sell software.

  11. 5:21

    Wojtek Blazalek In that setting a message works better, and people are more inclined to engage with it, if it shows what goes on behind the scenes at your company or shares practical knowledge. In my experience, reports and analyses work well. If you run a SaaS tool, it’s worth doing that kind of research with your audience, producing reports and sharing what you learn with your customers. They really like and appreciate it, and it works well.

  12. 5:57

    Wiktor Cyrny Two questions immediately came to mind. I’ll ask one first, because I picked up on testing our emails and that was new to me. Your example was about seeing how recipients react if we change the message a little. Are there platforms or testing tools that can show a business owner how the email will be received?

  13. 6:29

    Broadly, there are two kinds of tools in the area we’re talking about. One kind lets us render an email, generate a preview of how it will look… “In mailboxes.” “In mailboxes. And there are hundreds of different possibilities. The other kind of tool is for the more technical side.”

  14. 6:55

    Do we reach the inbox or go to spam? That’s what seed testing tools tell us. We get a list of a hundred or two hundred addresses and send a test message to them. They’re at different mailbox providers, such as Gmail, Yahoo, WP and Onet. There’s plenty to choose from.

  15. 7:22

    Plenty to choose from. When you send a sample newsletter or another message to that list, the tool gives you a dashboard showing whether the email went to the inbox, Promotions or spam. Those are the two main things we test before sending, or afterwards. When I investigate deliverability, I use seed tests a lot. They’re really the only way to see how mailbox providers are treating our messages.

  16. 8:00

    Wiktor Cyrny So we can make changes before the email goes out. That’s very interesting. I don’t know if our viewers were aware of this, but tools like these really can change how recipients treat our emails.

  17. 8:17

    Wiktor Cyrny My second question is about something we briefly discussed before the interview. People come to you very often from ecommerce and SaaS, companies that make software or applications. Why do you think those two industries in particular come knocking so often? Do you have an answer?

  18. 8:43

    “I think so.” “Then over to you.”

  19. 8:52

    Wojtek Blazalek This is my interpretation, but those companies rely heavily on email. I’d probably divide them into B2C and B2B rather than ecommerce and SaaS. In B2C my business serves a broad audience, the average person I can sell something to or offer a service to. In B2B I have a professional service for other businesses, one that makes a process easier for them or automates something.

  20. 9:27

    Wojtek Blazalek Email works a little differently in those two settings, but it’s an important part of sales and, in B2B, of acquiring new customers. If you send millions of B2C emails, you can run into trouble. In B2B, if you go about emailing prospective customers the wrong way, those cold emails can cause problems too. These are the two main groups of clients I see. I think they come to me because email matters to them, or because they overuse it and send too much.

  21. 10:13

    Wiktor Cyrny I’d like to touch on something that matters to many companies, particularly large ones. Emails sometimes go out in several streams. Different groups in the business, whether they know about one another’s activities or not, sometimes email the same people. That damages the company’s reputation too. Where does this confusion come from and what can we do about it? Do we need to bring those streams together or agree on something across departments? I understand it matters a lot for deliverability.

  22. 11:05

    Wojtek Blazalek What you’re describing happens a lot in B2B businesses. It’s mainly because every department has its own goals and focuses on them. Information may not flow between departments. That’s quite natural to a degree. If you’re in your own silo dealing with your own day-to-day work, that’s what gets your attention.

  23. 11:30

    Wojtek Blazalek Take a typical SaaS company. There are emails we write by hand every day. There are often cold emails intended to sell something, sent before someone becomes a customer. It’s a bit like handing out flyers. Then there are transactional emails. Once someone creates an account, they get an activation link, a password reminder or a notification that something has happened.

  24. 12:03

    Wojtek Blazalek You also have customer success or lifecycle marketing, trying to keep customers from leaving. That can be a separate email stream too. Finally there’s marketing, sending newsletters about blog posts, updates and so on. Every department has slightly different performance indicators, different KPIs and often a different boss. So that separation in how information flows is quite natural, but companies often don’t realize it’s happening.

  25. 12:43

    Wojtek Blazalek One problem is the lack of a common contact list. One department may still be writing to people who have already left. They can get annoyed and mark the email as spam. They’re thinking, ‘I’m no longer a customer. I canceled your service. Why are you writing to me?’ Keeping a list clean in each individual silo is harder than doing it across the company.

  26. 13:11

    Wojtek Blazalek I’d strongly recommend addressing it. I often ask questions during an initial discovery or kickoff call and hear, “I don’t know.” “How do you send your transactional emails?” “I don’t know, I’ll have to check, someone handles that,” and so on. I won’t go into the details, but it creates a lot of problems for the company. They affect deliverability itself and also how professional the business looks to its customers.

  27. 13:46

    Wiktor Cyrny How do we deal with it? What should we do? Call a company meeting and agree on priorities? Of course, the best solution is probably to hire Wojtek Błażałek to set it all up for us, but how do you handle a situation like that?

  28. 14:03

    Wojtek Blazalek From my perspective the best solution would be to create a single source of truth. One place that the different systems and departments check regularly to see whether an email address is still eligible to receive mail and where the customer is in their lifecycle. For example, are they on a trial or have they already churned?

  29. 14:26

    “What do those terms mean?” “A trial user has created an account and has, say, fourteen days to try the service. They receive quite a few messages encouraging them to enter their card number in our dashboard and make a purchase. A churned customer is someone who has left. They might have been a customer for several months but canceled the service for one reason or another.”

  30. 14:59

    Wojtek Blazalek I think the whole company needs to pay more attention to this, especially with the new requirements from Gmail and Yahoo. It can hurt your sender reputation. That can mean fewer new customers, because it becomes harder to reach people on a trial and persuade them to stay for good.

  31. 15:30

    Wiktor Cyrny I don’t think anyone likes getting too many emails from one company. We’ll come back to that in the next episode. I’d like to ask for some pointers. How do you maintain a relationship with customers without annoying them? That may be a difficult question, but it seems very important to the whole deliverability process.

  32. 15:58

    Wojtek Blazalek Again, I don’t know of a single magic solution. It comes back to what we discussed: how you present the message and how frequently you send. Make it interesting, don’t overuse the channel, and send to people who are interested.

  33. 16:22

    Wojtek Blazalek Keep your list clean by removing inactive recipients and addresses that no longer exist. I didn’t mention earlier that mailboxes disappear too. People stop using them, delete them, or the provider closes an inactive mailbox. All of that is part of list hygiene. Then there’s segmentation, which determines which message we send to which group. Add testing, checking what works, iterating and repeating.

  34. 16:50

    Wiktor Cyrny I’ll just add that we talked about segmentation in the previous episode. I recommend it because it shows how to group your audience so the emails reach them and get the response you’re looking for. We also mentioned tests that help you see whether you can improve an email before sending it. If you haven’t seen the previous episode, do take a look.

  35. 17:29

    Wiktor Cyrny We’ll leave it there for today. In the next episode we’ll talk about security: how someone can break into a company through email and how to approach the messages we receive. Phishing emails will turn up regardless. What matters is recognizing when an email is trying to mislead or manipulate you, or get you to do something.

  36. 18:08

    “Please visit our website and watch our next conversation with Wojtek Błażałek. Thank you for today.” “Thank you too.” “Goodbye.” “Goodbye.”