Reply rate as a better measure than opens for a small list

5 days ago
3 min read

Introduction

Open rate has been the default measure of email for years and it has quietly stopped meaning very much. Privacy features load images automatically, inflating the figure. Others block tracking entirely, deflating it. Two messages with identical real readership can report open rates differing by half, and nobody inside the business can tell which is which.

A reply is different. Somebody typed something and sent it. It cannot be inflated by an automated fetch or suppressed by a blocked image, and in a small business it is also directly useful rather than merely indicative. For lists of a few hundred people it is a better primary measure than anything the platform reports.

1. Reply rate as a better measure than opens is about reliability

The core reason.

Opens are inferred from a technical event that is now triggered and suppressed by things unrelated to reading. Replies are an action a person took. A measure that can move by half without anybody's behaviour changing is not a measure you can manage by.

2. Ask a question in every message

The requirement that makes it work.

A reply rate on a message that asked nothing measures very little. One genuine question, easy to answer, converts the measure into a signal. It also produces the conversations that are the point of the channel in the first place.

3. Reply from an address that accepts replies

The obvious prerequisite.

A no-reply sender makes the measure impossible and tells the recipient you are not interested in hearing from them. For a small business this is a poor trade in both directions. Use a real address that somebody monitors.

4. Count the replies, however few

The scale point.

On a list of three hundred, five replies is a strong result and a meaningful conversation with five people. A percentage understates what that is worth in a small business. Report the number, not the rate.

5. Watch clicks where there is something to click

The secondary measure.

A click on a specific link is a real action and more reliable than an open. It is narrower and it means something definite. Give each message one link rather than several, so a click is unambiguous.

6. Treat unsubscribes as a signal too

The negative measure.

They are unambiguous, they cannot be inflated, and they cluster on messages that misjudged something. As data they are more useful than opens.

7. Use opens for relative comparison only

The residual value.

Comparing two of your own messages sent to the same list in the same period is still somewhat informative. Comparing your figure to a published benchmark is not.

8. Ask people directly whether they read it

The direct method.

An occasional question to a handful of recipients. Ten honest answers tell you more about whether the channel works than a year of platform reporting.

9. Judge the channel on enquiries in the end

The real measure.

Whether people who eventually contacted you had been receiving the messages. That is the outcome, and every other number on this list is a proxy for it.

Open tracking generally relies on an embedded image and is treated as a form of tracking in several jurisdictions, with consent implications. This is another reason to lean on replies and clicks rather than building your reporting on it.

Conclusion

Use replies as your primary measure, because opens have become unreliable.

Ask one easy question in every message so a reply is possible, send from an address that accepts replies, count the absolute number rather than the percentage on a small list, use clicks as a secondary signal, treat unsubscribes as informative rather than as failure, use opens only to compare your own messages to each other, ask a handful of recipients directly whether they read it, and judge the channel finally on enquiries from people who were receiving it.