I added an email subscription opt in popup to this blog back in February.
I wanted to find out what effect that actually had on the blog and if it was even worth having.
Personally I find them annoying and interfere with the user experience, but that’s just an opinion.
Let’s settle this with cold hard data!
Creating My Popup
I took one of the templates that came with the plugin and modified it slightly.
I updated the font colours to match my branding and added a couple of award images.
I think its looks pretty good, spells out the deal clearly with a clear call to action.
It is setup to pop after 7 seconds which gives readers time to fully load the page and begin reading.
Closing the popup will prevent it from opening for another 24 hours. If you subscribe you never see it again.
How To Setup Your Own Email Popup
At first I tried to use the premium WPSubscribers plugin and was shocked to find it was not compatible with any caching plugins.
When I get in touch with the developer he told me it wasn’t possible with this kind of plugin – I knew he was lying.
Eventually I came across NinjaPopups which costs just $18, is compatible with caching plugins, is bundled with lots of themes and has some cool features.
It can be used to create opt in popups, opt in lockers, social lockers, exit popups, page specific popups and a bunch of other stuff.
Certainly get a great amount of bang for your buck! The developer is super helpful as well.
It takes minutes to setup-
- Upload the plugin & activate it
- Go to Ninja Popups > Settings
- Configure to your liking – I disable it on mobile devices
- Make sure you connect Aweber or whichever service under the Mailing List Manager
- Go to Ninja Popups > Add New Popup
- Select a template & theme
- Configure the other settings (see below)
Here are the exact settings I use for the popup on this blog.
Click on the image to get the full version so you can see them all!
But Is It Actually Worth It?
So what measureable effect has adding an email subscription opt in popup actually had on the blog?
I deployed the popup at 9pm on the 28th February 2013.
I’m going to compare before (Jan 9th-Feb 27th) statistics with after (Mar 1st-Apr 19th) which are 50 day periods.
I’m also going to segment this based on new & returning traffic.
New traffic has technically never seen the site before – this is their first impression.
Returning traffic – I love you guys, you keep coming back for more – I better look after you!
The Engagement Effect
First of all let’s take a look at how it affected engagement statistics like pages per visit, visit duration and bounce rate.
|New Before||New After||Returning Before||Returning After||Total +/-|
Well thats not great now is it!
Does that popup put people off to the tune of 9.5% across the critical engagement metrics?
Perhaps the increase in conversions will make up for it.
The Conversion Effect
So if its doing that much damage to the user experience, what is it doing for conversions?
Lets find out!
Before The Popup
Note: On the 7th February I activated a plugin that added every comment submission to the email list. That ended up with a bunch of junk emails on the list from spam submissions.
I had to clean up the data from Feb 7th-12th – luckily I setup ad tracking so know precisely where each subscriber comes from or this test would have being up a creek without a paddle.
After The Popup
What Does It All Mean?
So before the popup I had a conversion rate of 0.85%
After the popup I had a conversion rate of 1.23%
That’s a 44.71% increase in conversion – pretty good right?
But what does that actually mean in cold hard subscriber numbers-
|Visitors||# Subs Before||# Subs After||+ / -|
Adding the email subscription opt in popup had a noticeable effect in a few areas.
Last month my blog got 13,487 unique visitors, based on the numbers above I would have got 114 subscribers without the popup and 166 with it.
That’s an extra 52 subscribers from the same traffic.
However that comes at the cost of you guys dropping 9.29% pages/visit, 10.2% visit duration and 9.02% off the bounce rate.
That is certainly not in line with the conversion increase Darren Rowse saw way back in 2008 but I suspect that is because over that time we have become ‘popup blind’ and they have lost the impact they once had.
Plus his stats were from a photography blog which is much more likely to be receptive to the popup when compared to the seasoned internet marketing niche who see them on every other site every day of the week.
I also have to factor in how the other opt in boxes perform across the blog-
Just for reference, About is from the about page, EndPost is at the end of every post, IncomeReport is the income report page, Inpost are the inline optin boxes, Sidebar well you can figure that one out.
The pop up is by far the best performing site wide email subscription option at 1.23% – but I don’t think the increase in conversion is worth the trade off in engagement metrics.
I’m going to spend some time tweaking the settings of the popup as well as the design & copy to see what can be done to increase conversion.
At 60-70% it would become worthwhile based on my site and my traffic and sometimes changing just 1 word can have that impact.
Should You Add One To Your Site?
Ninja Popups allows you to quickly and easily increase subscriber conversion on your blog.
When you’re starting out every subscriber counts, so that 44% increase in subscriber conversion is important.
Note: When someone has joined your email list you have earnt their trust and respect – don’t abuse that!
I believe this technique is much more effective in any niche that isn’t related to internet marketing or making money online.
Especially if you have a great proposition! Which I don’t really.
There are also a lot more things you can do with NinjaPopups over and above what I have shown you here.
As I try to fine tune the subscriber conversion number (even with the popup at 1.23% its poor) I’m going to try things like-
- Add an email locker to part 2 of the tiered link building tutorial series
- Add an email locker to the income reports with a 60 second delay to get the hook first
- Tweak the forum to include inline opt in forms after the opening post
- Tweak the copy & design of the existing popup to boost conversion further
- Offering an exclusive resource of some type
If you do add a popup to your blog, make sure you add a note/annotation in Analytics so you can easily compare the before/after yourself!
Test, test, test!
What are your thoughts on how the increase in conversion caused a drop in engagement?
Is the 44% increase in conversion worth the 9.5% drop in engagement?