Neat A/B Testing is ideal for any simple AB testing hypothesis you'd like to conduct. Recommended for small businesses that want to test things fast and need an easy UX. One important factor to consider is that Neat A/B testing doesn't split the traffic, but rather allocates 100% of the traffic to version A for a specific amount of time, and then to version B. Overall a great app for small business who don't need to test really complicated scenarii and need an effective support team to help.
We thank you and appreciate you taking the time and writing us a review!
We are excited to hear that the tool is simple and easy to use. We designed it to be very user-friendly and intuitive so we love to hear the UX is fitting this goal.
We appreciate the feedback on the 1-hour test window. Depending on the test, we do split traffic! For those tests that don't, we offer 1 hour, 4 hours, 7 hours, and 24 hours so the merchants depending on their traffic can pick what is best for them!
We look forward to continuing to work together and providing best-in-class customer service!
All the best,
Randy Silver - Chief Revenue Officer of Neat A/B Testing
Both the draft and the test kept crashing the system. I could never even set one up. They clearly are not ready.
UPDATE This team reached out to me right after I left a one star review offering to help. That's why I gave them as second chance. I respect that kind of commitment.
I have used them extensively since then. It works well.
Things I would like them to add:
1) Factor in cost of goods and create an ROI calculator
2) Make it work on all mobile devices. It's too inconsistent on mobile so I have to use it solely from desktop.
When I first began using this app, it was newly released (I was the first person to review it). I encountered some significant issues that impacted use and told the developers, and they were EXTREMELY responsive and began making modifications to resolve issues that same day. Some of the things that were immediately improved:
-Ability to create a draft test (you can draft an alternative product page, for instance, and save it to continue working on it later)
-Ability to draft test in both html & rich text
-Better instructions on how to stop test / select a winner
-Improvements to workflow and UX
It still feels a little rudimentary and could benefit from some better user directives (guiding a beginner through the steps with some more direction rather than relying on the help section to be used as an instruction book) but I think it's going to work ok. If you run into any issues, rest assured that the developers are VERY responsive. There is also a pretty well written Help section that will provide answers and coach on setting up tests, achieving statistical significance, and the theory behind A/B testing.
All in all, Neat AB currently fills a gap for performing split testing within the Shopify system. I'm sure the developers will continue working on it. In the meantime, I'm running some tests and will probably set up a few more, and hope to update this review after more time spent with the app.