Shogun ‑ AB Testing

Hey there, Shenghai. Thanks for sharing your feedback.

We apologize for the inconvenience you faced that has led to this feedback.

I was looking at the use case and your account, and I want to let you know that when you start/run a product details test, we set up a duplicate theme that has all the required adjustments for you to make the changes to the variant.

We then publish this modified theme. You can treat the modified theme as the new main theme moving forward, and modify that in case you wish to modify anything in the theme. However, if you want, once the test ends, you can republish the old theme again.

Also, about the product details, I wanted to check if you had made changes to the description on the original. When you change the product description, you may want to re-run theme modifications if you have already run it on a previous version. This ensures the theme is set correctly and you can make changes to the variant B of your test.

I see you had run a few product details tests previously, and they were all for the same product.

Having said that, we would love to analyze the issue for you and help you better. I have reached out to you via the same chat thread and we would appreciate if you could reply back to us

We appreciate your support.

Sweetan | Client Services
Shogun

Hi there, Thanks for taking the time and leaving us a review.

I am so glad that I was able to help and answer the question. We are here to help and if you bump into any issues, please don't hesitate to reach out.

Thanks for your support.

Sweetan | Client Services
Shogun

Wow! That’s amazing to hear! 🚀 A 12% lift on your best-selling product is a huge win. We’re so glad the new Pricing Testing feature is delivering value for you, and it’s great to hear our support team has been there when you needed them.

Thanks so much for sharing your results. We’re excited to keep helping you grow!

Sweetan | Client Services
Shogun

Hi Tim,

Thank you for taking the time to share your feedback. I’m really sorry to hear how frustrating this experience has been.

I’d like to clarify one important point: we do not publish a theme without your approval. Can you please confirm which theme you would refer to, or would you be referring to the activity log?

Regarding the traffic split you experienced, we completely understand how this impacted your confidence in the test results. As mentioned previously in the email thread by my colleague, James, we have identified cases where bot traffic can skew experiment distribution by behaving like normal visitors. This is something our team is actively working on improving, so test data remains reliable.

We truly appreciate you raising both of these concerns and giving us the chance to investigate and also process a refund for both your invoices.

We'll look forward to hearing back from you on the same email thread so that we can look at the other concerns for you.

Thanks for your support.

Sweetan | Client Services
Shogun

Thank you so much for the amazing feedback! We’re thrilled to hear the app has made A/B testing easier and more accessible for your team. Making powerful optimization tools simple to use without needing a developer is exactly what we aim for.

We really appreciate your support and are excited to keep helping you test, learn, and grow!

Sweetan | Client Services
Shogun

Thank you for the great feedback! We’re so glad to hear you’re finding the app easy to use. That’s exactly the experience we aim to create. We really appreciate your support!

Sweetan | Client Services
Shogun

Thanks for leaving us a review and sharing your feedback. We are glad to hear that you are enjoying the app and having a great experience with our support team.

Please let us know if there is anything else we can assist you with.

Sweetan | Client Services
Shogun

Hi there, Raymond.

Thanks for your patience as we worked through this issue.

We investigated this matter at the time of your posting, and we noted that you had uninstalled the app but had since reinstalled it upon our prompting.

When we tested it again with you some weeks after this review was added, the app was working as intended. We invited you to try running some new tests, as we concluded that we might have fixed the issue you encountered in passing.

I've rechecked now, and it doesn't appear that you've performed any tests since. I invite you to let us know how you get on!

James | Client Services
Shogun

Hi there, thank you so much for leaving us a review.

Sweetan | Client Services
Shogun

Thanks a lot for the awesome feedback! 🙌

We’re so glad the app is making your A/B testing easier and helping you optimize landing pages and offers. Here’s to more winning experiments!

Please let us know if there is anything that we can help you with. 😊

Sweetan | Client Services
Shogun