Shopify SimGym

Provides some useful actionable information, but the support documentation is non-existent (the app points you to shopify for support, which points you back to the app...). I can't figure out how credits are distributed (monthly?) or if you can buy more ad-hoc. There's no information on what the difference is when specifying different target areas for a simulation (i.e. if I select to focus on cart and home page, does that mean I'm getting less quantitative or qualitative data?), there's no way to export simulation results, and there's no way to customize simulation shoppers (I had several searching for products I don't carry, and the recommendations were entirely unhelpful for providing alternative products. This was basically a waste of a credit since I can't provide information regarding my average shopper and ideal shopper). It's a cool concept, but kinda poorly executed.

cool concept for the beta. it needs an export function as I'd love to take all the individual agent experiences and compress in LLMs and actually turn it into something useful

Creates an anomaly in your traffic in google analytics, including conversion tracking like add to carts and beginning checkout. Very frustrating that this distorts the analytics, this should be made clear. Also, I think this is only useful if you're making massive theme changes and comparing two very different user experiences.

的確なアドバイス（改善点）を出してくれたと思うところもある反面、不具合のような形で書き出された部分を確認したところ動作になんの問題もなかったという点が複数あった。
具体的には、「フッターのリンクを複数ユーザーがクリックしてもページが切り替わらない為、改善をしてください」という旨のレポートが出ていたが、実際に動作確認をしたところ正しいリンク先へ問題なく遷移している。ということがあった。

Tremendous potential - but pay attention to your target audience, Shopify. Much of your value proposition centers around small to medium sized businesses who don't have access to highly experienced web teams - the very thing that makes Shopify so wonderful! These results from these simulations are useless without easy execution paths both understandable and executable for the average Shopify user.

Review submitted during Preview / Research period

Pretty cool, gave some amazing insights, the different personas are useful, so you can tailor you UI and experience to different customers

It's frustrating that you can only go ahead with a simulation when two themes are set, sometimes I just want to check my current theme, instead of A/B testing

Complete garbage!!! Did not understand my brand at all, searched for things we do not even sell, and insisted that our search was broken. Also, claimed our Checkout button is broken, when it is clearly not. I can go on BrowserStack and check it across multiple devices and browsers and clearly see that the Checkout button works. Maybe bots are too dumbs to figure out how to checkout. Overall, a complete waste of time. No one should ever pay for this app for any reason.

While the concept is novel and I really like the partial results, I couldn't get the full report. One of the bot instances got stuck, which stalled the full report. There was no way for me to terminate the rogue bot and finish the analysis.

Really good, but would be great if we can export the full audit in PDF or any other format to share it with developers.

bots cant access store, no support. waste of time.