question

Kevin@Amazon avatar image
Kevin@Amazon asked

Live App Testing Tips and Tricks

[b]Live App Testing (LAT)[/b] allows you to test your app, the integrated APIs and even In-App-Purchasing in a live environment with a limited number of testers before you publish to the full Amazon marketplace. You can find a general overview of the service here: https://developer.amazon.com/public/resources/development-tools/live-app-testing *note: only account Administrators can 'End' or 'Promote' a LAT.

Below you will find a more detailed set of issues and resolutions that you may find helpful.

[b]App Availability[/b] - LAT is not available for users in China – The developer can be located in China and use LAT for testers located in other countries. However LAT cannot be used for any testers in the China marketplace, if you select ‘worldwide’ for distribution for your LAT we will automatically deselect China for you. *note also that if you have sent an invitation to a tester that has an Amazon account associated with the Amazon.cn marketplace they will receive an invitation, but will NOT be able to download the test app version from the CN marketplace. -At the end of a LAT the developer has the option to ‘END’ the test, ‘EDIT’ the test or ‘PROMOTE TO UPCOMMING’. For ‘Promote to Upcoming’ note that the developer will still need to ‘SUBMIT’ (orange button) the version to the Appstore for testing and publish. [b] Tester did not get invitation[/b] - Invitations can go to any e-mail address and does not have to be associated with an Amazon.com account. • If the address is associated with an Amazon account, and the user has opted out of E-mails in ANY marketplace we DO NOT send the e-mail. User can go to amazon.com>Your Account>E-Mail From Amazon>E-Mail Preferences & Notifications>Select ‘Send marketing’ for all markets associated with that e-mail address. • Notification will be sent to the developer with e-mail status. This status will only show the number of invitations sent, and the number of invitees opted out. It will NOT show who the actual e-mail address are. • The minimum category to receive an invitation is ‘Amazon Appstore’ • If a user e-mail address is associated with another Amazon market (Amazon.com and Amazon.fr for example), note that ALL need to be set to receive notifications. If one market is set to not receive, than all will fail. • If the user happens to be logged in to Amazon.com (with any user account) and accept an invitation (with the on-time invitation link), the actual Amazon.com e-mail address associated with that logged in user is what is used for the users LAT (the e-mail address used in the original invitation is overwritten). If this is not acceptable for the user, the developer needs to remove the original tester invitation, and invite them again with note to NOT be logged into ANY Amazon.com account when accepting an invitation. • Note that LAT has a cap of 500 users.

[b]User experience for if tester owns Live app[/b] - Tester is invited and purchases LAT version of the same app (same package name) – manifest version of LAT version is higher than that of Live version (Android mandates this in order to allow the install). * note that if developer does not increment versionCode the tester will not see an LAT version of the app to update. - Tester installs LAT version – no state is lost – LAT version of app is still pointing to the local and server storage of Live app. - Tester is done with testing – Tester wants to go back to the Live version of the app - Tester needs to uninstall the LAT version in order to be able to install the older Live App Version (manifest version is lower) – on uninstall the local storage is deleted - Tester installs the Live Version. [b]LAT and Developer Portal can become out of sync[/b] - When you are creating a LAT, the system will copy the current Live version data to create the LAT version – this copy/sync happens only once. This essentially creates branch, and any updates to the current Live version will NOT be reflected in the LAT version. If the LAT version subsequently is promoted to upcoming, the data in the LAT version is what will become the actual Live version. This is expected behavior for any branched code, but worth noting.

[b]I do not see my LAT in Cloud tab[/b] - The developer or user may need to click sync to pull in the new version - The user will need to verify need to have accepted the E-mail invitation and received a confirmation. - The user might not have a compatible device. For example a min SDK level of 15 and user has an SDK level of 11. [b] LAT app version overwrote Live app version[/b] - If you have used the same packageName it will overwrite the Live app if installed – this is a standard Android function. To resolve, the user needs to reinstall Live version from the cloud tab. Test version icon will have ‘test’ badge.

[b]LAT uses the same App Key and Security Profile as the Live Version[/b] - Note that metrics, reporting etc. will be tracking LAT version as well. This will impact your user metrics, Mobile Ad impressions for example. - Actual app sales are broken out and will not accrue revenue for LAT versions, the app price will be set to $0.00 for all LAT app sales. IAP sales are also automatically set to $0.00 (Live app IAP items are not impacted). Pricing info will not be able to be tested. - Mobile ads will be the same for LAT and Live versions as you would be using the same App Key. All reporting will reflect the LAT version and is not broken out. - ADM will function the same as the Live version as it uses the same key. Separate testing for ADM is not feasible for LAT versions. - Mobile Associates will function the same as the current Live version. Separate testing for MAA is not possible for LAT versions. - Analytics API will incorporate the LAT and Live versions, this is not broken out. - A/B testing will function/ report the same as the Live version. Separate A/B tests for LAT versions are not feasible unless a new identifier is used.

live app testing
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

lonebuyer avatar image
lonebuyer answered
Hi Kevin, can you edit your post and fill in ? Also, can you provide step by step info on how to do live testing of an already published app for a new app version ? Do we add it to upcoming version and then go to "live app testing"? Or can we upload a submission within "Live App Testing"? I'm reluctant to try out LAT w/o this info as I would not like the go live accidentally. However, many, many thanks for this FAQ in its current form.
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Kevin@Amazon avatar image
Kevin@Amazon answered
Hi Pete, Done. (sorry, missed that)
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

lonebuyer avatar image
lonebuyer answered
For anyone reading this, when you start a new TEST you get a UI similiar to the main submission process where you can upload a binaries as part of the test. I've found this page to be very helpful : https://developer.amazon.com/public/resources/development-tools/live-app-testing/docs/getting-started
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Amelia@Amazon avatar image
Amelia@Amazon answered
Hello Brian Judy, Our publishing process turnaround times vary. We see that the 2nd testing version is live now. If you have any additional questions please raise a ConatctUs ( https://developer.amazon.com/help/contactus.html) with us and we will look into the issue.
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Nick Gardner avatar image
Nick Gardner answered
For modifying LAT settings, developer should have sufficient permissions based on my testing.
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Nick Gardner avatar image
Nick Gardner answered
Hi Guest, In order to investigate this issue further we will need specific information about which app in your account is causing this problem. To protect the personal information of developers, we do not discuss the details of specific applications on these discussion forums. Please reach out to us via our Contact Us form ( https://developer.amazon.com/help/contactus.html ). This will allow us to validate your identity and discuss app specific information in a context that will not expose your personal and proprietary information.
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Electronic Arts, Swiss Sarl avatar image
Electronic Arts, Swiss Sarl answered
can we have two builds in publishing status.
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

Ubisoft Mobile Barcelona avatar image
Ubisoft Mobile Barcelona answered
Hi, I just submitted a LAT which is working as expected. However I can't seem to end, edit, promote or create new tests atm. I have administrator role in my account for the app. Do I need to wait a certain amount of time? What's exactly blocking or preventing me to do this? Thanks in advance. Regards,
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

DougM@Amazon avatar image
DougM@Amazon answered
Also note, please make absolute sure that your In-App items are live when you submit your live app tests. If you do not, this creates the possibility that your Live App Test will fail.
10 |5000

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.