Jump to content


Photo

Faqs About Soak Tests

soak test FAQ

  • Please log in to reply
No replies to this topic

#1 MkVsTheWorld

MkVsTheWorld

    Member

  • Members
  • PipPip
  • 76 posts
  • Twitter:MkVsTheWorld
  • LocationBaltimore, MD

Posted 29 June 2012 - 11:58 AM

So you want to learn about soak testing and why it is often mentioned throughout Android forums? Here are some FAQs about the process:

What is a Soak Test?
A Soak Test generally refers to external private testing that is done on Motorola devices prior to being released to the public. A Soak Test includes security updates, stability fixes, radio upgrades, OS upgrades, etc. At this stage of sofware testing, the update is ready to be released to the public but as a security precaution, a small group of testers' gets the update first.

Why should I care/do about a Soak Test?
Well, if you don't care much about upgrades and security fixes to your phone then you wouldn't be reading this. But, when someone violates the agreement and tips people off of the upcoming soak test, this a general indication that a software upgrade is headed in the next few weeks. You can also use this opportunity to update your device without some of the risk involved in installing an unofficial update.

Why are Soak Tests' done?
When upgrading software, a good practice is to test upgrade in a real environment that is impartial. That is usually end users that are not involved in developing the software. The logic behind this is to prevent a range of issues from occurring, i.e. business politics from getting involved, not enough test scenarios done by testers', or just prevent huge oversight that external testers' could catch.

Why are Soak Tests' kept private?
Only Motorola would be able to answer that question. I could list a bunch of reasons why Motorola wouldn't want to make a soak test public. First off, this could trigger customers to flood their customer support with questions. Secondly, they probably don't want to get in the practice of announcing an update then not deploying it after a soak test, which looks bad. Thirdly, if the update doesn't go well then only the testers are affected and not the vast majority of handset owners.


How can I join?
You have to join the Motorola Owners' Forum and enroll in the Motorola Feedback Network. Motorola's requirements do change from time to time. As of June 2012, follow these steps:
  • First: Create a Motorola Owners' Forum Profile. Here is the link to the forums,

    Please Login or Register to see this Hidden Content

    .
  • Second:

    Please Login or Register to see this Hidden Content

    (This will take you to the registration page -- if you are not an MFN member, click "I would like to participate in the Motorola Forums" toward the bottom of the page and complete the information requested there.)
  • Third:

    Please Login or Register to see this Hidden Content

Next time a soak test invite goes out for your device, you might be lucky and get selected for a Soak Test.

Suggestions for participating in Soak Tests?
- Don't kiss and tell. You can actually get kicked out of soak testing permanently for not following Motorola's terms. They go to extraordinary lengths to keep the testing low-key. So, don't go public and tell the world that you have an updated phone. First off, this won't make you cooler. Secondly, chances are everyone else on the forum you are bragging to already got the update as part of a leak weeks ago. Thirdly, Android Police/Droid Life/Drippler will get the information out that a soak test is ongoing. Fourthly, Motorola can find out.

- If you get selected, be a good tester and respond to all surveys and contribute to the forum. As part of being a tester, you are expected to do so. In addition, if you just take the update and run, you could also get kicked out of testing in the future too. You should really take this opportunity to find issues and report them so that Motorola could fix those issues in the next update.

- Do not do factory resets unless totally necessary, i.e. your phone is bricked. If you do a factory reset, that can kick you out of the soak.

- Be honest about rooting. Also be aware that you may have to restore your phone back to stock in order to participate; even removing all forms of bootstrap and such.


- You may not get picked for a soak test. After all, Motorola must keep the sample size to a minimum. If they had too many people testing then it would defy the purpose of testing.
Run for your health, run for the rush, run for charity. Sign up for a race near you, you can do it!





Also tagged with one or more of these keywords: soak test, FAQ

2 user(s) are reading this topic

0 members, 2 guests, 0 anonymous users