All articles

Bot Regression Week: When QA Is Better Off Renting a Number Than Buying a Stack of One-Time Activations

On Monday, a tester sets up a test account for the bot with a one-time activation, gets the code, and runs through the test scenarios. On Wednesday, the test plan calls for checking sign-in from a clean device, and the service sends another SMS. By then the number has long since gone back to the supplier. The code never reaches the tester, and the account with Monday's settings and history is locked out. It all comes down to one thing: a multi-day job was run on a product built for a single registration.

What you get with a one-time activation

A one-time activation gives you a number for one service for a limited time. The window comes from that service's catalog and is currently one hour. During that time the code arrives, you enter it, and once the SMS is received the service counts as delivered. If the code doesn't arrive before the window closes, the money goes back to your internal balance automatically. You can also cancel the order before the code arrives, but no sooner than one minute after purchase.

That's enough to set up a test account once. Regression testing runs over several days, and the tester needs the same number again and again. A one-time activation doesn't hold on to it.

Where regression testing trips up

Picture a team testing a bot before release. Runs happen every day, and the test plan includes cases that depend on a phone number:

  • signing in to the test account after a session reset or on a new device;
  • recovering access via SMS;
  • re-verification that the service asks for after settings change;
  • the same scenario again after a hotfix.

With one-time activations, each of these cases means a new purchase. A new number means a new account with no history, so comparing results with the previous run no longer holds up: the environment changed, not just the bot's code. Sometimes a fresh number is already tied to someone else's account, and the case fails for a reason that has nothing to do with the release.

You can get your previous number back with the "Buy again" button: an expired number can be purchased again, and your own cooldown doesn't block it. But each of those sign-ins is paid for separately. And if the supplier's SIM happens to be offline at that moment, the run waits until it's back in service.

How a rental covers the week

A single-service number rental is sold for 1, 3, or 7 days. For the whole period, the number works for you on the service you picked, and repeat SMS codes come in free of charge until the rental ends. That's the point of renting a number for testing: the test account lives on one number from the first run to the last, and signing in after a session reset doesn't require a new purchase.

Match the length to your cycle:

  • 1 day: a hotfix check or a smoke run before deployment;
  • 3 days: a condensed mid-week regression;
  • 7 days: a full week from the first run to release.

If the release slips and the rental runs out before testing is done, buy the same number again. That's how you extend a rental. If the supplier's SIM goes offline mid-cycle, you can send them a request from your dashboard to bring it back online.

There are two caveats. The buttons only show the durations the selected service sells, so the one you need may not be there. And a received code doesn't guarantee that a third-party service will let the sign-in or registration through. Every platform has its own checks, and test accounts have to be set up under its rules.

How to run the numbers for your service

We don't give ready-made figures: suppliers set the prices, and they vary by service and country. The comparison takes three steps:

  1. List the cases in your test plan that need a code, and multiply that count by the number of runs per cycle. That gives you the number of sign-ins per test account.
  2. Multiply that number by the one-time activation price for your service and country.
  3. Compare the result with the rental price for your cycle length: 1, 3, or 7 days.

If your plan has only one case that needs a code and you won't have to repeat it, go with an activation. If there are several sign-ins spread across several days, a rental removes number changes between runs either way, and step three shows you the difference in cost. For several test accounts, the storefront comes in handy. It shows each supplier's remaining stock, so you can pick one with enough numbers. Or you can skip choosing, and the number will come from the cheapest supplier.

Open the order window, select the service and country for your test accounts, and compare the one-time activation price with a 1-, 3-, and 7-day rental. Prices and availability are shown before you pay. You can also check them without signing in through "View prices" on the home page, and buy once you've signed in to your dashboard.

Your first number in a minute

Signing up takes a minute, topping up a couple more, and the code arrives in 20 seconds.

Buy a number
No subscription feeCancel with a refund in the first hour