1. ?? How it works
applitools SDKs works with existing test frameworks and simply takes screenshots of the page,element,region or an iframe and uploads them along with DOM snapshots to our Eyes server. Our AI then compares them with prevIoUs test executions‘ screenshots (aka Baselines) and tells if there is a bug or not. It‘s that simple!
#1.1 Baseline vs. Checkpoint images
When you first run the test,our A.I. server simply stores those first set of screenshots as Baseline images. When you run the same test again (and everytime there after),the A.I. server will compare the new set of screenshots,aka Checkpoint images,with the corresponding Baseline images and higlights differences in pink color.
#1.2 Marking the test as "Pass" or "Fail"
When the AI compares the baseline and the checkpoint image,if it finds a legitimate difference,it‘ll mark the test as Unresolved. This is because the AI doesn‘t kNow if the difference is because of a new feature or a real bug and will wait for you to manually mark it as a Pass/Fail for the 1st time.
If you mark the unresolved checkpoint image as a "Fail",any further runs with similar difference will be automatically marked as "Failed".
If you mark the unresolved checkpoint image as a "Pass",then it means that the difference is due to a new feature and so we update the new checkpoint image as the new baseline and mark the current test as Pass. And going forward we‘ll compare any future tests with this new baseline.
Note:
-
applitools AI has been trained with 100s of millions of images. It doesn‘t do a pixel-by-pixel comparison because it leads to a lot of false positives,but instead simulates real human eyes and ignore normal differences that humans would ignore and only highlight those that humans would highlight as bugs.
-
ACCURACY: A.I‘s current accuracy rate is 99.9999%! Which means for most applications that odds that you‘ll see false-positives is 1 in a million!
#A powerful test results dashboard
We provide a state-of-the-art dashboard that makes it very easy for you to analyze differences,report bugs straight from the dashboard and so on.
2. ?? Analyzing differences3. ?? Reporting bugs (straight into Jira or Github)4. ? Prerequisites5.1 ?? - Run the existing demo app5.2 ?? - Add applitools to an existing project6. ?? Try Visual Grid ??
