Scanbot SDK Document Quality Analyzer (DoQA) Configurator

Introduction

This tool allows you to create a customized config for the Document Quality Analyzer from the Scanbot SDK.

The goal of the Document Quality Analyzer is to decide if a user-provided image of a document is of good enough quality to proceed, or if the user should be asked to provide an image of better quality. This distinction between good and bad quality images is difficult and largely depends on the use-case:

• What type of documents will be scanned? E.g. receipts, invoices, contracts
• What part of the document carries the important information? E.g. is it important that the fine-print on the image is readable? Or is it sufficient if the larger text is readable?
• What are the capabilities of the next processing passes? E.g. text with poor contrast might be fine for OCR but is difficult to read for humans.

By providing examples of images that have sufficient or insufficient quality for your use-case, this tool will create a fine-tuned configuration file to optimize the DoQA performance for you.

Prerequisites

To run this tool, you need to have the following:

• Docker with Docker Compose support
• Images of documents that are of sufficient (good) or insufficient (bad) quality for your use-case. Per class good / bad you should provide at least 100 samples (200 in total). The more samples you provide, the better final configuration will fit to your use-case.
• A special license key that is only valid for the DoQA Configurator. This license key will be different from the license key you use in your app. Please contact customer support to obtain it.
• You need to know the version of the ScanbotSDK Core used in your release. Please also contact customer support to obtain it.

Usage

• Clone or download the repository

  git clone https://github.com/doo/scanbot-sdk-doqa-configurator
  

• Place the training images into the folders data/bad & data/good. Images should be in JPG or PNG format.
• Modify the .env file and put the version of the ScanbotSDK Core and your license key there.
• Run the following command to produce the custom configuration:

  docker compose run --build --rm sbsdk-doqa-configurator
  

• Your config will be created in data/DoQA_config.txt. Please provide the contents of this file during the configuration of the Scanbot SDK.
• A report will be generated in data/training_report.html that shows what performance you can expect from your new configuration.
• A debug file will data/DoQA_config_debug.pkl generated (see usage below).

Debugging

If you find that after creating a custom DoQA configuration, the output of the DoQA is not satisfactory, we provide some tools to understand what might be going wrong.

Usage:

• The folders data/bad & data/good need to contain the same images as they did when you created the DoQA configuration.
• The file data/DoQA_config_debug.pkl from your training needs to be present.
• Place the images that yield unexpected DoQA results and you would like to examine in the folder data/explain (JPEG or PNG).
• Run the following command

  docker compose run --env-from-file=.env --build --rm --entrypoint python sbsdk-doqa-configurator /app/explain.py --scanbotsdk_license_key=YOUR_LICENSE_KEY
  

  The command will generate one report HTML in data/explain for every image in that folder. These reports can help you understand how the DoQA operates and what you can do to improve its performance.