Yep makes sense. For the OCR part a colleague suggested something like Tesseract or Google Vision but, what about the shapes, like weapon (type) symbol on top right and health/shield bar percentages and etc ?
Maybe i should just get started small with the OCR part
The health and shield bar percentages could be measured
by counting pixels. For instance you could draw a
horizontal line across the bar and see how many pixels are
lit up.
Maybe i should just get started small with the OCR part