What would be the most suitable AI tool for automating document classification and extracting relevant data for search functionality?
I have a collection of domain-specific documents, including medical certificates, award certificates, and other certificates and handwritten forms. Some of these documents contain a mix of printed and handwritten text, while others are entirely printed. My goal is to build a system that can automatically classify these documents, extract key information (e.g., names and other relevant details), and enable users to search for a person’s name to retrieve all associated documents stored in the system.
Since I have a dataset of these documents, I can use it to train or fine-tune a model for improved accuracy in text extraction and classification. I am considering OCR-based solutions like Google Document AI and TroOCR, as well as transformer models and vision-language models (VLMs) such as Qwen2-VL, MiniCPM, and GPT-4V. Given my dataset and requirements, which AI tool or combination of tools would be the most effective for this use case?