NuMind introduces NuExtract, a language model specialized in converting text into structured JSON data. The major innovation lies in the creation of compact models (from 0.5 billion to 7 billion parameters) that match or exceed the performance of generic LLMs a hundred times larger.
The model excels at extracting complex information from varied documents, organizing data hierarchically. Typical use cases include the analysis of medical records, legal documents, and financial reports. NuExtract can operate in zero-shot mode for general tasks or be fine-tuned for specific business problems.
The dataset creation methodology is a key element of the success. The team leveraged 300,000 English texts from the C4 dataset, using Llama 3 70B to generate extraction templates and annotations. This process produced 50,000 quality training examples, with extraction trees reaching up to 9 levels of hierarchical depth.
Performance results demonstrate the effectiveness of the approach. NuExtract-tiny outperforms GPT-3.5 despite being 100 times smaller. The standard NuExtract version surpasses Llama3-70B while being 35 times more compact. NuExtract-large achieves equivalence with GPT-4o with a size reduction factor of 100.
These performances open up considerable practical advantages compared to proprietary alternatives. Inference costs are drastically reduced thanks to the compact size of the models. Local or private deployment becomes feasible, meeting the confidentiality requirements of many organizations. The fine-tuning capability makes it easy to adapt the model to specific domains without deep ML expertise.
The model is distributed under the MIT license, allowing free use in commercial and research contexts. This open source approach positions NuExtract as a credible alternative to proprietary extraction APIs, particularly for organizations concerned with controlling their costs and their data.
The article illustrates an important trend: specialized models of modest size can rival generalist giants on targeted tasks, paving the way for more economical and sovereign deployments.