It’s 6:30 a.m. in the logistics hub of a major fruit importer, and a tray containing apples is quickly pushed into the inspection machine. A scale and barcode scanner capture the data from it and compare this with the delivery note. Tapping on the touchscreen also causes near-infrared cameras and microwave radar technology to create an image of the fruit and take a look beneath the peel without destroying any produce.

 

Using artificial intelligence to predict shelf life

Assisted by AI, a comparison with a stored ideal image of the fruit reveals whether any goods are missing or other varieties have ended up in the tray. It also displays any quality deficiencies on the screen. Using data based on this, it is possible to predict the shelf life of goods and amend the time of sale or pricing as appropriate — making a significant contribution to preventing food waste.

 

Conserving resources

One of the major aims that Fraunhofer CCIT is incorporating through its new scanner is to optimize the flow of goods and improve planning capability so that, where possible, perishable fresh goods no longer contribute to the approximately 58 million tons of food thrown away every year in the EU alone. This figure also weighs heavily in financial terms, equating to around 132 billion euros.

 

Ready for a multitude of applications

Now ready for use, the prototype was developed by the Fraunhofer Institute for Optronics, System Technologies and Image Exploitation IOSB and for Nondestructive Testing IZFP, in conjunction with partners from industry and the food wholesale trade. “This allowed us to accumulate a great deal of practical expertise,” explains Anna Taphorn from Fraunhofer IOSB. “The scanner is now ready to be used in other applications.” This means additional varieties of fruit and vegetables — and beyond: “We’ve also had a request from the bakery sector, where consistency and freshness are of paramount importance,” adds Taphorn, a specialist in visual inspection systems. 

 

Versatile sensors and knowledge transfer opportunities

There are two major aspects contributing to this outstanding versatility. Firstly, the sensor technology is able to adapt to the requirements in question — with gas sensors for detecting ripening gases or hyperspectral cameras that measure sugar content and other internal quality parameters, for instance.

Secondly, the type of AI being used offers significant advantages by using anomaly detection to identify issues that would have gone unnoticed before. The model is trained on error-free — that is to say, “ideal” data — and issues a notification when deviations from this data occur. These insights can also be transferred relatively quickly, meaning that only a small quantity of data is required to retrain the model if a new variety of produce is introduced, for example. 

 

Scalability thanks to simple operation

If threshold values are defined for quality features, the AI models are able to make use of recommendations for the next steps that the scanned goods should undergo. This data-centric approach can be multiplied, allowing any number of scanners to be used in parallel. Since the scanners are also easy to operate using a touchpad, they can be used in applications beyond wholesale businesses without the need for costly staff training.

 

A glimpse of an automated future

“It is possible to envision even more applications in the future. For example, new partnerships could allow us to expand the technology to conveyor belts if required,” says Taphorn. This would mean no more need to carry individual crates over to the inspection area manually, plus the ability to use data in a centralized quality check and run entire processes automatically. “This brings huge benefits for speed and quality compared to the manual inspection processes that are commonly used today.”

 

Optimizing the flow of goods

Featuring efficient diagnostic capabilities, outstanding versatility and fast availability, the prototype of the multimodal inspection system is now ready to be used in practice. This will open up new horizons, explains Taphorn: “In the future, the customizable sensors and ease of use will play a part in optimizing how fresh goods such as fruit and vegetables are marketed, and in reducing food waste.”