One of the biggest information service providers in UK
The goal of the project was to identify commodities and quantities from bills of lading using text mining and build integrations from the Warehouse as well as from webpages onto a cloud data processing model. The historic data fetched was used by the model to determine the predicted price based on the source and destination of shipping, nature, and quantity of commodity being shipped. The current pricing of commodities needs to be harvested from web pages and pushed onto the model repository.
The handwritten bills of lading are used to determine the commodity and quantity associated. Improper/incomplete information on these forms limits the solution for such cases. Currency and unit measure would vary based on the data from these forms and these are primary factors determining the fair price. When harvesting price data of commodities, the common products in each category are considered for pricing input onto the data lake.