Rod Sherkin

Companies are rapidly integrating generative AI into procurement and sourcing decisions. The promise is obvious. AI can read thousands of pages of supplier proposals faster than any human team, summarize technical requirements in seconds, and create the appearance of consistency and objectivity in evaluation. But there is an important distinction managers are starting to overlook. The same AI system that performs extremely well at identifying whether a supplier meets minimum requirements may perform much less reliably when judging which supplier is truly better. Recent research published in the Journal of Business Logistics examined this issue by comparing how large language models evaluated supplier bids against evaluations completed by experienced procurement professionals. It analyzed 123 supplier proposals tied to 31 public procurement projects conducted by the State of Ohio between 2023 and 2024. The projects involved complex IT services contracts, many containing large, text-heavy bid packages requiring evaluative judgment rather than simple arithmetic comparisons. The researchers tested three reasoning-oriented AI models: OpenAI o3, Grok-3-Mini, and DeepSeek R1. They then compared their evaluations against human procurement scores. The findings revealed a surprisingly clear pattern. AI performed well when evaluating compliance signals. These are signals tied to baseline qualifications and technical requirements. Does…

Thinkers 360 recently searched its entire content library to select the best business, technology, and sustainability podcasts from their Thinkers360 member thought leaders, and some bonus picks from around the web. We’re proud to announce the Supply Chain Now and Dial P for Procurement were chosen as two of their featured selections! Congratulations to Scott, Greg, and Kelly, and the entire Supply Chain Now and Dial P teams! Check out the entire list here.