Analytics and Optimization

Ajay Deshpande

Research Staff Member & Manager, Cognitive Commerce Group
IBM TJ Watson Research Center

A Rapid What-if Simulator for E-commerce Order Fulfillment

As online demand is growing, retailers are increasingly leveraging their store networks along with their e-commerce fulfillment centers (DC’s) to fulfill online orders. Retailers use order fulfillment solutions, which are typically driven by a complex set of user-defined rules or a sophisticated predictive multi-objective optimization tool (recently launched IBM Order Optimizer) or a combination of both. However, as the fulfillment network expands from a handful of DC’s to hundreds or thousands of stores, retailers are left with the hard question of how to plan fulfillment operations for the next promotional event or the peak season. Retailers are mostly left with the guesswork of either tweaking complex fulfillment rules based on the recent experiences or adjusting optimization parameters with a little view into the outcome. To address this challenge, we have developed a planner tool, which is a rapid discrete event simulator engine that helps retailers answer a variety of “what-if” questions. The planner includes a framework to quickly ingest a retailer’s historical data such as inventory, POS sales, e-com orders, network, etc. Depending on the user configuration, the planner uses a rule based or optimization based approach to perform order by order fulfillment simulation and generates KPIs for comparison. In this talk, we present the planner tool and present real case studies from two retailers.


Dr. Ajay Deshpande is a Research Staff Member and Manager of the Cognitive Commerce group in the IBM T. J. Watson Research Center. Prior to joining IBM, he worked as a Postdoctoral Associate in the Laboratory for Manufacturing and Productivity at the Massachusetts Institute of Technology (MIT). Dr. Deshpande received his Ph.D. degree in Mechanical Engineering from MIT in 2008 where he was a recipient of the MIT Presidential Fellowship. He also earned his double Masters in Mechanical Engineering, and Electrical Engineering and Computer Science, from MIT in 2006. He graduated from the Indian Institute of Technology Bombay in 2001 with his B.Tech. and M.Tech. degrees. Dr. Deshpande is a Master Inventor at IBM, has received multiple IBM Manager’s Choice Awards, and several IBM Invention Plateau Awards and the Best Paper Award at the CHI 2013 conference. Dr. Deshpande co-authors several papers in the area of commerce, smarter cities, and internet of things.

Philipp Hungerlaender

Associate Professor of Operations Research
University of Klagenfurt

Optimizing a Fleet of Vehicles for Efficient and Customer-friendly Grocery Delivery

Nowadays, all main supermarket chains provide online shopping services, where customers select groceries on the supermarket’s website, as well as a delivery time window. The goal of our common research project with one of the world’s largest supermarket chains was to design a stable and fast optimization approach producing efficient vehicle routes for handling a large number of customers and vehicles in real time. More efficient tours not only safe money but also allow to insert more additional customer orders into the tours and to show more available time windows to each new customer, leading to a higher customer satisfaction. Our optimization approach improved the efficiency of the routes compared to the previous system of our client by nearly 10%, which translates to cost reductions of several million euros per year. Additionally we could increase customer satisfaction as customers are now more likely to obtain their preferred delivery time window.


Philipp is an Associate Professor of Operations Research at University of Klagenfurt in Austria. He received several awards from scientific societies and the Austrian president for his research. Since 2 years he leads a research team of 10 people funded by an industrial cooperation with the English technology firm Satalia (NPComplete Ltd) that provides artificial intelligence solutions to solve industries hardest problems. The primary goal of this industrial cooperation is to build state-of-the-art heuristics, exact methods and machine learning approaches for solving combinatorial optimization problems lying at the heart of real-world applications. Core application areas are routing and scheduling. Currently Philipp’s team conducts projects with one of the world’s largest supermarket chains and one of the world’s largest accounting companies, among others.

Anssi Kaki

Manager, Advanced Analytics
UPM-Kymmene Corporation

What To Do When Planners Deviate From Optimized Plans? Case Hydropower Planning

Planning tools are often based on optimization models whose recommendations the tool users may, or may not, follow. Empirical evidence suggests that decision makers can deviate from the optimal recommendations provided by a model even in problems that are recurrent; for instance in inventory management or production planning. In this presentation, we describe a case study of a hydropower producer that uses an in-house tool for the optimization of daily production plans driven by electricity price forecasts and constrained by environmental limits and river flow dynamics. We study hundreds of daily plans with focus on deviations between the optimized and actual plans, complemented with corresponding planner feedback collected via a web-survey each day. By analyzing this data, we are able to identify when planners’ deviations are beneficial and when harmful. We also identify improvement potential relating to i) de-biasing the electricity price forecast, ii) improving the hydrological model, and iii) adding new model constraints that allow the planner to control the amount of hour-to-hour changes in the plan. After detailing the case study, we provide insights on how to identify key challenges in use of optimization models by collecting both quantitative and subjective data from the decision process. We then present multiple ideas for corrective actions that pertain to input data, model development and decision maker behavior. The insights are widely applicable to decision processes that are supported by optimization and based on business data.


Anssi Käki manages a team dedicated to analytics and operations research at Finland-based UPM-Kymmene Corporation. At UPM, he has been working on hydropower production planning, power market bidding, paper machine scheduling and wood flow planning, for instance. Before joining UPM in 2013, Anssi worked in supply chain consulting at ROCE Partners (currently part of Chainalytics), where he led projects related to logistics process management, supply chain planning and demand forecasting in consumer electronics and technical wholesales industries. He has a D.Sc. degree in Operations Research from the Aalto University. His research has been published in scientific journals such as Journal of Business Logistics and IEEE Transactions on Engineering Management.

Joshua Lyon

Operations Research Analyst
Ford Motor Company

Human Guided Optimization

Optimization has broad applications in problems like scheduling, routing, investing, etc. However, it can be difficult to capture the essence of a problem mathematically. Problem formulation is more difficult when there are multiple objectives, nonlinear relationships, subjective constraints, or incomplete data. How should we proceed when it is hard to capture the important features? The traditional approach assigns an optimization specialist to carefully craft a model that is realistic and solvable. But this process takes time and expertise. And it may under-utilize the domain knowledge of subject matter experts (SMEs) when their insights are hard to capture mathematically. As a result, project teams can spend time and frustration when “optimal” solutions for the model turn out to be suboptimal or infeasible in application. We will explore in this session how to partially overcome these challenges by having SMEs interact with the algorithm and guide it toward practical solutions. We will discuss: • How SMEs can interact with optimization models through Decision Support Systems. • How to create decomposition methods led by human guidance. • How initial formulations change when the solution process will be human-guided. • How to communicate to SMEs why the algorithm recommends certain decisions. We will present a case study around production planning for stampings at Ford Motor Company. The manufacturer makes decisions years in advance for what to outsource and where to produce parts. The case study looks at how to adjust plans when conditions start deviating from the original assumptions, such as when demand is higher or lower than expected. The problem has multiple objectives, subjective constraints, and a lack of data to determine which of the 1015 potential solutions are really feasible. We will use this problem as a backdrop to illustrate general challenges and demonstrate solutions. We will demonstrate how human-guided optimization can reduce development time before successful results. We will cover a decomposition approach that is analogous to Benders Decomposition, but where the cuts are generated from human evaluation rather than mathematical means. The process has the algorithm search the solution space while SMEs guide for nuances that may be hard to represent mathematically. Because SMEs are able to correct model inaccuracies in real time, less time is needed to pre-prepare a robust formulation that is realistic for all corners of the solution space. Rather SME inputs become part of a dynamic model that grows more accurate over time. This environment allows decision makers to slowly gain insights and trust in the model without a lengthy model-development phase. We demonstrate through the case-study how these strategies can lead to better business outcomes compared to unsupervised optimization.


Joshua is an Operations Research Analyst at Ford Motor Company. He received his PhD from Arizona State University in Industrial Engineering, with research in Energy Markets.

David R. Morrison

Software Engineer

Super-charging Dev Ops with Analytics: How Yelp Runs Millions of Tests a Week and Saves Money Doing It

Over the last two years, Yelp has developed an in-house scalable and reliable parallel task execution system, called Seagull. This system is used by Yelp to drive its enormous testing infrastructure: Seagull enables Yelp developers to perform nearly 1.5 million tests of the Yelp website and platform every day, ensuring that changes and improvements to Yelp’s application are safe to deploy to a production setting. In this talk, we will describe how Yelp is using advanced analytics techniques to solve two related scheduling problems. In so doing, Yelp is able to ensure that its developers can perform continuous development on the Yelp application, while keeping infrastructure costs low and maintaining the stability of its systems. In this talk, we will share lessons that we’ve learned on our journey towards powering DevOps with analytic techniques.


Dr. David R. Morrison is a software engineer working in scheduling and optimization on the distributed systems team at Yelp. He has developed and improved auto-scaling code for one of Yelp’s most expensive compute clusters. Previously, David worked at Inverse Limit, where he received federal funding from DARPA as well as money from Google’s ATAP program to do research and development on a wide range of projects. David received his PhD in computer science (with a focus in Operations Research) from the University of Illinois, Urbana-Champaign under the supervision of Dr. Sheldon Jacobson. David has an established track record as a public speaker; his most recent presentation was to a large audience at AWS re:Invent 2016. He has also given multiple presentations at the INFORMS Annual Meetings, as well as other venues.