- 46
- 134 837
Nicolas Vandeput
เข้าร่วมเมื่อ 15 ต.ค. 2011
Join me for content related to Inventory Optimization and Demand Forecasting.
VN1 Forecasting Competition - How did the winners win?
Download the datasets here:
www.datasource.ai/en/home/data-science-competitions-for-startups/phase-2-vn1-forecasting-accuracy-challenge/datasets
Download the notebooks here:
www.datasource.ai/en/home/data-science-competitions-for-startups/vn1-forecasting-accuracy-challenge-phase-1/notebook
www.datasource.ai/en/home/data-science-competitions-for-startups/phase-2-vn1-forecasting-accuracy-challenge/datasets
Download the notebooks here:
www.datasource.ai/en/home/data-science-competitions-for-startups/vn1-forecasting-accuracy-challenge-phase-1/notebook
มุมมอง: 1 158
วีดีโอ
My vision for demand planning using AI and humans.
มุมมอง 10014 วันที่ผ่านมา
Earlier in July, I had the pleasure of introducing my vision for demand planning (using AI and humans) at the Forecasting Symposium. Here are the four main concepts, - Get as much data, information, business drivers, and insights as possible regarding your historical and future demand. - Get an automated, bulletproof machine learning engine. Automated means that it should run on its own without...
Connect forecasts and inventory policies!
มุมมอง 1672 หลายเดือนก่อน
Planners need to connect inventory policies (and supply planning in general) with forecasts. Automatically and at scale. Yet many supply chains fail to automatically make this connection. That's a lot of value left on the table as you have a team (and software) specifically designed to predict the future, and your inventory team is redoing all the work by using fixed targets or moving averages....
Don't incentivize demand planners on accuracy
มุมมอง 1883 หลายเดือนก่อน
I wouldn't, 1. Worry about forecasting accuracy 2. Incentivize planners to reach accuracy targets. Assessing the quality of a demand planner's work (or forecasting model) based on forecasting accuracy isn't a good idea, as the demand's inherent variability mostly determines it. Some markets/products/months are more volatile than others, and that's totally independent of your demand planning pro...
Demand planners shouldn't do this
มุมมอง 1043 หลายเดือนก่อน
Demand planners are not computers. So don't ask them to do what computers should do. They shouldn't spend a minute finetuning or selecting forecasting models. Let an algorithm do this. It will be faster and more reliable. I don't clean outliers, and so should you; If you have outliers, - Invest more time in (automated) data cleaning and processing. - Include more business drivers in your foreca...
Don't hire demand planners to review forecasting models
มุมมอง 1613 หลายเดือนก่อน
Don't hire demand planners to review forecasting models. Data scientists should create a fully automated forecasting engine. If you need a human to manually check it, it means it's not bulletproof, and it should be improved. Demand planners should care about the quality of the data fed into the forecasting engine (historical transactions, promotions, historical inventory levels, etc.) and about...
How to make an efficient demand planning process
มุมมอง 1.7K3 หลายเดือนก่อน
If you want to learn more about demand and inventory planning, I predict you'll enjoy my mailing list: mailchi.mp/supchains.com/newsletter. My 3 books: www.amazon.com/stores/Nicolas-Vandeput/author/B07KL86HMV
Which product should demand planners review first?
มุมมอง 763 หลายเดือนก่อน
Have you heard something from your clients or marketing colleagues, or is there a new product launch? If so, you should enrich the forecast for these products/clients. I call this "insight-driven enrichments": instead of going through a list of products from most to least important, gather business insights and only enrich forecasts when you know something specific. It's unlikely you can add va...
Planners only have a 50% chance of improving forecasts.
มุมมอง 684 หลายเดือนก่อน
Planners only have a 50% chance of improving a forecast when modifying it. Academics say. That's really low, unfortunately. This means that the overall added value is low as they have a 50/50 chance of improving or worsening the underlying forecast. So, what can we do to improve this ratio? 1️⃣ Track Forecast Value Added. Without this, you are in the dark. You know what they say: if you can't m...
Don't use ABC XYZ to set inventory targets
มุมมอง 1834 หลายเดือนก่อน
Don't use ABC XYZ to set inventory targets
Demand planners shouldn't care about supply and sales.
มุมมอง 1894 หลายเดือนก่อน
Demand planners shouldn't care about supply and sales.
3 Things you need to be great at demand planning
มุมมอง 3235 หลายเดือนก่อน
3 Things you need to be great at demand planning
How Machine Learning impacts Demand Planning
มุมมอง 2K9 หลายเดือนก่อน
How Machine Learning impacts Demand Planning
50% of planners fail to add value to their forecasts
มุมมอง 71810 หลายเดือนก่อน
50% of planners fail to add value to their forecasts
Forecast Value Added: Concept and Case Studies
มุมมอง 2.6Kปีที่แล้ว
Forecast Value Added: Concept and Case Studies
Demand Forecasting Best Practices - Chapter 1
มุมมอง 682ปีที่แล้ว
Demand Forecasting Best Practices - Chapter 1
Outlier Management - Detection and Correction
มุมมอง 3.8Kปีที่แล้ว
Outlier Management - Detection and Correction
Data Science & Machine Learning for Demand Forecasting
มุมมอง 17Kปีที่แล้ว
Data Science & Machine Learning for Demand Forecasting
How to improve forecasting for fun and profit
มุมมอง 9762 ปีที่แล้ว
How to improve forecasting for fun and profit
How to deal with unpredictable lead times?
มุมมอง 1.4K2 ปีที่แล้ว
How to deal with unpredictable lead times?
where to find winning python code pls, as mentioned in video ?
Here: www.datasource.ai/en/home/data-science-competitions-for-startups/vn1-forecasting-accuracy-challenge-phase-1/notebook
I've always thought this was a bit of a fallacy. You would have to go through thousands if not millions of scenarios that you can't control.
What is your feedback to clients who hesitate to use ML because of forecast interpretability concerns?
In my experience with my clients (and supply chain leaders I discuss with), people who have this concern usually don't implement ML models or poor ones (they get sold linear regressions as ML models) - they get stuck. People who don't share much of this concern implement ML and then usually don't ask many questions about interpretation as it runs smoothly.
Hello Nicolas, really interesting video I came across. In our case (luxury market) we have intermitent demand for the majority of our product portfolio, I heard ML is only good for volume forecast. What do you recommend for this kind of products ? we can have per market demand every 2 or 3 months for 1 or 2 pcs... Aggregated WW demand could be 60 pcs per year... thanks
Hello @Kaycana1221, I think ML can outperform Stat models in nearly all setups, including low-volume intermittent products. Forecasting luxury products is not easy: you don't do promotions, you don't really change prices. But you could already account for (frequent) shortages in your model. In any case, I would go for ML. If you follow me on LinkedIn, you already know that the results of the last competition show that ensembling ML with a bit of Stat is the current best approach (on the competition data)
That's awesome content. Merci Nicolas
Thank you Demba :)
What dataset did you use and is it available publicly online?
It's not available, but you can use the datasets (and open notebooks!) of my forecasting competition VN1 here: Here: www.datasource.ai/en/home/data-science-competitions-for-startups/vn1-forecasting-accuracy-challenge-phase-1/notebook
What is your approach to deal with buffers of raw material or intermediate items that don't have a forecast, instead are dependent of the forecast of the finished products?
Indeed, they should directly be connected to your supply plan of finished goods (so not to your forecasts, at least not directly)
Or compare yourself to the worst performing models, get some venture capital on board, and dump the whole thing in an ipo which will be followed by a 90% decline in price in 3 months. There, I saved your fraudulent start up.
Tres interessant, je suis "purchaser and Planning" , avec des connaissances en develepoment web, je me suis toujours demandee comment me separer de excel et creer de vrai solutions avec du ML
La première étape c'est d'automatiser Excel en passant par Python ou n'importe quel autre langage.
We are struggling to get forecast accuracy to reach 50%. Wondering what other companies are at.
I don't advise my clients to reach for a specific target, I advise to compare themselves to benchmarks and track their added value against it. More info here: nicolas-vandeput.medium.com/forecast-value-added-ebc163d7ccd
where is link to competition ?
www.datasource.ai/en/home/data-science-competitions-for-startups/vn1-forecasting-accuracy-challenge-phase-1/description There you go!
@@nicolasvandeput-SupChains competition is on hold till sep12
meantime may you share link to another data set to download for demand prediction ML task? As you wrote : Why you should never forecast sales On the other hand, sales are constrained by (lack of) supply. So data set to predict demand but for real live situation when sales are constrained by (lack of) supply
@@sndrstpnv8419 you can also always look at the M5 forecasting competition.
@@nicolasvandeput-SupChains M5 is not for case when sales are constrained by (lack of) supply?
may you share link to your data science completion with 20k prize as you announced ?
www.datasource.ai/en/home/data-science-competitions-for-startups/vn1-forecasting-accuracy-challenge-phase-1/description Sure, there you go. We had to move the starting date to 12th of September
What is the paper you reference in here (at 52:00) related to changing forecasts for minimal amounts? And tradeoffs for time?
I discuss the papers with the author here: th-cam.com/video/iKUcpJksun4/w-d-xo.html ;)
very nice explanation. Is geometric mean being used for evaluation as well? You could get more "typical" error compared to average.
In my experience, I have never encountered anyone using geometric means in supply chains. But feel free to try! I am afraid it would come with many drawbacks (skewed and complicated)
is there any way to connect you?
LinkedIn is best: www.linkedin.com/in/vandeputnicolas/
Great speech! Where do you recommend people learn more about ML as it pertains to forecasting?
Hello, if you want to learn how to make your own models: www.amazon.com/Data-Science-Supply-Chain-Forecasting/dp/3110671107 (It's a step by step approach starting from 0, so don't worry if you are not an expert today.) If you want to understand how ML impacts demand planning and how your teams should work with it. www.amazon.com/Demand-Forecasting-Practices-Nicolas-Vandeput/dp/1633438090
Nicholas that’s a good advice! I saw that you wrote an article on How to Forecast Intermediate Demand on medium but it’s behind the paywall! 😢
Paywall should be removed now!
Hi I am an S&OP manager based in Pakistan, I wanted to know how can I get access to your book? also I have been working to create baseline forecast in my organization but since there are no historic demand driver details available its very difficult to generate baseline forecast, any mathematical approach that I can use to atleast begin with forecasting for longer period of months?
Hi Nicholas, when it comes to feature engineering for future covariates, which features are a must according to you? The only future feature I've been able to implement is the lag features, however one is then constrained by the lowest lag feature, i.e if you have lag 7 day feature, you can't predict further than 7 days into the future. What other future variables are there that one would know in the future, apart from holidays and company specific things like marketing costs, promotions etc?
🎯 Key points for quick navigation: 00:29 *📊 Forecast Value Added (FVA) assesses how different teams contribute to improving or worsening forecasting accuracy.* 02:05 *🔄 Demand planning processes typically involve automated baseline forecasts adjusted by teams to enhance accuracy.* 04:19 *🎯 FVA aims to ensure forecast accuracy improvements without excessive time spent on adjustments.* 05:02 *📉 FVA framework tracks how each team's adjustments impact forecast accuracy positively or negatively.* 08:16 *📈 Comparing forecasts to benchmarks like moving averages helps assess the added value of forecasting models.* 11:16 *🎯 Setting accuracy improvement targets relative to baseline performance can be more effective than absolute accuracy targets.* 14:41 *💰 Evaluating forecast errors based on value helps prioritize improvements on high-value products over low-value ones.* 19:28 *🌐 Forecasting across various time horizons (short, medium, long-term) supports strategic supply chain decisions.* 23:09 *📊 Forecast Value Added (FVA) helps identify SKU-level performance, guiding decisions on where to focus and where improvements areneeded.* 23:38 *🔄 FVA encourages a positive feedback loop by comparing market performance against statistical baselines, fostering model improvements.* 24:31 *🌐 Different forecast horizons (short-term vs. mid-to-long-term) require varying model strengths, prompting discussions on model integration.* 25:12 *🤝 Collaborative discussions using FVA help align marketing and finance teams by highlighting where judgmental adjustments add value.* 25:49 *📉 Separating positive and negative adjustments in FVA reveals insights into which adjustments enhance or diminish forecast accuracy.* 27:01 *🎯 Forecasting supports supply chain decisions, aiding in manufacturing and procurement planning crucial for business operations.* 46:55 *🌍 Different countries and industries may require tailored risk management strategies in pharmaceutical production to ensure patient needs are met without compromise.* 47:22 *🤝 Collaborative relationships between planning teams and sales are crucial for mitigating forecast overrides, emphasizing education on supply chain dynamics and outcomes.* 48:27 *📊 Presenting a range of forecast possibilities enhances decision-making by providing stakeholders with more nuanced insights and flexibility.* 49:20 *💡 Implementing statistical engines requires effective change management strategies to shift from manual to automated forecasting processes, emphasizing education and gradual adoption.* 51:12 *💼 For small to medium-sized businesses, affordability and implementation time of forecasting tools can pose significant challenges despite their potential benefits.* 54:04 *📈 Transitioning from manual to automated forecasting involves proving benefits through accuracy metrics and building confidence in system outputs to foster acceptance among demand planners.* Made with HARPA AI
Thanks for the vides Nicolas! I have read all your books - what a fresh take! Please make a video for niche demand planners and inventory controllers to which I belong. That is MRO spare parts inventory which is fraught with intermittent demand and skewed probability distributions. If you ever revise your books 'Data Science for Supply Chain Forecast' and 'Inventory Optimization' please include these topics. I read your article on Croston Method in towards data science and it was very well written with a practitioner's perspective. Whenever possible please make a video on demand forecasting and inventory control for spare parts. Thanks!
Second this! Well said 👏
Love it! 🙏 Thanks for sharing Nicolas! So once we have a great forecast using these three steps, how does one implement the inventory optimization element? I’d be curious to hear your top 3 on the IO portion. Of course, your IO book goes into this quite well already!
Hi Nicolas, it is a very explanatory webinar about outliers. I have a question. Do we need to apply outlier detection process based on train data, or whole data (train+test)? I hope my question is clear.
I would try not to do any statistical outlier detection. I would invest more in data cleaning. If you remove outliers from the test set, you are somehow overfitting - so I would not do it.
Beautiful and intelligent Forecasting session
Muy buen vídeo; la explicación quedó clara con el ejemplo desarrollado en Excel
This is really nice.
Hello dear , I want to congratulate you for the content and the skills that you teach people . I have a question : the forcast ,like you describe it , is applicable for the retail demand planning and the MTO strategy , that's right .Because I don't think that this kind of forcasting is relevent in an MTO industry where the demand is not stable .
Hello, you can apply it to MTO but it might require some differences. For examples you could focus more on forecasting raw material, or include as a features in your ML engine preorders. Or contractual terms/budget.
@@nicolasvandeput-SupChains Is that what we call supply planning ? Thank you in advance.
Thank you for your webinar. I have a question regarding outliers. I am conducting a serum biomarker research (medical research) consisting 50 patients vs. 50 controls. I have 3 cases having non-detectable values (above the detection level) in the same group. This group is already have higher levels than the other one. I do not want to remove those cases and lose the data. Which strategy should I use ? Should I imputate them with the mean value of the relevant group? or Should I enter the measured highest value/s instead of undetectable ones ? or else ? Thank you in advanced.
Hello, sorry I specialize in supply chain demand planning - I don't think I am legitimate or have the experience required to advise you regarding how to conduct medical research. All the best!
Amazing! Thank you for sharing Nicolas!!
Hi Nicolas, to calculate the bias in case of many unpredictable new products introduction and phase out, the latter are not considered because the time series are not available in the forecast period while the former are considered and demand is greatly overestimated, as the 2 cases do not compensate, the overall bias on the product portfolio is always positive. How do you recommend managing this case? Should I consider as a forecast error also the forecast 0 on NPI even if their time series were not available at the time of the forecast?
Hello, this is quite a complicated case. You could compute bias in two different flavors, with and without NPIs. The idea is that you don't want to bring the message that bias is close to 0% whereas obviously, you missed 10% of NPIs. But the responsibility for these NPIs might lie with another team.
Thank you Nicolas. Actually what happens is that if I include NPIs I get an unbiased forecast overall because NPIs compensate unpredictable phase out products, while if I don’t include NPIs I get a positive bias (globally on the product portfolio). Maybe global metrics in this case are not meaningful and I should look at the distribution of Bias/MAE of product time series.
Hi Nicholas, you explained it very well. Could we access the PowerPoint presentation you used?
Thanks Nicolas for amazing content.. how can i join your live sessions?
You can register here to be informed of future webinars: mailchi.mp/supchains.com/newsletter
Awesome session! I'm curious, how would we forecast zeroes? lets say we have inventory for such items but they do no sell at particular time period may be.
use static rules based on competitor price
please make a detailed video on forecasting slow moving intermittent demanded items!
I already have this for you if you're interested: nicolas-vandeput.medium.com/how-to-forecast-intermittent-products-c5d477b90176
Good summary! I used this to explain to my colleagues
Please which certification would you recommend for a demand planner?
I was waiting for it, Thanks
Do you have the github python code available for these?
No, but I share them in books available here: www.amazon.com/stores/Nicolas-Vandeput/author/B07KL86HMV?ref=sr_ntt_srch_lnk_2
Hello Nicolas, what do you think of training a ML model using as input in addition to past demand also the previous month ML forecast enriched by sales? For example, to predict December 2023 demand (M+2) I would use as input features summarizing historical demand + the forecast submitted last month so in september for december (which was M+3) possibly enriched by sales. So if sales enrich a forecast because they are aware of future trends, the following month this information will be captured by the model.
This might add value but will require a lot of data maintenance. I am not sure about the tradeoff.
Hi Nicolas, thank you for sharing this. I have a question for you on forecasting error metrics, I know you don’t like MAPE and I agree, but what do you think of WAPE i.e. sum of SKU (actual - forecast) divided by sum of all SKU actuals ? I think it’s a quite good accuracy metric and also easy to explain to business stakeholders as it is a percentage.
Hello, indeed that's the one I like to use. I call it MAE%. Don't forget to look at it in combination with bias.
Created one year ago, and is still relevant today! Watched the whole thing and probably will watch it again. Thanks Nicolas! Love this!
any code or tutorial?
I share the code in my books: www.amazon.com/stores/Nicolas-Vandeput/author/B07KL86HMV?ref=sr_ntt_srch_lnk_2
BonjourMr , pourquoi vous ne fairiez pas une formation en ligne (payante bien entendu) où vous enseignez le demand planing d'une façon théorique et pratique avec des cas réels , des exercices de prévisions sur excel .....? Nous sommes une génération qui n'aime pas trop recevoir l'information en lisons (même si je ne doute pas que le contenu du livre est pertinant )
Je vais probablement publier une vidéo à l'occasion cette année à propos des KPIs.
Thank you for posting these webinars. Even with all the Q&A on shortages I'm still confused on figuring out unconstrained demand. On your slide you say to bypass it, but in your book it says to censor it. Are you meaning the same thing for both the slide and book? Also, on the slide in this webinar, that's also book, it looks like you're using a default value for demand, which looks to be the last demand value before the shortage for the duration of the shortage. Is that what you use? Your book mentions forecasting techniques that might help estimate unconstrained demand, but I can't find any examples. Can you share those techniques? Do you use machine learning techniques, or an equation? Thanks!
I usually don't use equations to clean shortages. Nowadays, I just censor them. nicolas-vandeput.medium.com/forecasting-demand-despite-shortages-fee899120c08
What great content! I just finished reading demand forecasting best practices and found this video in the footnotes. Very cool, several learnings, thank you!
Thank you!
How do you capture a demand for a manufacturer in a b2b setting. As orders are been placed and stored in the erp system. Do you use the quantity of order placed as the are intermittent in nature.
Track historical orders (and even preorders) and censor periods with shortages: nicolas-vandeput.medium.com/forecasting-demand-despite-shortages-fee899120c08
what if my lead time is different from material to material?
Great content !!! Thank you for sharing.
Hi there I have a question, exist a tool like COV for trends or seasonality.
I don't advise measuring COV. Best to track forecastability as we do here: www.skuscience.com
Great. Thanks And I can use this analysis for the procurement of supplies needed for production who have dependent demand?
Please make video on forecasting intermittent time series data. I tried croston, tsb etc but results are pretty bad.I have only 8 months data . Will you please suggest some methods.
With only 8 months, it'll be difficult. But I will make more content on this ;)
I just have a question on the first one; why do we focus til' M5; why not further and then how further do we forecast? Like a dynamic programming problem; we can keep focusing til' the end of the planning horizon to assess what's a good position at M5, M4,... right?
Hello Pras, You have two problems: - On which horizon should you focus your forecasting effort - On which horizon should you focus your planning effort For both, if you use models (anything automated), you could do as much as possible. But if you need human resources (to do the baseline or enrich a model), you'll have to focus on what's the most important. You only have limited time/resources.