Given seqeuneces of images captured by cameras we are aiming at doing semantic segementation using semi-supervised learning together with forecasting of motion patterns of dynamic objects. The overall goal is to to use the information to control a fleet of autonomous transport robots in a factory. This work is used in the project AiMCoR and SECAR funded by CHAIR, WASP and AB Volvo.