At the Systems Engineering Design group (Chalmers > IMS > Product Development) we have been using commercial LLM provider API for our research. Now we want to try a local model alternative, for the research that is data sensitive and also for projects that do not have an allocated budget for LLMs. We want to test the Alvis infrastructure to see if this would be feasible, so this project will test serving an open source model from HuggingFace in Alvis.