This project explores new methods for speech language models, a new family of speech foundation models that enable various speech technology applications. We are especially interested in the Text-to-speech (TTS) application. We intend to construct a speech language model for English and Swedish.