Solved this and wrote an article about this, soon to be published!