Just a follow up: Took out the pressure regulator. Removing the circlip was easy but the regulator took some gentle persuasion to get loose. There are 2 O-rings, a small and a big one, both were o.k. There was some goo in there which apparently caused the leak, because when I cleaned and assembled it, the problem was solved.
I love simple fixes...