Presumably due to the depiction in the film, Swansea Library would not give permission for filming. The film uses the Glynn Vivian art gallery, directly over the road, for exteriors instead.
The South Wales town the film is set in - Aberdarcy - is a fictional one.