Though there is no evidence to indicate that There Was was ever performed by Pulp, it was performed by a one-off live project featuring Jarvis (The Jarvis Cocker Explosion Experience) in 1983
Forever In My Dreams was never performed live by Pulp but it was performed as an instrumental by Jarvis' live project "A Touch of Glass"