After more than 50 years, a well-known swimming club in Swindon has announced it will close due to financial struggles.