Rugby audiences declining