Justin and Hailey Bieber are spending a celebratory weekend together, following the July 11 release of 'Swag,' Justin's first solo album in more than four years. A source familiar with the creation of the album tells PEOPLE that the Rhode founder supported her husband throughout the entire process.

Bieber is reportedly expected to drop a surprise album on July 11 after months of hosting "jam sessions" at his California home.