Rarities 1971–2003 is a compilation album by The Rolling Stones that was released in 2005 worldwide by Virgin Records – as well as by the coffee-chain Starbucks in North America – and features a selection of rare and obscure material recorded between 1971 and 2003. The album peaked at No. 76 on the Billboard chart.
Several B-sides were included, such as "Fancy Man Blues", "Anyway You Look at It", "Wish I'd Never Met You", "Through the Lonely Nights", and the band's live rendition of Chuck Berry's "Let It Rock" from 1971.
Track 3, "Wild Horses" (live), from the successful album Stripped, and Tracks 6 and 15, which are taken from the 1981 compilation Sucking in the Seventies, might not be considered rarities because they appeared on previously released albums.
Although the cover image is from 1978 (from the music video for "Respectable") it only shows the current four members of the band and does not feature bassist Bill Wyman, who was removed from the picture; the original colour image can be seen in the booklet from Forty Licks, showing him standing in the back behind Jagger and Richards.
Stephen Thomas Erlewine of AllMusic writes "Rarities 1971–2003 isn't exactly the clearing-house of outtakes, rarities, and B-sides that fans have been waiting for. Not only are there plenty of heavily bootlegged outtakes such as "Blood Red Wine", "Claudine", and "Brown Sugar" with Eric Clapton on guitar missing, but there are plenty of B-sides from these three decades missing." (Notably, "Claudine" and the rare version of "Brown Sugar" were later released on the Deluxe Special Editions of Some Girls and Sticky Fingers.)
Hybrid rehearsal/live version, originally intended to be included on Stripped; previously released on the "Wild Horses" single (1996); backstage rehearsal portion recorded at the Paradiso, Amsterdam, 26 or 27 May 1995; live performance recorded at the Olympia, Paris, 3 July 1995
Originally released as an additional track on the B-side of "Brown Sugar" from 1971 in the UK only, recorded live at the University of Leeds, 13 March 1971. Also released on the Spanish 1971 version of Sticky Fingers.
Darryl Jones – bass guitar on "Tumbling Dice" (Live), "Wild Horses" (Live Stripped Version), "Live with Me" (Live), "Anyway You Look at It", and "Thru and Thru" (Live)
Matt Clifford - keyboards on "Wish I'd Never Met You", "Mixed Emotions"
Chuck Leavell - keyboards, vocals on "Fancy Man Blues", "Tumbling Dice" (Live), "Wild Horses" (Live Stripped Version), "Anyway You Look At It", "Wish I'd Never Met You", "Mixed Emotions", "Live with Me" (Live), "Harlem Shuffle", "Thru and Thru"