How to Remove CommerceMedia From CommerceMediaCollection

var commerceMediaToRemove=
writableCommerceMedia.FirstOrDefault(x => x.AssetLink.Equals(contentLink));

writableCommerceMedia.Remove(commerceMediaToRemove); // this returns false

Does anyone have any idea of what im doing wrong?