Affection is calculated by Likes minus Dislikes. Keep in mind that Likes from users who are not signed in are not counted towards your Affection, but are counted towards your total Likes, so the numbers may not match! Removing photos may result in your Affection decreasing, due to the loss of Likes from those photos.
Need more help? Email us at email@example.com or tweet @500px_help