To prevent people from avoiding the estate tax by giving their property away, the law imposes a gift tax. You can give up to $14,000 yearly to each of as many people you want without worrying about this tax. Any part of the credit used to offset taxable gifts will not be available to reduce the estate tax. When the gift tax is owed, it is owed by the giver, not the recipient.