If the gifts love language doesn't come naturally to you, you should still learn the language if your partner speaks it.

Look at things in your daily life from a gift-giving perspective. It doesn't have to be expensive, just little reminders that they're always on your mind. If you know someone who speaks gifts as their love language, then not getting them a gift on a special occasion would be very hurtful to them, as would approaching the gift-giving as more a chore than an opportunity.