If you're not planning on doing any more soundproofing treatment to the walls/ceiling, I'd just put an extra pillow in the kick when playing at night.
With almost no soundproofing treatment in my room, and with "my room" being the master bedroom in my house, I'm forced to track all drums during the day, or I'll wake up not only the neighbors, but my family, too. D'oh!