[really] bring [me/you/us/...] down 　落ち込ませる・がっかりさせる

1. That really brings me down, man.

2. I'm sorry, I didn't mean to bring you down.