Not getting very sore? Problem?

I often work out very hard, but don't get sore. Is it because I am in my twenties and my body recovers quickly or I am I not working hard enough. I am a little worried. I am making gains, but I wonder if I could be making gains quicker. I can't really lift heavier and finish my sets. Any thoughts?