You’re doing many things well and have what it takes to be a Builder. It’s likely that most people enjoy working on your team, but some believe you come across like you don’t care. This is a shame, because their reduced engagement will affect your team negatively.
Strengthening your management skills should not be too difficult if you become a better student of people (that includes becoming a better student of yourself). Other areas to consider: You should critique and seek to improve your listening skills, your delegation skills, and your training skills.