Yes, it's quite easy.
Right click on the desired OU > DELEGATE CONTROL
Select the users / groups you want to delegate control
Then you can select basic tasks (like password resetting) or create your own.
Once you are finished, you can check the permissions on that OU and you should see users / groups with the right permission.
let me know.