Unwinding of position does not necessarily mean that it is done by big player. It can be by retail investors also if their stop loss is hit. You have to check the smart money flow and then decide who is unwinding? If big player is unwinding then definitely it will impact IV and Premium.
I shared a video on how to find correlation coefficient between the IV and the stock price. IV may increase or decrease.