Dont know if anyone has mentioned this before but I had the same issue and my solution was this "Kando Max" (Sensitivity Max) box from Max Orido.
I have been friends with the kid who runs his shop for years since he worked at the petrol station close to my house (it was like Itsuki and Takumi from Initial D I kid you not). Went in and spoke with Max about it for a while and he personally tuned these boxes for this car with his personal GR86. The drive away feeling and shift changes are massively improved with this little throttle map box. It plugs in between the main wiring harness and the throttle and took about 2 minutes to install.
This was hands down the best mod I have ever done for a stock GR86/BRZ
Looks like he has an English page for it but its pretty pricy overseas. I am sure I didnt pay that much for it.
SENSITIVITY MAX【感度 MAX】 [GR86 only, TOYOTA86 / BRZ only, Hiace, Swift ZC32S / ZC33S only, TOYOTA LEXUS only GR Yaris only, Honda S660 only] Detail:The throttle response of the electronic throttle is improved so that it feels as if the car has become lighter and the torque has increased...
maxorido.jp
Sadly with a supercharger and the HKS ECU I am back to the same old jerky throttle maps and I could never get Max to give me the data points so that I could work with HKS to remap thier ECU to match up with his tuning...