No you can’t upgrade directly to Infinity’24 with UI Kit as its only based on Constellation. That’s my idea but you can consult with your account manager for more details.
Ideally old frameworks on new version platforms, but Pega has released version 24.1 for SI too and they would recommend you to upgrade that too.