This is super easy, just press the ‘Windows’ key (flag) and the ‘Full Stop’ key (.) on your keyboard at the same time to pop-up the emoji selector.
After all these years, I just found this feature! It was mentioned in a VSCode YouTube tutorial that I watched yesterday.