I have been a welder and machinist for over 25 years now and have tigged and drilled enough aluminum that I will probably end up with alzheimers from exposure to it.
You need to drill aluminum slow.
Slowest speed yer press will go or one up from it.
Use a nice sharp hole saw and some tap magic, a thinner thread cutting oil or even wax.
The trick is to go slow with light pressure letting the bit do the cutting and not forcing it to cut.
Aluminum gets gummy when it heats up and clogs up the teeth.
Back the bit off periodically, clear the chips from the cut, give another little squirt of cut fluid and have back at it.
Go sharp and slow with some cutting fluid and youll get er done in no time.