The Expanded Inventory option that lets you carry four weapons on PC instead of two on consoles doesn’t break this achievement. So feel free to use it to get this achievement more easily.
The pistol has low ammo capacity and a small clip size, but is a decent weapon if you’re good at headshots, so hanging on to it isn’t much of a handicap.