I had the exact same problem, but for accessories. I have 2 main pre-existing things that are 2" to insert into the truck (because I had a half ton previously): 1) My weight distrubition hitch shank, and 2) My Thule 4-bike rack that has built-in expanding anti-rattle mechanism.
For 1) I am rolling with the OEM reducer. Once it is lined up I can get the long locking pin through everything. There is play but once the trailer's weight and spring bar tension applied, that thing is not wiggling. If yours still wiggles (is it not a weight distribution hitch with tension?) then the only options (as others mentioned) are welding a reducer sleeve to the shank, or ordering the 2.5" shank version for your hitch. So far I'm doing ok with the OEM reducer not welded (I don't see wear on the reducer or shank, or excessive chewing up on the pin).
For 2) I initially bought a Kuat reducer (
https://www.kuat.com/product/hitch-reducer/), thinking that once I insert my Thule accessory, I can crank and it will expand out to remove all slack. Well, the Kuat reducer fits in the bottom-left and top-right corners, but my Thule hitch expands toward the top-left. So of course it did not work.
The problem I was trying to overcome is that any solid reducer I expand the Thule into will still have slack between the reducer and 2.5" receiver. And the anti rattle clamp I bought (
https://www.etrailer.com/Hitch-Anti~Rattle/CURT/C87UR.html) also didn't work, as the original poster mentioned, because the Ram's bumper is in the way.
My father in law gave me an easy solution. Get a spring with a diameter >5/8". Get a hex bolt that can fit a 5/8" hole, and a large nut for it. Then a piece of scrap metal slightly less than 2" square or rectangle, and drill a 5/8" hole in the center. Solder or weld the nut to the scrap metal with holes aligned. Solder or weld the spring to the nut, such that you can pass the hex bolt through the nut and spring together. Now slide the spring+nut combination into the reducer, and line it up with the pin hole. The spring tension should keep it in place, if not just re-align it manually but I haven't had to yet. Put your reducer into the 2.5" receiver, now use the hex bolt as your pin. Thread it and the nut will suck the reducer up against the receiver and NO MORE RATTLE. The crap metal keeps the nut from rotating on the last few tightenings, but if the spring is strong enough it may keep the nut in place with friction. You can optionally use a hex bolt that passes all the way through to the other side of the receiver, and put another nut, or drill a hole and put a cotter pin, for safety.
The above should be fairly inexpensive and works beautifully for my 2" accessory Thule bike rack.
Here are some pics of the overkill version my (bored retired) father in law made. I was going to do the soldered version but he got too excited to have a project.