I just checked my 32-20 loading notes for my #2 rolling block. I load up to 18gr weight of old eynsford 3F under the lyman 311008 bullet, 115gr. If you load down to 14gr of 3F and a lighter bullet, that will reduce stress. But who's to say what future owners will shoot? Another considerations is the bottleneck 32-20 case creates greater bolt thrust.
I make my own reloadable 32 long rimfire and 32 XL rimfire cases.
The 32 long rimfire is for a #4RRB. For this I load 9.8gr by weight of Goex 3F over an 87gr bullet.
The 32XL is for a #2 RRB. For this I load 14gr of 3F Old E over an 87gr bullet with .125" compression.
Clearly the 32-20 can hold more powder than the 32 long or 32 XL rimfires, can and usually do load heavier bullets and with the bottleneck case deliver more bolt thrust. You may load an extra light BP load in it, but odds are someone else down the road will shoot factory or heavier reloads.
The Remington engineers designed the #4 as a lightweight boys rifle chambered in .22 or 32 short or long. It was never chambered for a 32 XL, 32-20 or anything larger due to its very light and weak action. They knew what they were doing. But even with these cartridges, the takedown versions often shoot lose due to wear and weak design. The solid frames are a little better, but they have the same small screws as pivot pins for block and hammer.
If you really want a 32-20, look for a worn out #2 and reline it. That's what I was going to do, but then I found a nice original #2 in 32-20. It's a great rifle. I also have that worn out #2 that I may reline or sell, not sure yet.
Sorry to rain on your parade, but the bottom line of this is whatever you do with this 100 some-odd year old rifle, doing it safely for you and future generations.