It can be done. I have a
former RF who's defense deteriorated (all the way down to a 1 in OF range). He had played a few games here and there at first over his career, but I decided to make him a full-time first baseman this year and he's played pretty well. His IF ratings are 1-2-2-2, so he's a little better than your guy is, but not much.