I agree with asking for help from others, but I’ll disagree with Qwazse’s comment that the OP didn’t have much direct contact. To me, the ASM has as much, if not more, direct contact with the Scouts. At least that’s how I did it. I was the guy herding the cats, printing out their camp MB schedules and making sure they had a buddy to get to their classes. That left the SM to work on the big-picture stuff, like finding potential camp projects to present to the SPL to choose from.
We’re a very small troop right now, so as the newly-minted SM, I talked to another small troop about share a site at camp, which lets us back eachother up. If that’s an option, I highly recommend it, so long as you can live with their style. We were assigned another troop last year and their SM was totally useless, to the point where it wasn’t safe (e.g. dancing in campfire, constant knife-play), along with being a terrible example for our Scouts. I ended up spending a ton of time coaching him and their SPL. I just wish I knew if any of it stuck.