Many new igs only eat at night, or wait a long time after you place the plate of food. It is real good that he is eating at all.
You should go ahead and try feeding him 2 or 3 times/day. If he can be prompted to eat the food fresher this way, it's worth it. Maybe he's become used to crappy, dried out food.
Being just a baby, he can't be expected to not stress out from handling or having hour face real close. Sneak his dish into and out of his cage as subtly as possible.
Wait until he is eating well before experimenting with handling.
Their natural food is loaded with water, so low eating leads to dehydration, which for igs is a sickness which causes even less eating. If it becomes necessary, a vet visit can help with that.