Can I volunteer to go infantry in the air force even though I didn't pass air force color vision standards?

Sounds like either your recruiter needs to learn to communicate better or you need to listen better. He is talking about a one time thing that he lucked into. it has nothing to do with recruiting and shouldn't even be brought up. He probably thought he was going to lose you to the Army. You sign up for a specific job in the AF, maybe you do something different once over a 20 year career as your recruiter may have done. But don't base your career choice on that possibility. If you want to be on the ground then find a different job.