Yep, you were too close. If you could see him at 55 yards, he could see you and also couldn't see the hen he was looking for. Set up farther away and use a decoy. After a few mornings you'll get some idea of his preferred routine.
Also I avoid sitting under very large trees that I can't see around (with minimal movement) for other turkeys. That's buggered me up more than once.
"The joy of living is his, who has the heart to demand it." Teddy Roosevelt