I think you are actually right. There was a slim planter there with generic shrubbery, behind a cement curb that did nothing for the theme. But at least it was a decent trip hazard.
Here's the exit in 1963 with the shrubs and curb.
And the random sign plopped there says
"ALL MOTORIZED VEHICLES ARE RESTRICTED FROM ENTERING INDIAN VILLAGE." Why would it be okay to leave a theme-killing sign out like that for anyone to see in 1963? Because, Walt! Walt cared even less than Chapek!
Here's the brick wall in November, 1963. They had built that mansion the year before, but abandoned the concept as a walk-thru while they worked on all the World's Fair pavilions for big corporate sponsors. The wall was not exactly pristine in the mid 1960's.