Gore Vidal 
In a Yellow Wood 

Robert Holton has returned from Europe and settled into a solitary existence working for a New York stockbroker. He suppresses memories of nights of love in Florence as he tries to succeed in the city, but when Carla turns up he has to choose between conventionality and the fraught path of love. (Goodreads)