Bond prices fell. The yield on the 10-year Treasury rose to 2.99 percent.
The Federal Reserve has signaled it will raise rates twice more this year, after having done so in March, and most economists foresee the next increase in June.
Australian stocks bucked the region's downward trend, rising 0.4%. Small-company stocks also rose.
Among the technology stocks pressuring the overall market, Alphabet Inc., the parent company of Google, fell 2%, while Facebook Inc. lost 1.2%. Mortgage rates, which have been rising this year, tend to track the movement in the 10-year Treasury yield. Higher mortgage rates can make it harder for would-be buyers to purchase a home.
Core April retail sales - which excludes gasoline, automobiles, building materials and food services - rose at a brisker 0.4 percent monthly pace over March, as consumer spending is quickening its pace after a first-quarter slowdown.
Home Depot Inc shares slipped 1.6% after the home improvement retailer missed sales forecasts as the long winter put a damper on demand for spring products.
Technology and health care companies took some of the worst losses. Chipmaker Nvidia fell 3.8 percent to $245.56.
City soak up fans' adulation in victory parade
He is now the all-time top-scoring foreign player in a single season in Premier League history, moving past Ronaldo and Suarez. He's always positive, going there and creating good environments in the clubs.
ENERGY: Benchmark U.S. crude oil gained 59 cents to $71.55 a barrel in electronic trading on the New York Mercantile Exchange. Brent crude, used to price global oil, gained 77 cents to $79.00 a barrel in London.
CURRENCY: The dollar fell to 110.27 yen from 110.36 yen late Tuesday.
The greenback's gains weighed on precious metals prices.
The S&P 500 rose 9 points, or 0.3 percent, to 2,736. Silver dropped 38 cents, or 2.3 percent, to $16.27 an ounce.
Major indexes in Europe finished mixed Tuesday. The technological Nasdaq Composite expanded by 0.1% and ended at 7,411.32 points. Germany's DAX gained only 0.1 percent to 12,991 after new data showed the country's economy slowed in the first quarter. Britain's FTSE 100 added 0.2 percent.
Japan's benchmark Nikkei 225 edged down 0.2 percent to 22,818.02. The Dow Jones Small-Cap Value TSM Index closed at 10,162.47 for a gain of 1.12 points or 0.01%.
NORTH KOREA: North Korea canceled a high-level meeting with South Korea, threatening to scrap a historic summit next month between President Donald Trump and North Korean leader Kim Jong Un over military exercises between Seoul and Washington that Pyongyang has long claimed are rehearsals for invasion. Hong Kong's Hang Seng fell 0.8%.