Heat 1 tablespoon of the olive oil in a 10- or 12-inch cast iron or nonstick skillet over medium-high heat until shimmering. Tilt the pan so that the oil coats the bottom. Using a wide, flat spatula, gently transfer 4 of the patties into the pan and cook, flipping once, until golden-brown and crisp, about 3 minutes per side. Repeat with the remaining 1 tablespoon oil and 4 patties. Serve warm with sour cream, if desired.