This side pairs well with seared steak or fried eggs.
Preheat oven to 400 degrees. On a rimmed baking sheet, toss together potatoes and olive oil; season with salt and pepper. Arrange in a single layer and roast until potatoes are tender when pierced with a knife, 35 to 40 minutes. Meanwhile, in a small bowl, whisk together mayonnaise, lemon juice, garlic, and paprika; season to taste with salt and pepper. Serve potatoes with sauce.