In a mixing bowl, whisk egg, and then whisk in the next 9 ingredients. Add ¼ cup of the panko to the egg mixture. Once well combined, gently fold in the crab. Put the remaining panko on a plate, to dredge the crab cakes.
Make a quick tester for seasoning. Take a spoonful of the crab mixture, and make a mini crab cake. Dip the cake lightly into the panko on both sides. Heat a drizzle of olive in a skillet (nonstick is great for this, if you have one). Once the oil is hot, add the tester cake and cook on both sides until golden, just a couple minutes in total. Test and adjust seasoning as needed, adding more salt or lemon, etc.
Form the crab patties out of the crab mixture, roughly 1½ inches by ¾ inch. About 14 in total. Dredge in panko, and refrigerate for at least an hour to firm up.
If you have a nonstick skillet, this is a great time to use it. Either way, heat 1 or 2 tablespoons of oil in a medium skillet, enough to coat the bottom. When oil is hot, add the cakes, turning after a couple of minutes when golden brown. Wipe the skillet with a paper towel between batches, so the panko doesn’t burn.
Serve with lemon wedges.