Pour the milk into a microwave proof pitcher, and cook in the microwave on high until the milk begins to simmer, 4 to 5 minutes depending on the microwave. Meanwhile, whisk the eggs together with 1/4 cup sugar in a large bowl. Once the milk is hot, slowly drizzle into the eggs while whisking until all of the milk has been incorporated. Scrape the custard into a saucepan. Cook over medium heat, stirring frequently, until the custard has thickened enough to coat the back of a metal spoon, about 5 minutes. Pour the custard into a bowl, cover with plastic wrap, and refrigerate several hours until cold.

Whip the cream with the remaining 2 tablespoons of sugar to firm peaks; set aside. Line the bottom and sides of a trifle bowl with half of the pound cake slices. Drizzle the pound cake slices with half of the sherry. Pour 1/3 of the cold custard into the trifle dish and smooth the top. Repeat to make two more layers of pound cake, sherry, and custard. Top with whipped cream.

Cover the dish with plastic wrap, and refrigerate at least 2 hours before serving to allow the flavors to blend.