How to fix weird “Production Breakpoints” errors in an Azure App Service?

This post was most recently updated on November 28th, 2021.

This article describes a curious fix I found to an issue where Application Insights (seemingly) crashes your Azure App Service, leaving behind interesting, yet non-descriptive errors in the Application Event Logs.

The actual symptoms might be your Azure app service just timing out with no errors being surfaced on the front-end. Frustrating.

Problem

Does your Azure App Service’s event log look like this? Full of “Production Breakpoints” with weird errors about named pipes?

In my case, the errors were something like these below:

IfFailRet(pNamedPipe->Read((BYTE*)&controlRequest, sizeof(SnapshotHolderControlStruct))) failed in function CSnapshotHolder::HandleNewPipeConnection: -2147024787

And:

CNamedPipe::Read - Read from named pipe failed: 0x8007006D.

Or:

CInstrumentationMethod::Initialize - failed to initialize instrumentation method PID: 12196 hr: 80131375 name: Production Breakpoint Instrumentation Method

Or something along those lines anyway.

What do?

These errors would always pop up at the same time the site would crash under fairly meager load. In one case, any user would crash the site. In another, a hundred or so RPS (requests per second) would completely destroy a site that’s supposed to be able to handle tens of thousands.

Impossible to tell whether the errors were logged because of the crash, or the app service crashed because of the same thing that caused the errors…

Reason

After a quick investigation, Application Insights seemed to be the source (“Production Breakpoints”) for the error. I had never heard of AppInsights crashing an App Service, but we did eas

This didn’t completely remove the issue, but did stabilize the app service. But how to get rid of the errors for good?

There’s a simple fix, though! Or at least there was for me. Maybe it’ll help you as well!

Earlier, when I had first had Azure DevOps enable “Monitoring”, it would install AppInsights extension to the Azure App Service website.

That’s a horrible mistake. Don’t do that.

The extensions are extremely fragile. I’ve posted about that earlier: You wouldn’t believe these 3 solutions to fix the error “500.32”, and what they look like now!

You might’ve also enabled these extensions by clicking the tempting buttons in Azure Portal. That might be a mistake as well.

Anyway – the extensions are kind of wild as they also add random application settings to your app service. And these settings have side effects – like in this case!

I had removed the extension, and we were using AppInsights with the SDK, i.e. without anything extra installed on the Azure App Service. But uninstalling the extension does not remove its Application Settings – which makes sense, because they DO have side effects, so you can’t really remove them, because some other functionality might be using them as well!

Oh, what fun.

Solution

This time, the solution was basically just a clean-up task: remove the unnecessary application settings that somehow mess up the app service. See below on how to do that!

And with any luck, you’re good.

Did it work for you? Let me know in the comments -section below!

• Author
• Recent Posts

Antti K. Koskela

Developer / Speaker / Consultant at Koskila / Etteplan Oyj / Norppandalotti Software Co / Alter - Experience Ideas Ltd.

Antti Koskela is a proud digital native nomadic millennial full stack developer (is that enough funny buzzwords? That's definitely enough funny buzzwords!), who works as a Cloud Solutions Architect for Etteplan Oyj, an engineering company that employs something like 700 devs building and fixing anything even half-digital.

He's been a developer from 2004 (starting with PHP and Java), and he's been working on .NET projects, Azure, Office 365, SharePoint and a lot of other stuff. He's also Microsoft MVP for Office Development.

This is his personal professional (e.g. professional, but definitely personal) blog.

Latest posts by Antti K. Koskela (see all)

• Azure Function build fails with “Mono.Cecil.AssemblyResolutionException: Failed to resolve assembly: Microsoft.AspNetCore.Mvc.Core” - December 1, 2021
• How to update from deprecated Microsoft.Azure.Services.AppAuthentication to new and shiny Azure.Security.KeyVaults.Secrets? - November 23, 2021
• Fixing Blazor WebAssembly .NET 6 MSAL authorization bug - November 16, 2021