<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>article NGINX ingress segfault issue (AKS App Routing Add-on) in Troubleshooting</title>
    <link>https://community.dynatrace.com/t5/Troubleshooting/NGINX-ingress-segfault-issue-AKS-App-Routing-Add-on/ta-p/300349</link>
    <description>&lt;DIV class="lia-message-template-content-zone"&gt;
&lt;H3&gt;Summary&lt;/H3&gt;
We’ve observed an segfault issue impacting customers using the following ingress controller image:&lt;A href="http://mcr.microsoft.com/oss/v2/ingress-nginx/controller:v1.13.9" target="_blank" rel="noopener"&gt;mcr.microsoft.com/oss/v2/ingress-nginx/controller:v1.13.9&lt;/A&gt;&lt;/DIV&gt;
&lt;H3 class="lia-message-template-content-zone"&gt;&amp;nbsp;&lt;/H3&gt;
&lt;H3 class="lia-message-template-content-zone"&gt;&lt;STRONG&gt;Problem&lt;/STRONG&gt;&lt;/H3&gt;
&lt;UL style="direction: ltr; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;" type="disc"&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Intermittent request failures&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Frequent crashes of nginx ingress worker processes&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Kernel logs showing repeated segfaults:&lt;/SPAN&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;P style="margin: 0in; font-family: Calibri; font-size: 11.0pt;"&gt;kernel: nginx[4143235]: segfault at 7 ip 00007feb5b80845b sp 00007ffde8362200 error 4 in liboneagentnginx.so&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;H3&gt;&lt;SPAN&gt;Root cause (likely)&lt;/SPAN&gt;&lt;/H3&gt;
&lt;P&gt;&lt;SPAN&gt;This image is part of AKS Application Routing add-on (managed NGINX ingress by Microsoft)&lt;/SPAN&gt;&lt;/P&gt;
&lt;UL style="direction: ltr; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;" type="disc"&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;It uses a patched/custom nginx binary. This image is part of AKS Application Routing add-on (managed NGINX ingress by Microsoft)&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Dynatrace NGINX code module (liboneagentnginx.so) relies on fixed assumptions about nginx internals.&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Due to this binary mismatch, instrumentation can lead to segfaults in nginx processes.&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Microsoft:&amp;nbsp; &lt;/SPAN&gt;&lt;A href="https://learn.microsoft.com/en-us/azure/aks/app-routing" target="_blank" rel="noopener"&gt;&lt;SPAN&gt;https://learn.microsoft.com/en-us/azure/aks/app-routing&lt;/SPAN&gt;&lt;/A&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;H3&gt;&amp;nbsp;&lt;/H3&gt;
&lt;H3&gt;&lt;SPAN&gt;&lt;STRONG&gt;Important notes&lt;/STRONG&gt;&lt;/SPAN&gt;&amp;nbsp;&lt;/H3&gt;
&lt;UL style="direction: ltr; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;" type="disc"&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;AKS App Routing is fully managed, so: &lt;/SPAN&gt;&lt;/LI&gt;
&lt;UL style="direction: ltr; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;" type="circle"&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Pod/deployment-level changes are restricted&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Forced runtime instrumentation is NOT possible&lt;/SPAN&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;/UL&gt;
&lt;H3&gt;&amp;nbsp;&lt;/H3&gt;
&lt;H3&gt;Resolution&lt;/H3&gt;
&lt;P&gt;Disable OneAgent injection for ingress pods/namespace&lt;/P&gt;
&lt;P&gt;For cloudNativeFullStack / applicationMonitoring:&lt;/P&gt;
&lt;UL&gt;
&lt;LI style="font-family: Calibri; font-size: 11pt;"&gt;
&lt;P&gt;Use annotations mentioned in Docs: &lt;A href="https://docs.dynatrace.com/docs/shortlink/annotate" target="_blank" rel="noopener"&gt;https://docs.dynatrace.com/docs/shortlink/annotate&lt;/A&gt;&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;For classicFullStack&lt;/P&gt;
&lt;UL&gt;
&lt;LI style="font-family: Calibri; font-size: 11pt;"&gt;Use &lt;SPAN&gt;container monitoring rules&lt;/SPAN&gt; to exclude the process - &lt;A href="https://docs.dynatrace.com/docs/shortlink/container-monitoring-rules" target="_blank" rel="noopener"&gt;https://docs.dynatrace.com/docs/shortlink/container-monitoring-rules&lt;/A&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;&lt;SPAN&gt;Disabling injection successfully stops crashes and restores stability.&lt;/SPAN&gt;&lt;/P&gt;
&lt;H3&gt;What's next&lt;/H3&gt;
&lt;UL style="direction: ltr; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;" type="disc"&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Link to Azure Github Issue -&amp;nbsp;&lt;A href="https://github.com/Azure/AKS/issues/5796" target="_blank" rel="noopener"&gt;https://github.com/Azure/AKS/issues/5796&lt;/A&gt;&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;This is currently the only supported workaround.&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;&lt;SPAN&gt;In case of any other&amp;nbsp;&lt;/SPAN&gt;&lt;/SPAN&gt;patched NGINX, please follow &lt;A href="https://docs.dynatrace.com/docs/ingest-from/technology-support/application-software/nginx/manual-runtime-instrumentation" target="_self"&gt;document&lt;/A&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;Please open a support ticket incase of any issues/concerns along OneAgent Support archive.&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Fri, 12 Jun 2026 10:13:34 GMT</pubDate>
    <dc:creator>bhaveshbjoshi</dc:creator>
    <dc:date>2026-06-12T10:13:34Z</dc:date>
    <item>
      <title>NGINX ingress segfault issue (AKS App Routing Add-on)</title>
      <link>https://community.dynatrace.com/t5/Troubleshooting/NGINX-ingress-segfault-issue-AKS-App-Routing-Add-on/ta-p/300349</link>
      <description>&lt;DIV class="lia-message-template-content-zone"&gt;
&lt;H3&gt;Summary&lt;/H3&gt;
We’ve observed an segfault issue impacting customers using the following ingress controller image:&lt;A href="http://mcr.microsoft.com/oss/v2/ingress-nginx/controller:v1.13.9" target="_blank" rel="noopener"&gt;mcr.microsoft.com/oss/v2/ingress-nginx/controller:v1.13.9&lt;/A&gt;&lt;/DIV&gt;
&lt;H3 class="lia-message-template-content-zone"&gt;&amp;nbsp;&lt;/H3&gt;
&lt;H3 class="lia-message-template-content-zone"&gt;&lt;STRONG&gt;Problem&lt;/STRONG&gt;&lt;/H3&gt;
&lt;UL style="direction: ltr; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;" type="disc"&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Intermittent request failures&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Frequent crashes of nginx ingress worker processes&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Kernel logs showing repeated segfaults:&lt;/SPAN&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;P style="margin: 0in; font-family: Calibri; font-size: 11.0pt;"&gt;kernel: nginx[4143235]: segfault at 7 ip 00007feb5b80845b sp 00007ffde8362200 error 4 in liboneagentnginx.so&lt;/P&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;
&lt;H3&gt;&lt;SPAN&gt;Root cause (likely)&lt;/SPAN&gt;&lt;/H3&gt;
&lt;P&gt;&lt;SPAN&gt;This image is part of AKS Application Routing add-on (managed NGINX ingress by Microsoft)&lt;/SPAN&gt;&lt;/P&gt;
&lt;UL style="direction: ltr; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;" type="disc"&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;It uses a patched/custom nginx binary. This image is part of AKS Application Routing add-on (managed NGINX ingress by Microsoft)&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Dynatrace NGINX code module (liboneagentnginx.so) relies on fixed assumptions about nginx internals.&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Due to this binary mismatch, instrumentation can lead to segfaults in nginx processes.&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Microsoft:&amp;nbsp; &lt;/SPAN&gt;&lt;A href="https://learn.microsoft.com/en-us/azure/aks/app-routing" target="_blank" rel="noopener"&gt;&lt;SPAN&gt;https://learn.microsoft.com/en-us/azure/aks/app-routing&lt;/SPAN&gt;&lt;/A&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;H3&gt;&amp;nbsp;&lt;/H3&gt;
&lt;H3&gt;&lt;SPAN&gt;&lt;STRONG&gt;Important notes&lt;/STRONG&gt;&lt;/SPAN&gt;&amp;nbsp;&lt;/H3&gt;
&lt;UL style="direction: ltr; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;" type="disc"&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;AKS App Routing is fully managed, so: &lt;/SPAN&gt;&lt;/LI&gt;
&lt;UL style="direction: ltr; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;" type="circle"&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Pod/deployment-level changes are restricted&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Forced runtime instrumentation is NOT possible&lt;/SPAN&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;/UL&gt;
&lt;H3&gt;&amp;nbsp;&lt;/H3&gt;
&lt;H3&gt;Resolution&lt;/H3&gt;
&lt;P&gt;Disable OneAgent injection for ingress pods/namespace&lt;/P&gt;
&lt;P&gt;For cloudNativeFullStack / applicationMonitoring:&lt;/P&gt;
&lt;UL&gt;
&lt;LI style="font-family: Calibri; font-size: 11pt;"&gt;
&lt;P&gt;Use annotations mentioned in Docs: &lt;A href="https://docs.dynatrace.com/docs/shortlink/annotate" target="_blank" rel="noopener"&gt;https://docs.dynatrace.com/docs/shortlink/annotate&lt;/A&gt;&lt;/P&gt;
&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;For classicFullStack&lt;/P&gt;
&lt;UL&gt;
&lt;LI style="font-family: Calibri; font-size: 11pt;"&gt;Use &lt;SPAN&gt;container monitoring rules&lt;/SPAN&gt; to exclude the process - &lt;A href="https://docs.dynatrace.com/docs/shortlink/container-monitoring-rules" target="_blank" rel="noopener"&gt;https://docs.dynatrace.com/docs/shortlink/container-monitoring-rules&lt;/A&gt;&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;&lt;SPAN&gt;Disabling injection successfully stops crashes and restores stability.&lt;/SPAN&gt;&lt;/P&gt;
&lt;H3&gt;What's next&lt;/H3&gt;
&lt;UL style="direction: ltr; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;" type="disc"&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;Link to Azure Github Issue -&amp;nbsp;&lt;A href="https://github.com/Azure/AKS/issues/5796" target="_blank" rel="noopener"&gt;https://github.com/Azure/AKS/issues/5796&lt;/A&gt;&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;This is currently the only supported workaround.&lt;/SPAN&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;&lt;SPAN&gt;&lt;SPAN&gt;In case of any other&amp;nbsp;&lt;/SPAN&gt;&lt;/SPAN&gt;patched NGINX, please follow &lt;A href="https://docs.dynatrace.com/docs/ingest-from/technology-support/application-software/nginx/manual-runtime-instrumentation" target="_self"&gt;document&lt;/A&gt;&lt;/LI&gt;
&lt;LI style="margin-top: 0; margin-bottom: 0; vertical-align: middle;"&gt;Please open a support ticket incase of any issues/concerns along OneAgent Support archive.&lt;/LI&gt;
&lt;/UL&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Fri, 12 Jun 2026 10:13:34 GMT</pubDate>
      <guid>https://community.dynatrace.com/t5/Troubleshooting/NGINX-ingress-segfault-issue-AKS-App-Routing-Add-on/ta-p/300349</guid>
      <dc:creator>bhaveshbjoshi</dc:creator>
      <dc:date>2026-06-12T10:13:34Z</dc:date>
    </item>
    <item>
      <title>Re: NGINX ingress segfault issue (AKS App Routing Add-on)</title>
      <link>https://community.dynatrace.com/t5/Troubleshooting/NGINX-ingress-segfault-issue-AKS-App-Routing-Add-on/tac-p/301370#M1145</link>
      <description>&lt;P&gt;Microsoft on the issue &lt;A href="https://github.com/Azure/AKS/issues/5796," target="_blank" rel="noopener"&gt;https://github.com/Azure/AKS/issues/5796,&lt;/A&gt; is claiming that is&amp;nbsp;&lt;SPAN&gt;outside the AKS support scope to provided a fix for&amp;nbsp;AKS App Routing, even be full managed (&lt;/SPAN&gt;&lt;SPAN&gt;Pod/deployment-level changes are restricted&lt;/SPAN&gt;&lt;SPAN&gt;) by AKS. &lt;a href="https://community.dynatrace.com/t5/user/viewprofilepage/user-id/6"&gt;@MaciejNeumann&lt;/a&gt; and&amp;nbsp;&lt;a href="https://community.dynatrace.com/t5/user/viewprofilepage/user-id/70560"&gt;@bhaveshbjoshi&lt;/a&gt;&amp;nbsp;Is there any evidence, recommendation or guidance that we can provide to our customer to escalate this to AKS support?&amp;nbsp;&lt;/SPAN&gt;&lt;/P&gt;</description>
      <pubDate>Tue, 30 Jun 2026 10:24:20 GMT</pubDate>
      <guid>https://community.dynatrace.com/t5/Troubleshooting/NGINX-ingress-segfault-issue-AKS-App-Routing-Add-on/tac-p/301370#M1145</guid>
      <dc:creator>artigas</dc:creator>
      <dc:date>2026-06-30T10:24:20Z</dc:date>
    </item>
    <item>
      <title>Re: NGINX ingress segfault issue (AKS App Routing Add-on)</title>
      <link>https://community.dynatrace.com/t5/Troubleshooting/NGINX-ingress-segfault-issue-AKS-App-Routing-Add-on/tac-p/301929#M1152</link>
      <description>&lt;P&gt;Hi&amp;nbsp;&lt;a href="https://community.dynatrace.com/t5/user/viewprofilepage/user-id/101596"&gt;@artigas&lt;/a&gt;&amp;nbsp;it seems the monitoring was not working earlier. With the changes introduced by MS it seems that OA is injecting into the process. Usually, OA doesn't inject into the patched nginx. You can verify the binaries loaded in earlier patch and impacted patch by using following command.&lt;/P&gt;
&lt;PRE&gt;ldd &lt;/PRE&gt;
&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
      <pubDate>Wed, 15 Jul 2026 06:25:59 GMT</pubDate>
      <guid>https://community.dynatrace.com/t5/Troubleshooting/NGINX-ingress-segfault-issue-AKS-App-Routing-Add-on/tac-p/301929#M1152</guid>
      <dc:creator>bhaveshbjoshi</dc:creator>
      <dc:date>2026-07-15T06:25:59Z</dc:date>
    </item>
  </channel>
</rss>

