{"id":10080,"date":"2022-05-17T11:42:00","date_gmt":"2022-05-17T14:42:00","guid":{"rendered":"http:\/\/made4it.com.br\/problems-with-traffic-from-cdn-local-ggc-google-and-bgp-ads\/"},"modified":"2023-02-13T11:11:34","modified_gmt":"2023-02-13T14:11:34","slug":"problems-with-traffic-from-cdn-local-ggc-google-and-bgp-ads","status":"publish","type":"post","link":"https:\/\/made4it.com.br\/en\/problems-with-traffic-from-cdn-local-ggc-google-and-bgp-ads\/","title":{"rendered":"Issues with local CDN traffic (Google GGC) and BGP ads"},"content":{"rendered":"\n<p>Hello. My name is Gabriel, I&#8217;m a network analyst here at Made4IT and today I&#8217;m going to tell you about an interesting situation involving CDN GGC Google and traffic engineering that we caught here in the consulting team a while ago.<br\/> <br\/>We received a call from a customer with a case where <strong>traffic from a local CDN GGC Google had a drastic decrease after a traffic engineering change.<\/strong> After extensive validations by the customer they were unable to find the root cause of this behavior and so they called our team. <br\/>We started there on 11\/04 with a strange decrease in Inbound traffic on the interface with the local CDN. It was very succinct and represented 1Gbps less traffic on the interface. <\/p>\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/www.made4it.com.br\/wp-content\/uploads\/2022\/05\/image-11.png\"><img fetchpriority=\"high\" decoding=\"async\" width=\"736\" height=\"242\" src=\"https:\/\/www.made4it.com.br\/wp-content\/uploads\/2022\/05\/image-11.png\" alt=\"\" class=\"wp-image-2135\" srcset=\"https:\/\/made4it.com.br\/wp-content\/uploads\/2022\/05\/image-11.png 736w, https:\/\/made4it.com.br\/wp-content\/uploads\/2022\/05\/image-11-300x99.png 300w\" sizes=\"(max-width: 736px) 100vw, 736px\" \/><\/a><\/figure>\n\n<p><br\/>With this info in hand, the first thing I did was access <a href=\"https:\/\/www.made4it.com.br\/made4flow-analisador-de-netflow\/\" class=\"rank-math-link\"><strong>Made4Flow<\/strong><\/a> to help understand what happened using of course my favorite chart, the \u201c<em>Interface by ASN<\/em>\u201d<br\/>I took care to take a time interval contemplating exactly the event from the 3rd to the 4th precisely to understand which ASNs were no longer \u201cserved\u201d by the local cache. <br\/><\/p>\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/www.made4it.com.br\/wp-content\/uploads\/2022\/05\/image-12.png\"><img decoding=\"async\" width=\"719\" height=\"288\" src=\"https:\/\/www.made4it.com.br\/wp-content\/uploads\/2022\/05\/image-12.png\" alt=\"\" class=\"wp-image-2136\" srcset=\"https:\/\/made4it.com.br\/wp-content\/uploads\/2022\/05\/image-12.png 719w, https:\/\/made4it.com.br\/wp-content\/uploads\/2022\/05\/image-12-300x120.png 300w\" sizes=\"(max-width: 719px) 100vw, 719px\" \/><\/a><\/figure>\n\n<p>With that in hand, I noticed 2 things right away:<br\/><em>&#8211; The \u201cOrange\u201d ASN here is no longer \u201cserved\u201d by this CDN, this is a fact due to the decrease in traffic evident in the graph&#8230;<br\/>&#8211; The \u201cBlue\u201d ASN(s) (a set of specific ASNs custom configured in our software) also showed a significant decrease in the graph. The \u201cBlue\u201d ASN is who hosts the cache. <\/em><br\/>The ASN \u201cOrange\u201d being also a Made4IT client allowed us a more efficient test within its network. ASN \u201cAzul\u201d and ASN \u201cOrange\u201d as partners gave us total freedom to carry out the <em>troubleshooting<\/em> and validate what was necessary on both sides. <br\/>After some checks, we used the content provider&#8217;s own tool to validate which &#8220;<em>node\/cache<\/em>&#8221; was &#8220;serving&#8221; this traffic that stopped coming from the local CDN of the &#8220;Azul&#8221; ASN. <br\/>This traffic no longer comes from the ASN \u201cAzul\u201d CDN, but it needs to come from somewhere, do you agree?<\/p>\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/www.made4it.com.br\/wp-content\/uploads\/2022\/05\/image-13.png\"><img decoding=\"async\" width=\"975\" height=\"120\" src=\"https:\/\/www.made4it.com.br\/wp-content\/uploads\/2022\/05\/image-13.png\" alt=\"\" class=\"wp-image-2137\" srcset=\"https:\/\/made4it.com.br\/wp-content\/uploads\/2022\/05\/image-13.png 975w, https:\/\/made4it.com.br\/wp-content\/uploads\/2022\/05\/image-13-300x37.png 300w, https:\/\/made4it.com.br\/wp-content\/uploads\/2022\/05\/image-13-768x95.png 768w\" sizes=\"(max-width: 975px) 100vw, 975px\" \/><\/a><\/figure>\n\n<p>In the image above, 2 things caught my attention:<br\/><em>&#8211; A Node in Guarulhos, referring to the network of this content provider, is the one who started to deliver the traffic that should previously come from the local CDN of the \u201cAzul\u201d ASN<br\/><strong>&#8211; x.x.x.0\/25?<\/strong><\/em><\/p>\n\n<p>At the time, a very important piece of information about ads for this content provider&#8217;s CDNs came to mind. They obey a rule that says:<br\/><strong>&#8211; Direct ads (ASN hosting cache) node accepts up to \/27 for direct influence on traffic engineering and content delivery eligibility.<br\/>&#8211; Indirect advertisements (ASNs adjacent to the ASN hosting the cache) the node only accepts up to \/24 for direct influence on traffic engineering and content delivery eligibility.<\/strong><br\/>Alright, for the ASN \u201cAzul\u201d traffic I already had the possible cause of the problem. When trying to induce this local node to deliver more traffic, they ended up announcing \/25 blocks to the cache node, implying that the content provider network would \u201cserve\u201d this traffic via its nodes in Guarulhos. <br\/>However, we still have a decrease in traffic on the \u201cAzul\u201d ASN, what happened? <br\/>The \u201cBlue\u201d ASN in this case was actually 3 ASNs, something that was custom created in the Made4Flow software. Interestingly, 2 of these ASNs were \u201cinjecting\u201d \/25 prefixes into the CDN node, where the behavior found was exactly the same as the one reported above for the ASN \u201cOrange.<\/p>\n\n<p>With all this information in hand, we set out to get our hands dirty and adjust the ads respecting what the content provider requests (and has documented) for its CDN. After the necessary adjustments, see the result: <\/p>\n\n<figure class=\"wp-block-image size-large\"><a href=\"https:\/\/www.made4it.com.br\/wp-content\/uploads\/2022\/05\/image-14.png\"><img loading=\"lazy\" decoding=\"async\" width=\"822\" height=\"271\" src=\"https:\/\/www.made4it.com.br\/wp-content\/uploads\/2022\/05\/image-14.png\" alt=\"\" class=\"wp-image-2138\" srcset=\"https:\/\/made4it.com.br\/wp-content\/uploads\/2022\/05\/image-14.png 822w, https:\/\/made4it.com.br\/wp-content\/uploads\/2022\/05\/image-14-300x99.png 300w, https:\/\/made4it.com.br\/wp-content\/uploads\/2022\/05\/image-14-768x253.png 768w\" sizes=\"(max-width: 822px) 100vw, 822px\" \/><\/a><\/figure>\n\n<p><strong>Conclusion:<\/strong><br\/>We know that for a CDN node to work there are several factors and that it involves protocols working in an orchestrated way, such as BGP, DNS, TCP, among others&#8230; CDN out of acceptable range.<br\/>When we announce the blocks <strong>\/25<\/strong> of ASNs adjacent to the ASN hosting the node\/cache, the &#8220;player&#8221; started delivering traffic to that ASN\/Prefix via its CDN nodes from <strong>Guarulhos<\/strong>, implying an increase in indirect traffic on our ASN client \u201cAzul\u201d and loss of performance and efficiency of the local node.<\/p>\n\n<p>Users behind this network were directly affected as their content started to be delivered by an infrastructure over 1000kms away, increasing latency, loading time and overall user experience. <br\/>After adjustments in traffic engineering respecting the content provider&#8217;s documentation and good BGP practices, the node started to behave again as expected. <br\/>For traffic engineering contemplating CDNs, always respect the documentation of the player in question and use its tools to detect which \u201cnode\u201d is \u201cserving\u201d the traffic. Usually CDN players also have a portal to monitor the performance of the cache with metrics and very important data about it, use these tools to your advantage.<\/p>\n\n<p>Did you find it interesting and want to see a little more about how the software we use in this conversation works or do you want to talk to a specialist to solve problems like this on your network? <a href=\"https:\/\/api.whatsapp.com\/send?phone=5543984854013&amp;text=Oi%2C%20gostaria%20de%20mais%20informa%C3%A7%C3%B5es\" class=\"rank-math-link\">Talk to our team<\/a><br\/><strong>&#8211; Gabriel Henrique, Network Analyst at Made4IT, has been working with technology and ISPs for over 10 years.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hello. My name is Gabriel, I&#8217;m a network analyst here at Made4IT and today I&#8217;m going to tell you about an interesting situation involving CDN GGC Google and traffic engineering that we caught here in the consulting team a while ago. We received a call from a customer with a case where traffic from a [&hellip;]<\/p>\n","protected":false},"author":13,"featured_media":9042,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"postBodyCss":"","postBodyMargin":[],"postBodyPadding":[],"postBodyBackground":{"backgroundType":"classic","gradient":""},"footnotes":""},"categories":[352],"tags":[393,394,391,392],"class_list":["post-10080","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized-en","tag-cdn-en","tag-cdn-local-en","tag-cdn-traffic","tag-google-traffic"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/made4it.com.br\/en\/wp-json\/wp\/v2\/posts\/10080","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/made4it.com.br\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/made4it.com.br\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/made4it.com.br\/en\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/made4it.com.br\/en\/wp-json\/wp\/v2\/comments?post=10080"}],"version-history":[{"count":0,"href":"https:\/\/made4it.com.br\/en\/wp-json\/wp\/v2\/posts\/10080\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/made4it.com.br\/en\/wp-json\/wp\/v2\/media\/9042"}],"wp:attachment":[{"href":"https:\/\/made4it.com.br\/en\/wp-json\/wp\/v2\/media?parent=10080"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/made4it.com.br\/en\/wp-json\/wp\/v2\/categories?post=10080"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/made4it.com.br\/en\/wp-json\/wp\/v2\/tags?post=10080"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}