[Blog](/blog)

Show links

Resources

[Blog](/blog)

[Breaches](/breaches)

[eBooks, reports, & more](/resources)

[Events](/events)

[News](/news)

[Third-Party Risk Management](/category/third-party-risk-management)

Show links

Categories

[Attack Surface Management](/category/attack-surface-management)

[Company News](/category/company-news)

[Compliance and Regulations](/category/compliance-and-regulations)

[Cybersecurity](/category/cybersecurity)

[Data Breaches](/category/data-breaches)

[DevOps](/category/devops)

[Human Cyber Risk](/category/human-cyber-risk)

[Risks and Vulnerabilities](/category/risks-and-vulnerabilities)

[Third-Party Risk Management](/category/third-party-risk-management)

[Vendor Risk Management](/category/vendor-risk-management)

[Detecting AI in the Software Supply Chain](/blog/detecting-ai-in-the-software-supply-chain)

Publish date

July 2, 2026

{x} minute read

# Detecting AI in the Software Supply Chain

[Get a demo](/contact-sales)

[Free trial](/demo)

[Download the PDF guide](/resources/artificial-intelligence-and-the-future-of-tprm)

[Free trial](/demo)

Written by

[Greg Pollock](/team/greg-pollock)

Director of Research and Insights

Greg is a CISA-certified cybersecurity researcher who holds multiple patents for data leak detection. His findings have been featured in The New York Times, Forbes, and Wired.

Reviewed by

[Kaushik Sen](/team/kaushik-sen)

Chief Marketing Officer

Kaushik has a background in software engineering, enterprise solution architecture, and data analytics. He brings a unique, data-driven perspective to cybersecurity education.

Table of contents

eBook

Artificial Intelligence and the Future of TPRM

Free resource

### Artificial Intelligence and the Future of TPRM

[Download now](/resources/artificial-intelligence-and-the-future-of-tprm)

Using third-party generative AI services requires transmitting user inputs to those providers for processing. That puts fourth-party Artificial Intelligence vendors squarely within the jurisdiction of your organization’s [Vendor Risk Management program](https://www.upguard.com/blog/vendor-risk-management). In other words, when third parties share your data with [fourth-party service providers](https://www.upguard.com/blog/what-is-fourth-party-risk), you need to know the data is handled in accordance with your security practices. The current state of AI regulation and adoption makes it all the more urgent to understand when those fourth-party vendors are providing AI software and or any other AI-powered service.

[Risk appetites](https://www.upguard.com/blog/risk-appetite-calculation-third-party-risk-management) for AI systems vary widely between companies. We have heard from organizations that require no exposure to AI services and others that want to ensure they are realizing AI-enabled and machine learning productivity gains. These divergent security risk appetites mirror the high variance in how regulations apply by geography and industry.

The EU has already had an [AI Act in force since August 2024](https://commission.europa.eu/news/ai-act-enters-force-2024-08-01_en). The US has a patchwork of [existing](https://www.skadden.com/insights/publications/2024/04/utah-becomes-first-state) and [emerging](https://iapp.org/resources/article/us-state-ai-governance-legislation-tracker/) state laws, with no federal regulation in sight. Australia’s policy approach is in progress. Whereas existing data privacy laws have focused on data types, AI regulation looks at decision making, creating greater regulatory focus for new industries.

As if a rapidly evolving risk environment weren’t challenging enough, AI adoption is also proliferating rapidly. As of the end of 2024, ChatGPT claimed over 300 million weekly active users and 1.3 million developer accounts.

In this report, we show that at least 30% of companies are using AI services to process user data. Thus, the urgency: regulatory requirements for AI technology are coming to a head at the same time that the amount of AI usage in the [software supply chain](https://www.upguard.com/blog/what-is-the-digital-supply-chain) is increasing, creating a ticking time bomb for those who ignore it. As AI usages grows unchecked, the supply chain risks they create will continue compounding.

This report provides specific examples of how AI can be detected in the supply chain, the frequency of different types of use, and how to incorporate it into your Vendor Risk Management program.

## Collecting evidence of AI usage

The UpGuard platform collects evidence by scanning public websites for technical information by gathering security documentation from vendor&#x73;*—*&#x64;ata that could also be used to highlight supply chain risks in [vendor risk assessments](https://www.upguard.com/product/risk-assessments). This report uses data collected by scanning websites for third-party code and dependencies and by crawling websites for public data subprocessor pages.

We used data collected for the 250 most commonly monitored vendors in the UpGuard platform to best represent the impacts these issues can have on the real-world supply chain ecosystem.

## AI vendors visible via external scanning 

Websites reveal part of their software supply chain by using scripts hosted on third-party vendor domains. Those domains can be associated with vendors, which can, in turn, be classified as AI vendors based on their services.

Across the 250 most used vendors, 36 (14%) had websites configured to run code from a third-party vendor providing AI services.

Embedding scripts on a website has long been a way to deploy predictive marketing analytics tools quickly. Amongst the AI vendors detected this way, there are still many analytics tools, but the hallmark capability of generative AI is right in the name of ChatGPT.

Chat agents are the most common type of AI capability deployed via third-party code. The function of a chat agent speaks to the kind of data likely being passed to the AI fourth party: sales and support inquiries. If a fouth-party AI vendor is compromised, chat agents could serve as attack vectors exposing the software supply chain to supply chain attacks or malware injections.

## AI vendors detected using subprocessor disclosures

When your company’s third-party providers share personal datasets with fourth parties, those fourth parties become what GDPR calls a “[data subprocessor](https://www.gdprsummary.com/gdpr-definitions/sub-processor/).” A typical example would be cloud hosting services. You give your payroll vendor your employees’ information, and they store it in a database hosted in AWS, and now AWS is a subprocessor of your data. [GDPR-compliant](https://www.upguard.com/blog/how-to-be-gdpr-compliant) companies must disclose their data subprocessors to their customers.

Many companies [voluntarily](https://www.upguard.com/company/subprocessors) make their data subprocessor lists public. Out of the 250 companies in this survey, UpGuard researchers identified public subprocessor pages for 147. The other companies almost certainly have data subprocessors but elect to disclose that information only on demand.

There is no standard structure for data subprocessor pages, creating challenges for automated data collection and continuous monitoring. The most typical implementation of a subprocessor page is an HTML table, though the number and labeling of columns in that table vary between companies.

The information can also be in PDFs or other embedded documents that, again, have arbitrary structures. Large companies might have different subprocessors for different products and regions. These factors make confident automated analysis of subprocessor pages possible for most but not all instances. Out of the 147 pages, 119 could be analyzed programmatically.

Because LLM solutions like “OpenAI” and “Anthropic” have unique vendor names, subprocessor pages could be confidently searched to determine whether these companies were listed as subprocessors. “Gemini” and “Vertex” were used to identify Google AI services.

No false positives or validation errors were discovered when manually verifying the results generated by automated analysis. We omitted results for Microsoft AI services because there were relatively few results in our exploration, and Microsoft AI services were often also identified as OpenAI delivered through Azure.

Out of 147 subprocessor pages, 36% of companies listed OpenAI as a data subprocessor, 10% listed Google Gemini or Vertex, and 9% listed Anthropic.

Whereas the chatbots embedded in internet-facing webpages are distributed amongst many small companies, the AI model services used by backend systems for processing production data are highly concentrated in a handful of vendors, most notably in OpenAI.

Over one-third of the companies analyzed (53 out of 147) are processing personal data with OpenAI. That is a very conservative measurement of OpenAI usage– it is likely more companies are using them in ways that do not require disclosure as a data subprocessor.

Interestingly, OpenAI also allows users to [publish custom GPTs](https://chatgpt.com/g/g-alKfVrz9K-canva) in the ChatGPT store. To prevent brand impersonation cyber threats, companies must add a DNS record to their domain to prove they own it. DNS records are another threat intelligence source that UpGuard scans, making it easy to determine which companies had OpenAI domain verification records.

There is no meaningful correlation between the two kinds of OpenAI usage– 53 companies use OpenAI as a subprocessor, 36 have verified their domain for publishing custom GPTs, and only 10 companies have done both.

## How to use this in your VRM program

Hearing that vendors are, most likely, passing your company's personal data to OpenAI sounds alarming. And if you’re not currently incorporating that information into your Vendor Risk Management program or cybersecurity risk assessments, you should be. However, the point of data subprocessor disclosures is that by knowing who processes your data, security teams can accurately assess whether they are potential vulnerabilities impacting your security posture.

In the case of OpenAI, which UpGuard uses, the terms of service for the Enterprise and Platform plans ensure that information submitted to OpenAI is not used for training data models. Add in their other documented security measurements to keep that data confidential; the risk is comparable to that of cloud hosting providers.

By documenting OpenAI as a data subprocessor and collecting evidence from OpenAI that shows it does not use data for training, we can effectively support remediation of the risk it poses as a data subprocessor. You should be able to follow that process for all your vendors; they should disclose their AI supply chain and whether they use input data for training models or AI development.

> Vendors may also levergae AI in their development processes, embedding it into the software development lifecycle. Monitoring AI development pipelines ensures alignment with your ideal AI security practices.

Ultimately, documented data subprocessors should be a layup for vendor management and procurement. If a fourth party like OpenAI is listed as a subprocessor, everyone involved—you, your vendor, and OpenAI—knows their privacy policies are being assessed. This clarity also strengthens incident responses, enabling rapid action if a fourth-party AI breach occurs, minimizing downstream impacts.

This information can be collected by visiting the websites of each of your vendors and locating the subprocessor's page or by using a vendor risk automation platform like UpGuard that centralizes evidence collection. Shadow AI requires multiple detection strategies, but automated detection of fourth parties via website code scanning provides an easy place to get started.

Security solutions like UpGuard ethically leverage AI technology to streamline workflows and expedite security issue management, creating real-time awareness of third-party software supply chain security risks.

> Once you know which AI vendors are in your supply chain, the next step is governing that exposure. The UpGuard AI Security Center gives your team a place to build from: AI Insights to build understanding of AI and fourth-party risk, and a free AI Policy Toolkit to generate a baseline policy your vendor and procurement teams can apply going forward.\
> \
> [Explore the AI Security Center →](https://www.upguard.com/solutions/ai-security)

Watch this video for an overview of UpGuard’s unique approach to efficiently managing third-party security vulnerabilities.

eBook

Artificial Intelligence and the Future of TPRM

Free resource

### Artificial Intelligence and the Future of TPRM

[Download now](/resources/artificial-intelligence-and-the-future-of-tprm)

## Related posts

Learn more about the latest issues in cybersecurity.

Third-Party Risk Management

#### [The Evidence Is In: UpGuard Named a Leader in the IDC MarketScape for Worldwide Third-Party Risk Management](/blog/upguard-named-leader-in-idc-marketscape)

UpGuard has been named a Leader in the IDC MarketScape: Worldwide Third-Party Risk Management Services 2026 Vendor Assessment. Find out why.

[](/team/cassy-van-eeden)

[Cassy van Eeden](#)

October 18, 2026

Third-Party Risk Management

#### [We Researched Four AI Evidence Analysis Tools for TPRM. Here’s What We Found.](/blog/ai-evidence-analysis-tools-for-tprm)

We researched four AI evidence-parsing tools against four criteria that security teams often overlook. None nailed all four.

[](/team/cassy-van-eeden)

[Cassy van Eeden](#)

September 29, 2026

Third-Party Risk Management

#### [The Vendor Assurance Confidence Gap: Why It’s Widest With Your Most Critical Vendors](/blog/vendor-assurance-confidence-gap)

Vendor assurance efforts are rising while confidence in them is falling. This gap is widest with the vendors that matter most. Here’s why.

[](/team/cassy-van-eeden)

[Cassy van Eeden](#)

August 25, 2026

Third-Party Risk Management

#### [Higher Education TPRM in 2026: New Research Maps the Vendor Visibility Gap](/blog/higher-education-tprm-2026)

Explore UpGuard’s latest research into higher education third-party risk, including supplier concentration and systemic vendor exposure.

[](/team/cassy-van-eeden)

[Cassy van Eeden](#)

August 10, 2026

Third-Party Risk Management

#### [Ongoing TPRM Success: Continuous Security Monitoring with AI](/blog/continuous-security-monitoring-with-ai)

Is manual work weighing down your security team and limiting your ability to scale? Learn how UpGuard and its AI features can help.

[](/team/nicholas-sollitto)

[Nicholas Sollitto](#)

September 29, 2026

Third-Party Risk Management

#### [Report Writing Solved: Generating Actionable Assessment Reports](/blog/report-writing-solved)

Is manual report writing slowing down your security team? Learn how UpGuard’s AI can help.

[](/team/nicholas-sollitto)

[Nicholas Sollitto](#)

April 2, 2025

[All posts](/blog)

Experience superior visibility and a simpler approach to cyber risk management

[Get a demo](/contact-sales)

[Free trial](/demo)
