SecurityScorecard vs Whistic Comparison

SecurityScorecard enables users to view and continuously monitor risk ratings, add third-party vendors or service providers, and report on the cyberhealth of their ecosystem.

Whistic relies on point-in-time vendor risk assessment to determine enterprise risk and primarily focuses on the results of standardized questionnaires.

UpGuard uses both approaches, combining security ratings based on thousands of individual checks and cyber risk assessments. As you know, it's hard to get time-poor vendors to complete a questionnaire, and when they do, the results can be subjective and are rendered inaccurate over time as new security issues emerge.

That said, questionnaires provide valuable information that security ratings cannot generally provide, that is, internal security issues and controls.

When paired together, security ratings and risk assessments provide a holistic view of an organization's internal and external security posture.

According to Gartner, cybersecurity ratings will become as important as credit ratings when assessing the risk of existing and new business relationships…these services will become a precondition for business relationships and part of the standard of due care for providers and procurers of services. Additionally, the services will have expanded their scope to assess other areas, such as cyber insurance, due diligence for M&A and even as a raw metric for internal security programs.

Read our full guide on security ratings to understand all their use cases.

• SecurityScorecard: A rating from A to F, like a report card.
• Whistic: Relies on standardized security questionnaires.
• UpGuard: Provides a score between 0 and 950 along with the following letter grades, A: 801-950, B: 601-800, C: 401-600, D: 201-400, F: 0-200. You can request your free security rating by clicking here.

Risk assessment methodology

Each service relies on a different risk assessment methodology to assess the potential risk of an IT vendor. SecurityScorecard relies heavily on IP reputation which attempts to attribute malware traffic based on IP addresses. We've outlined in detail why we believe IP attribution isn't a complete solution for your third-party risk program.

Whistic is focused on conducting and responding to security reviews. This is designed to remove inefficiencies in third-party risk management programs for organizations and their vendors alike, rather than completing the same questionnaire over and over, they can choose to publish it to their security profile.

The standardization of security assessment practices against recognized security frameworks, and making attestations easily shareable helps all business save time, resources, and increases trust in the supply chain.

That's why, like Whistic, UpGuard has introduced security profiles to help our customers save time and money by publishing completed security questionnaires and supporting documentation to their secure, UpGuard security profile.

Additionally, UpGuard uses security ratings to provide real-time critical risk monitoring capabilities, integrated vendor processes, and accessibility to provide businesses with a complete solution.

• SecurityScorecard: Primarily IP reputation with some misconfiguration assessment such as network security, DNS health, patching cadence, endpoint security, IP reputation, web application security, cubit score, hacker chatter, leaked credentials, and social engineering.
• Whistic: Relies on point-in-time risk assessments that can become outdated until the next assessment process.
• UpGuard: Augments point-in-time risk assessments with security ratings to ensure information is always up-to-date. Our security ratings algorithm runs hundreds of individual checks including email security and email spoofing risks (SPF, DKIM, and DMARC), website security (SSL, HSTS, header exposure), phishing and malware risk, explicit checks for 200 services across thousands of ports (mail, app, user auth, file sharing, voice, administration, database, unidentified, and open ports), domain hijacking risk (DNSSEC and domain registry issues), reputational risks (CEO rating and employee rating), credential management (exposure to known data breaches and data leaks detected by our data leak detection engine). Each identified issue is given a risk prioritization category so you know what represents the highest risk.

Scope

As you know, even small vendors can lead to large data breaches, e.g. the HVAC vendor that eventually led to Target's exposure of credit card and personal data on more than 110 million consumers.

SecurityScorecard has over 1 million companies rated while Whistic relies on manual point-in-time risk assessment, so they may not cover small or specialist service providers. In contrast, UpGuard scans over 2 million companies every day.

Not every solution provides the same level of coverage. If your organization employs small specialist vendors they may not be covered by a solution. As you know, any vendor that handles sensitive data is a potential risk that should be continuously monitored and accounted for.

• SecurityScorecard: 1,000,000+ companies rated
• Whistic: Unknown
• UpGuard: 2,000,000 organizations scanned daily and new vendors can be automatically added by customers.

How easy a product is to use depends on the quality of the organization's product, design, and engineering teams, and will play a large part in how quickly you can get up to speed and start using the tool to its potential.  

SecurityScorecard, Whistic, and UpGuard offer their services via SaaS and are accessible from web-based platforms that can help you find, assess, and monitor vendors.  

• SecurityScorecard: Simple interface for quick grade reports and charts.
• Whistic: Risks detailed on each point-in-time vendor assessment, which means new risks are only detected during the next assessment process. Remediation requests are not available. Their risk assessments are aligned to the VSA questionnaire, CAIQ, SIG, NIST Cybersecurity Framework, CIS Security Controls, and Privacy Shield Framework.
• UpGuard: High-level summation of risk with the ability to drill down into precise technical details. Each risk is prioritized based on extensive research conducted by our in-house security team, and where possible remediation and protection suggestions are provided. Additionally, we have a library of pre-built questionnaires that can be sent and managed with the UpGuard platform including a pandemic (e.g. COVID-19), ISO 27001, PCI DSS, NIST Cybersecurity Framework, CCPA, and Modern Slavery questionnaires. Read our full guide on the top security questionnaires here.

SecurityScorecard, Whistic, and UpGuard all invest in their community and try to make it as easy as possible for customers and prospects to get up to speed, reduce operational overhead, and decide on the right product for them.

Each company has its own blog that is a useful source of information for cybersecurity awareness training, as well as vendor risk management best practices.

• SecurityScorecard: Company and product blog.
• Whistic: Company and product blog.
• UpGuard: The UpGuard cybersecurity and risk management blog is updated four times a week and our breach research blog has uncovered and secured some of the largest data breaches.

Security controls need to constantly adapt and change to keep up with changes with the information and technology it is designed to protect. New vulnerabilities are added to CVE on a daily basis, attackers find new ways to exploit programming errors, and security controls become invalid constantly.

This means vendor risk management best practices are constantly changing too.

To be able to rely on a third-party risk management tool, you need to be sure they can incorporate changes quickly.

UpGuard has adopted DevOps principles internally to develop, test, and release software on a continuous basis, ensuring fast, consistent, and safe releases that are thoroughly tested.

Third-party risk management software can be expensive. The industry uses opaque pricing policies designed to take power away from the purchaser. Vendor risk solutions are typically priced on a per vendor, per year basis except in some cases where reports can be generated for a fixed price.

SecurityScorecard and Whistic are more expensive than UpGuard. Their high prices can price out small to medium-size businesses and relegate large organizations to managing only their most at-risk vendors.

• SecurityScorecard: Public pricing information is not available. Pricing is reported to start at $16,500 for self-assessment plus 5 vendors, additional vendors cost $1,500-$2,000 per vendor per year.
• Whistic: Reported to start at $25,000 and is based on the number of vendors managed in the platform or the number of security questionnaires to which you're responding.
• UpGuard: UpGuard has a transparent pricing model which you can view here. UpGuard pricing starts at $5k/year and scales with your company. If you have any questions, please let us know via sales@upguard.com and we will follow up.

While SecurityScorecard, Whistic, and UpGuard have their own platforms, you may want to access the resources on a different platform or consolidate reporting into a centralized dashboard.

The good news is all services offer standard APIs to pull data.

APIs are great if you have access to technical staff, but not everyone does. This situation is where standard third-party integrations become an important part of decision-making.

• SecurityScorecard: Offers integrations with GRC platforms such as RSA Archer.
• Whistic: Integrates with RiskRecon, Active Directory, Okta, and onelogin.
• UpGuard: Integrates with GRC platforms, ticketing systems like ServiceNow, and more.

The best proof comes from each solution's customers. SecurityScorecard, Whistic, and UpGuard all have impressive customer lists, none more distinguished than the other.

• SecurityScorecard: Customers include Symantec, Pepsico, Two Sigma, and Stony Brook University.
• Whistic: Customers include Betterment, Invision, Airbnb, Zynga, and Robinhood.
• UpGuard: Customers include NASA, the New York Stock Exchange (ICE), Morningstar, Akamai, Bill.com, IAG, and ADP. Read our customer case studies here and our Gartner reviews here.

Here's what a few UpGuard customers had to say about their experience. You can read more on Gartner reviews.

• "UpGuard has given us a view of our vendor security posture. The ability to launch a questionnaire or ask for a plan of remediation for items that show as vulnerable is also a great added value and a time saver. UpGuard is also very customer focused. They respond quickly to issues and to questions and welcome any input that could improve the product. Overall it is one of the best value add tools we have."
• "The simplicity of the product is fantastic. My team and I were able to be up and running in minutes. We monitor risks on over 25 vendors in near real-time and use these statistics to report to the C suite and Board of Directors. Upguard has become part of the critical cybersecurity metrics that we monitor and report upon."
• "The ease of use and simplicity of the product is excellent. We were able to be up and running with 50 vendors within minutes not hours. The reporting is used for monthly statistics and is reported to our Senior Management. Upguard has become an integral part of our critical cybersecurity metrics that we monitor and report upon."

The main reason we all invest in security tools is to prevent incidents from happening in the first place.

This makes a solution's ability to prevent data breaches and other cyber attacks the most important thing.

This is where SecurityScorecard, Whistic, and UpGuard truly differ.

• SecurityScorecard: The IP reputation methodology helps catch active malware installations, but that’s only one possible way a data breach can occur. Yes, they use additional data but lack the transparency to prove the efficacy of their scores.
• Whistic: Relies on risk assessments which can quickly become out of date as new zero-day exploits are discovered and new IT infrastructure is used. The truth is that questionnaires, much like penetration testing, can be subjective and become inaccurate over time as new security issues emerge. Additionally, Whistic provides no controls for capturing data loss incidents.
• UpGuard: As UpGuard checks for misconfigurations across your Internet footprint, many important breach vectors are covered, including phishing, ransomware susceptibility (like WannaCry), man-in-the-middle attacks, DNSSEC, vulnerabilities, email spoofing, domain hijacking, and DNS issues. For example, we were able to detect data exposed in a GitHub repository by an AWS engineer in 30 minutes. We reported it to AWS and the repo was secured the same day. This repo contained personal identity documents and system credentials including passwords, AWS key pairs, and private keys. We're able to do this because we actively discover exposed datasets on the open and deep web, scouring open S3 buckets, public Github repos, and unsecured RSync and FTP servers. Our data leak discovery engine continuously searches for keyword lists provided by our customers and is continually refined by our team of analysts, using the expertise and techniques gleaned from years of breach research. The UpGuard methodology is continuously refined based on the actual data breaches we have discovered and reported to the world in the New York Times, Bloomberg, Washington Post, Forbes, and TechCrunch.

Finally, let's take a look at how SecurityScorecard, Whistic, and UpGuard compare when assessed by UpGuard's platform on July 28, 2020. It's important to note that UpGuard adheres to the Principles of Fair and Accurate Security Ratings:

• Transparency: UpGuard believes in providing full and timely transparency not only to our customers but to any organization that wants to understand their security posture, which is why you can request your free security rating here and you can book a free trial of our platform here.
• Dispute, Correction, and Appeal: UpGuard is committed to working with customers, vendors and any organization that believes their score is not accurate or outdated.
• Accuracy and Validation: UpGuard's security ratings are empirical, data-driven and based on independently verifiable and accessible information.
• Model Governance: While the datasets and methodologies used to calculate our security ratings can change from time to time to better reflect our understanding of how to mitigate cybersecurity risk, we provide reasonable notice and explanation to our customers about how their security rating may be impacted.
• Independence: No commercial agreement or lack thereof, gives an organization the ability to improve its security rating without improving their security posture.
• Confidentiality: Any information disclosed to UpGuard during the course of a challenged rating or dispute is appropriately protected. Nor do we provide third-parties with sensitive or confidential information on rated organizations that could lead to system compromise.