Menu

  • Alerts
  • Incidents
  • News
  • APTs
  • Cyber Decoded
  • Cyber Hygiene
  • Cyber Review
  • Cyber Tips
  • Definitions
  • Malware
  • Threat Actors
  • Tutorials

Useful Tools

  • Password generator
  • Report an incident
  • Report to authorities
No Result
View All Result
CTF Hack Havoc
CyberMaterial
  • Education
    • Cyber Decoded
    • Definitions
  • Information
    • Alerts
    • Incidents
    • News
  • Insights
    • Cyber Hygiene
    • Cyber Review
    • Tips
    • Tutorials
  • Support
    • Contact Us
    • Report an incident
  • About
    • About Us
    • Advertise with us
Get Help
Hall of Hacks
  • Education
    • Cyber Decoded
    • Definitions
  • Information
    • Alerts
    • Incidents
    • News
  • Insights
    • Cyber Hygiene
    • Cyber Review
    • Tips
    • Tutorials
  • Support
    • Contact Us
    • Report an incident
  • About
    • About Us
    • Advertise with us
Get Help
No Result
View All Result
Hall of Hacks
CyberMaterial
No Result
View All Result
Home News

CTIBench Sets LLM Threat Intel Benchmark

June 11, 2024
Reading Time: 2 mins read
in News
CTIBench Sets LLM Threat Intel Benchmark

Researchers at the Rochester Institute of Technology (RIT) have launched CTIBench, a new benchmark designed to evaluate how well Large Language Models (LLMs) perform in Cyber Threat Intelligence (CTI). CTIBench focuses on critical CTI tasks such as threat detection, vulnerability analysis, and threat actor attribution. By testing models like ChatGPT 4 and Gemini 1.5, CTIBench aims to standardize and improve LLM capabilities in cybersecurity applications.

CTIBench includes tasks like Cyber Threat Intelligence Multiple Choice Questions (CTI-MCQ), Root Cause Mapping (CTI-RCM), Vulnerability Severity Prediction (CTI-VSP), and Threat Actor Attribution (CTI-TAA). These tasks assess LLMs’ ability to interpret and process complex CTI data, providing insights into their accuracy and reliability in practical cybersecurity scenarios.

Developed using a knowledge database from established CTI frameworks and standards, CTIBench features over 2500 multiple-choice questions derived from sources like MITRE ATT&CK and the Common Vulnerability Scoring System (CVSS). By evaluating various LLMs, CTIBench identifies areas where advancements in LLM technology can enhance CTI effectiveness and response strategies.

The results from CTIBench testing highlight both strengths and weaknesses among LLMs, guiding future research and development efforts to bolster cybersecurity defenses. This initiative underscores the importance of robust evaluation frameworks like CTIBench in advancing LLM applications in CTI and fortifying cybersecurity operations globally.

Reference:
  • CTIBench to Establish a Benchmark for Evaluating LLMs in Cyber Threat Intelligence
Tags: CTIBenchCyber NewsCyber News 2024Cyber threatsCybersecurityJune 2024researchersRITRochester Institute of Technology
ADVERTISEMENT

Related Posts

Cryptomus Fined 177M By FINTRAC

Cryptomus Fined 177M By FINTRAC

October 24, 2025
Cryptomus Fined 177M By FINTRAC

SpaceX Cuts Starlink In Myanmar

October 24, 2025
Cryptomus Fined 177M By FINTRAC

Russia Managing Cybercrime Groups

October 24, 2025
NY DFS Updates Third Party Cyber Rules

NY DFS Updates Third Party Cyber Rules

October 23, 2025
NY DFS Updates Third Party Cyber Rules

Keycard Raises 38 Million Funding

October 23, 2025
NY DFS Updates Third Party Cyber Rules

Jaguar Land Rover Cyberattack Hits UK

October 23, 2025

Latest Alerts

China Hackers Breach Telecom Firm

YouTube Videos Used As Malware Traps

Lazarus Hits European Defense Firms

Gift Card Heist Via Cloud Hackers

MuddyWater Launches Global Spying

Fake Zoom Calls Target Ukraine Aid

Subscribe to our newsletter

    Latest Incidents

    Hackers Breach Verstappen Data

    Toys R Us Canada Data Breach Alert

    Shaq Range Rover Stolen After Hack

    Ransomware Hits Jewett Cameron

    Salt Typhoon Hacks European Telecom

    JFL Loses 800K Weekly After Hack

    CyberMaterial Logo
    • About Us
    • Contact Us
    • Jobs
    • Legal and Privacy Policy
    • Site Map

    © 2025 | CyberMaterial | All rights reserved

    Welcome Back!

    Login to your account below

    Forgotten Password?

    Retrieve your password

    Please enter your username or email address to reset your password.

    Log In

    Add New Playlist

    No Result
    View All Result
    • Alerts
    • Incidents
    • News
    • Cyber Decoded
    • Cyber Hygiene
    • Cyber Review
    • Definitions
    • Malware
    • Cyber Tips
    • Tutorials
    • Advanced Persistent Threats
    • Threat Actors
    • Report an incident
    • Password Generator
    • About Us
    • Contact Us
    • Advertise with us

    Copyright © 2025 CyberMaterial