MISP ioC retrosearch with misp42 Splunk app.

Introduction

Hi, in this blog post I am going to share how I have built a framework on Splunk to retrosearch on MISP indicators of compromise.

Continue reading

MISP 2.4.198 released with many bugs fixed, security fixes and improvements.

MISP v2.4.198 (2024-09-13)

Based on a set of fixes including a security fix, we are pleased to announce the immediate availability of MISP 2.4.198. You can find a list of the detailed changes along with new features further below. As with any security release, we highly encourage everyone to update their instance as soon as possible.

Continue reading

MISP 2.4.197 released with many bugs fixed, a security fix and improvements.

Release Notes - v2.4.197 (2024-09-02)

New Features

• Config Option: Added a new configuration option user_org_uuid_in_response_header to include a response header with the requesting user’s organization UUID. [Jeroen Pinoy]
• Build: Display required STIX dependencies versions during the build process. [Jakub Onderka]
• Bookmark now supports comment.

Changes

• Version: Version bump. [iglocska]
• Warning List: Updated the warning list. [Alexandre Dulaunoy]
• Taxonomies: Updated to the latest version. [Alexandre Dulaunoy]
• MISP Galaxy: Updated to the latest version. [Alexandre Dulaunoy]
• PyMISP: Version bump. [Raphaël Vinot]
• Internal Logging: Added logging when an event will not be published. [Jakub Onderka]
• Global Menu - Bookmarks: Added comment field as the dropdown element’s title in the global menu bookmark. [Sami Mokaddem]
• Database Upgrade - Bookmarks: Upgraded the database to support bookmark comments. [Sami Mokaddem]
• Bookmark View: Added a missing comma for the new comment function and added a field for comments in the bookmark view. [Jan Z.]
• Bookmark Index: Added a field to display comments in the bookmarks index. [Jan Z.]
• Bookmark Add/Edit: Added a field to add and edit comments for bookmarks. [Jan Z.]
• MISP Object: Updated to the latest version. [Alexandre Dulaunoy]

Fixes

• UI/Footer: Improved UI footer to avoid confusion for some users. [Alexandre Dulaunoy]
• IOC Import: Added a check to ensure the provided XML is valid. [Jakub Onderka]
• Schema: Updated schema version. [Jakub Onderka]
• UI: Fixed tag popover to return already parsed data. [Jakub Onderka]
• Bookmarks - Add: Lower-cased the comment field. [Sami Mokaddem]
• Sightings: Correctly retrieve sightings per the requested event. [Tom King]
• Bookmarks - Verbose Returns: Fixed an issue with overly verbose returns from bookmarks when shared with the organization. This fix was reported by Sharad Kumar Dahal of Green Tick Nepal Pvt. Ltd. [iglocska] This fixes a security issue recorded as CVE-2024-45509.
• Feed: When pulling feeds, events are now checked against specified rules if any rules are provided. [Benni0]

Other

• Merged pull requests addressing issues with unpublished events logging, tag popover parsing, sightings restSearch performance, and STIX dependencies version display. [Jakub Onderka, Andras Iklody, Andrew Hicks]
• Fixed issues related to sightings restSearch negation of organization ID. [Andrew Hicks]

For a complete list of updates, please refer to the changelog pages. Many thanks to all the diligent contributors that ensure that MISP keeps improving rapidly!

Continue reading

MISP 2.4.196 released with many bugs fixed and improvements.

MISP 2.4.196 released with many bugs fixed and improvements.

New Features

• Decaying Model: Introduced a new DecayingModel that leverages true positive and false positive sightings for better decision-making. [Marcel Slotema]
• Log Search Enhancement: Added an optional hh:mm:ss accuracy to log searches, allowing for more precise time-based queries. This update also includes significant refactoring to improve code quality. [iglocska]
• User Log Review: Improved the functionality of the “review user logs” button. It now links directly to logs relevant to the specific user, considering the new audit log system. Future enhancements will include email-based log searches. [iglocska]

Changes

• PyMISP Update: Updated PyMISP to the latest version. [Raphaël Vinot]
• Decaying Model Formulas: Enhanced error handling by catching undefined indexes in decaying model formulas. [Sami Mokaddem]
• Attributes Search: Added support for sorting by publish_timestamp and introduced the X-Skipped-Elements-Count header to improve pagination during REST searches. [Benni0]
• Reverse Proxy Handling: Fixed issues with base URL handling for reverse proxies, eliminating problematic redirects. Special thanks to Mitch Germansky for the extensive debugging. [iglocska]
• MISP Components Update: Updated MISP Object, Galaxy, and STIX components to their latest versions. [Alexandre Dulaunoy, Christian Studer]

Fixes

• STIX 2 Import: Updated the STIX 2 parsers following recent changes in MISP-STIX. [Christian Studer]
• Base URL Setting: Adjusted the priority order in beforeFilter to avoid redis errors during benchmarking. [iglocska]
• Image Helper: Allowed for variable-width organization logos without overlapping text. [iglocska]
• Workflow Module: Ensured correct type return if redis fails to load during workflow:getEnabledModules. [Sami Mokaddem]
• Settings Management: Fixed multiple issues related to changing instance settings, including improvements to CLI checks. [iglocska]
• Attribute Search Ordering: Reverted ID-based sliding window ordering due to performance concerns. [iglocska]

Other

• Merged several development branches to integrate recent changes, updates, and fixes from various contributors. Notably, the branches related to attribute search order, skipped elements count, and environment dependencies were integrated into the main branch. [iglocska, Christian Studer, Sami Mokaddem, Alexandre Dulaunoy, Stefano Ortolani, Andras Iklody]

For a complete list of updates, please refer to the changelog pages. Many thanks to all the diligent contributors that ensure that MISP keeps improving rapidly!

Continue reading

SkillAegis

Design and Execute Cyber Threat Intelligence Scenarios with SkillAegis

Practical experience is essential for skill development, and effective training must be both engaging and capable of identifying gaps in understanding. That’s why we’re pleased to launch version 1.0.0 of SkillAegis, your new training companion.

Continue reading

MISP 2.4.195 - hot summer olympic release

MISP 2.4.195 - hot summer olympic release

We are pleased to announce the immediate availability of MISP v2.4.195, a summer release aiming to introduce new features, fix a long list of reported bugs and deficiencies as well as give your servers a breather in the scorching summer heat by taking a load off your CPUs thanks to a set of impactful performance fixes.

Continue reading

Maltego Integration with MISP

Maltego Integration with MISP

Understanding How Maltego Integrates with MISP Data for Enhanced Cyber Threat Analysis

Table of contents

• Introduction
• About Maltego
• How Maltego Integrates with MISP Data
  • Requirements
  • Use Cases
  • Introducing Workflows
  • Demonstration
• Conclusion

Introduction

Many organizations run MISP instances with other cybersecurity tools and OSINT for data-driven investigations. Investigators can integrate both internal and external data to map with MISP data in various ways. This blog details how to look up information directly in the MISP community using MISP Transforms on Maltego Graph, highlighting its seamless integration for efficient and comprehensive investigations.

Continue reading

Collaborative Threat Intelligence Sharing and Automated Information Exchange - Insights from the JTAN Project Experience

The JTAN (Joint Threat Analysis Network) Project, co-funded by the European Union’s CEF program, addresses the critical need for efficient and effective threat intelligence sharing among cybersecurity teams. As cyber threats grow in complexity and scale, the ability to quickly exchange and analyze threat data across organizations has become essential for maintaining robust security.

Continue reading

MISP 2.4.194 released with new functionalities and various bugs fixed

MISP 2.4.194 released with new functionalities and various bugs fixed.

New Features

• Bookmark Functionality:
  • Users can now create bookmarks.
  • Bookmarks can be shared with all users in the same organization.
• Heartbeat Endpoint:
  • New /users/heartbeat endpoint.
  • Accessible without authentication; returns a 200 response to indicate the instance is operational.
  • Designed for quick checks to see if the instance is up and running.
• Skip OTP Requirement:
  • New role permission to exclude certain roles from OTP requirements.
  • Useful for filtered, local service accounts.
• Users API Update:
  • Added a new boolean field indicating whether TOTP is set up for the user.
  • Applicable to /users/view, /admin/users/view, /admin/users/index endpoints.

Changes

• Various Version Bumps:
  • Updates for misp-stix, schema, PyMISP, warning-lists, misp-galaxy, and misp-objects.
• Bookmark Improvements:
  • Added title documentation for the exposed_to_org field.
  • Enhanced quick search support for bookmarks.
• ACL and Schema Updates:
  • Heartbeat added to the ACL component.
  • Updates to schema and mysql.sql.

Fixes

• Default Roles and Permissions:
  • Added delegation permission for sync user and publisher roles.
  • Readded default roles.
  • Fixed issues with PyMISP tests, default roles, and various editor and ingestion bugs.
• UI and Functional Fixes:
  • Corrected event report markdown editor to display tags.
  • Included user agent in feed ingestion to address issues with specific feeds.
  • Fixed editing view for galaxycluster blocklist.
  • Readded missing org logo in the decaying model.
  • Corrected JSON response handling in the decaying tool.
  • Fixed object reference links for proper view refocus.
  • Corrected errors in the server edit view.
  • Fixed typo in bookmark description.
  • Adjusted default role settings in mysql.sql.
  • Updated local flag in EventTags to be boolean.
  • Corrected filenames in RHEL background worker migration guide.
  • Improved performance by increasing chunk size for sighting sync.

For a complete list of updates, please refer to the changelog pages. Many thanks to all the diligent contributors that ensure that MISP keeps improving rapidly!

Continue reading

MISP 2.4.193 released with many bugs fixed, API improvements and security fixes

MISP 2.4.193 released with many bugs fixed, API improvements and security fixes

New

• [attributes/enrich] endpoint added.

  • Simply post a list of modules you wish to enrich the attribute by.
  • URL: /attributes/enrich/[attribute_id|attribute_uuid]
  • Post body format: {"dns": 1, "foo_bar_baz": 1} listing all modules to execute.

• [misp-community] MISP-LEA information sharing community added.

  Continue reading

MISP 2.4.192 released with many performance improvement, fixes and updates.

New Features

• Security Enhancements:

  • Ability to disable TOTP/HTOTP when linked to an identity provider with strong authentication.
  • Introduced Fast API Authentication with temporary storage of hashed API keys in Redis to enhance endpoint performance.

• Logging and Tracking:

  Continue reading

MISP 2.4.190 (and 2.4.191) released with new feed improvement, workflows and a new benchmarking suite.

We are excited to announce the release of MISP v2.4.190. This latest version introduces a slew of new features, improvements, and fixes designed to streamline operations and enhance security measures for our users.

Continue reading

Using your MISP IoCs in Kunai (the open source EDR for Linux)

Using your MISP IoCs in Kunai

Kunai is an open-source security monitoring tool, specifically designed to address the threat-hunting and threat-detection problematic on Linux. It has been inspired by Microsoft Sysmon, to provide a Sysmon alike experience to the end user. However, it comes with some more advanced features such as fine grained event filtering, detection rules and IoC matching. In this blog post, we are going to introduce how to implement real time MISP IoC matching in a very short amount of time.

Continue reading

MISP 2.4.189 released with bug fixes, performance improvements and a new blocklist feature.

We are pleased to announce the immediate release of MISP 2.4.189, released with bug fixes, performance improvements and a new blocklist feature.

Continue reading

MISP - Elastic Stack - Docker Lab

MISP - Elastic Stack - Docker

This lab explains how to connect MISP to the Elastic Stack in order to leverage IOCs from MISP and trigger alerts based on user defined rules.

Continue reading

Partnership Collaboration between the MISP Project and the Yeti Platform

The MISP Project, renowned for its threat intelligence sharing platform, and Yeti Platform, the Forensics Intelligence platform supporting CTI and DFIR practitioners, are coming together to create a more robust and interconnected open source landscape.

Continue reading

MISP 2.4.188 released major performance improvements and many bugs fixed.

We are pleased to announce the immediate release of MISP 2.4.188, with major performance improvements and many bugs fixed.

New Features

• Datasource Improvements:
  • Updates to some datasources with the ignoreIndexHint parameter (mysqlExtended, mysqlObserverExtended).
  • Fix for forceIndexHint.
• Settings:
  • Added setting to temporarily disable the loading of sightings via the API (affects restsearch and /events/view endpoints). This helps with performance issues caused by large sighting data sets.

Changes

• PyMISP:
  • Multiple version bumps.
• Version and Internal Updates:
  • General version bump.
  • Improved error handling and marking BadRequestException as fail log in CI.
  • Attempt to fix a failing test.
  • Updated misp-galaxy, misp-object, and warning-lists.
• Attribute Search Rework:
  • Significant performance improvement when using MysqlExtended or MysqlObserverExtended data sources.
  • Event level lookup moved to subqueries for faster queries.
  • Ignoring the deleted index to improve speed.
• OpenAPI Updates:
  • Added content for analyst-data and event-reports.
• Sighting Policy Support:
  • Added support of sighting policy in sightings:getLastSighting.
• Attribute Search Performance:
  • Improved performance of includeDecayScore by a factor of 5.
• Attribute Fetch Refactor:
  • Simplified conditions and optimizations.

Fixes

• Attribute Search:
  • Enforced unpublishedprivate directive.
• Internal Error Handling:
  • Error handling improvements in AttachmentScan.
• CurlClient HEAD Request:
  • Added CURLOPT_NOBODY for HEAD requests.
• CLI and ECS Updates:
  • Fix for redisReady in dragonfly.
  • Change type from Exception to Throwable in ECS.
• OIDC:
  • Default organization handling if not provided by OIDC.
• Publishing and Sync Issues:
  • Fix for publishing and sync errors.
• Performance Improvements:
  • Bulk loading of analyst data to speed up event loading.
• UI Update:
  • Added MISP.email_reply_to to server config.

Other

• Multiple merges of branches and updates.
• Fixes and changes in misp-stix, attachment scan error handling, OIDC default org handling, alert email titles, shadow attribute handling, and community additions (ICS-CSIRT.io).

Community and Contribution Updates

• Additions and changes to the community, including the introduction of the ICS-CSIRT.io community.

Details changes are available in Changelog.

Continue reading

Poppy a new Bloom filter format and open source project

Poppy a new Bloom filter format and open source library

Introduction

At CIRCL we use regularly bloom filters for some of our use cases especially in digital forensic. Such as providing a small, fast and shareable caching mechanism for Hashlookup database which can be used by incident responders.

Continue reading

MISP 2.4.187 released with security fixes, new features and bugs fixes.

We are pleased to announce the immediate release of MISP 2.4.187, including security fixes, new features and bugs fixes.

New Features

• CLI Enhancements:
  • Added org list to shell commands.
  • New command to change user role.
  • Fixes to role management.
• OIDC Update:
  • New option OidcAuth.update_user_role to disable role changes from OIDC.

Changes

• Version and Software Updates:
  • Version bump.
  • Updates to PyMISP, misp-galaxy, misp-warninglists, misp-objects, and taxonomies.
• Internal Updates:
  • Added ext-zstd to suggested PHP extensions.
  • Fixed non-focusable relationship dropdown search field in analyst data.

Fixes

• General Fixes:
  • Corrected variable unset in events:restsearch to prevent attribute override.
  • Ensured sync pulls continue after an event save failure.
  • Database update fixes for older MySQL versions.
  • Improved API consistency.
  • Fixed pulling from remote servers when analyst data is not supported.
  • Logging fix for removeTagFromObject().
  • Security improvements for file and logo uploads. (Thanks to Rémi Matasse and Raphael Lob from Synacktiv for the report)
    • CVE-2024-29859 < MISP 2.4.187 - add_misp_export in app/Controller/EventsController.php does not properly check for a valid file upload.
    • CVE-2024-29858 < MISP 2.4.187 - __uploadLogo in app/Controller/OrganisationsController.php does not properly check for a valid logo upload.
  • Correct message display when disabling a galaxy.
• CLI Updates:
  • Added new functionalities including listing roles and creating users.

Details changes are available in Changelog.

Continue reading

Introducing Standalone Functionality to MISP Modules - A New Era of Flexibility and Efficiency

Introducing Standalone Functionality to MISP Modules: A New Era of Flexibility and Efficiency

In the ever-evolving landscape of information security, the need for adaptable and efficient tools has never been greater. The MISP project, known for facilitating the sharing of structured threat information, has taken a significant leap forward. We’re excited to announce a pivotal enhancement to the misp-modules, a collection of modules for MISP, extending their functionality to operate not only as an integral part of MISP but also as a standalone web application.

Continue reading