apunkt/flakestorm
1
0
Fork 0
mirror of https://github.com/flakestorm/flakestorm.git synced 2026-06-08 17:05:12 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Commit graph

  • 0c237c0993
         Update README.md main Flakestorm 2026-04-16 09:21:38 +08:00
  • 85f00ba44d
         Update README.md Flakestorm 2026-04-07 23:40:41 +08:00
  • c1dcc4a47e
         Update README.md Flakestorm 2026-04-07 23:39:36 +08:00
  • 8acca7a596
         Create CHAOS_ENGINE.md Flakestorm 2026-04-07 23:37:54 +08:00
  • f4d45d4053 Update documentation and configuration for Flakestorm V2, enhancing clarity on CI processes, report generation, and reproducibility features. Added details on the new --output option for saving reports, clarified the use of --min-score, and improved descriptions of the seed configuration for deterministic runs. Updated README and usage guides to reflect these changes and ensure comprehensive understanding of the CI pipeline and report outputs. Francisco M Humarang Jr. 2026-03-12 20:05:51 +08:00
  • 4a13425f8a Update documentation to reflect enhancements in Flakestorm V2, including detailed descriptions of new features such as resilience scores, chaos engineering capabilities, behavioral contracts, and replay regression. Clarified API key management via environment variables, updated CLI commands, and improved test scenarios. Adjusted mutation types count to 22+ and ensured all V2 gaps are closed as per the latest specifications. Francisco M Humarang Jr. 2026-03-09 19:52:39 +08:00
  • f1570628c3 Update TEST_SCENARIOS.md to include detailed descriptions of V2 scenarios, specifically focusing on the Research Agent with Search Tool and Support Agent with KB Tool. Enhanced documentation with actual tool calling examples, chaos and contract testing details, and configuration settings for improved clarity and usability. Entropix 2026-03-09 13:41:41 +08:00
  • 11489255e3 Remove the implementation checklist document and update README and TEST_SCENARIOS to reflect the latest V2 features, including detailed descriptions of environment chaos, behavioral contracts, and replay regression scenarios. Adjusted links and clarified configuration options for better usability. Entropix 2026-03-09 13:01:08 +08:00
  • 4b0ab63f97 Update README and usage guide to reflect changes in mutation types and clarify V1/V2 flow. Increased mutation types from 22 to 24 and added details on the new V2 features, including environment chaos and behavioral contracts. Enhanced documentation for clarity on scoring mechanisms and command usage. Entropix 2026-03-09 12:45:42 +08:00
  • 4c1b43c5d5 Enhance documentation for Flakestorm V2 features, including detailed updates on behavioral contracts, context attacks, and scoring mechanisms. Added new configuration options for state isolation in agents, clarified context attack types, and improved the contract report generation with suggested actions for failures. Updated various guides to reflect the latest changes in chaos engineering capabilities and replay regression functionalities. Francisco M Humarang Jr. 2026-03-08 20:29:48 +08:00
  • 902c5d8ac4 Merge branch 'main' of https://github.com/flakestorm/flakestorm Francisco M Humarang Jr. 2026-03-08 14:07:50 +08:00
  • ec6ca104c5 Implement memory poisoning context attacks and enhance README documentation. Added functions for applying memory poisoning to user input and normalizing context attack configurations. Updated ChaosInterceptor to apply memory poisoning before invoking the wrapped adapter. Enhanced README to clarify CI/CD pipeline features and the distinction between OSS and Cloud capabilities. Francisco M Humarang Jr. 2026-03-08 14:07:34 +08:00
  • a8e3dac246 Remove build status badge from README.md for a cleaner presentation. entropix 2026-03-07 15:06:28 +08:00
  • 1bbe3a1f7b Enhance documentation and replay functionality in Flakestorm. Updated README to clarify V2 Spec and added references to LangSmith sources in configuration guide. Improved replay regression capabilities by allowing imports from LangSmith projects and runs, with filtering options. Added new classes for LangSmith project and run sources in the configuration. Updated replay loader to support project imports and refined session resolution logic. v2.0 Francisco M Humarang Jr. 2026-03-07 02:04:55 +08:00
  • 58f49b08ba Remove Flakestorm V2 PRD Plan document as part of project restructuring. This change eliminates the detailed implementation plan for Flakestorm v2.0 OSS, including LLM API key support and chaos features. Francisco M Humarang Jr. 2026-03-07 00:38:38 +08:00
  • 61a81a7f4b Add Flakestorm V2 PRD Plan and enhance v2 research agent to utilize Ollama for LLM responses. Updated README and requirements for dependencies. Implemented LLM API key support and chaos features in the agent. Francisco M Humarang Jr. 2026-03-07 00:31:26 +08:00
  • 9c3450a75d Update version to 2.0.0 and enhance chaos engineering features in Flakestorm. Added support for environment chaos, behavioral contracts, and replay regression. Expanded documentation and improved scoring mechanisms. Updated .gitignore to include new documentation files. Francisco M Humarang Jr. 2026-03-06 23:33:21 +08:00
  • 59cca61f3c Correct capitalization of "Flakestorm" in sponsorship section of README.md Francisco M Humarang Jr. 2026-01-16 23:35:14 +08:00
  • 84d2229d16 Refactor sponsorship section in README.md for improved presentation and alignment Francisco M Humarang Jr. 2026-01-16 23:32:59 +08:00
  • 1019c02ac5
         Update README.md Flakestorm 2026-01-16 23:31:39 +08:00
  • ae956a413f
         Update README.md Flakestorm 2026-01-16 23:30:38 +08:00
  • 3a8391c326
         Update README.md Flakestorm 2026-01-16 23:29:31 +08:00
  • 52da44de66
         Update README.md Flakestorm 2026-01-16 23:28:52 +08:00
  • 25ee15de40
         Update README.md Flakestorm 2026-01-16 11:10:32 +08:00
  • 82912aa8d3
         Update README.md Flakestorm 2026-01-16 11:05:22 +08:00
  • e573587484
         Update README.md Flakestorm 2026-01-16 11:01:07 +08:00
  • 8f54a45a80
         Update README.md Flakestorm 2026-01-16 10:59:17 +08:00
  • 9a1d8660d5 Update to 24 mutation types: Add release notes, update development status to Production/Stable, and expand test coverage for all mutation types Entropix 2026-01-15 15:04:10 +08:00
  • 611dd82229 Update README.md to reflect the addition of 24 mutation types, enhancing clarity on core and advanced prompt-level attacks as well as system/network-level attacks. Introduce a new support section with issue templates for better user engagement. v.0.9.1 Entropix 2026-01-15 13:41:01 +08:00
  • d4ccb2d2c8
         Update ROADMAP.md Flakestorm 2026-01-13 21:42:45 +08:00
  • 637c0c65be Merge branch 'main' of https://github.com/flakestorm/flakestorm Francisco M Humarang Jr. 2026-01-13 21:40:03 +08:00
  • 2f4f2270b5 Update README.md and CONTRIBUTING.md to enhance project visibility and support for new contributors. Added PyPI version and download badges, build status, and latest release information to README.md. Introduced a section in CONTRIBUTING.md for finding good first issues, providing guidance for beginners on how to contribute effectively. Francisco M Humarang Jr. 2026-01-13 21:39:50 +08:00
  • 3c0fd45cd8
         Add files via upload Flakestorm 2026-01-12 19:42:41 +08:00
  • d1aaa626c9 Enhance documentation to reflect the addition of 22+ mutation types in Flakestorm, including advanced prompt-level and system/network-level attacks. Update README.md, API_SPECIFICATION.md, CONFIGURATION_GUIDE.md, USAGE_GUIDE.md, and related files to improve clarity on mutation strategies, testing scenarios, and configuration options. Emphasize the importance of comprehensive testing for production AI agents and provide detailed descriptions for each mutation type. Francisco M Humarang Jr. 2026-01-05 22:21:27 +08:00
  • 43a35e55b4
         Update README.md Flakestorm 2026-01-05 18:28:28 +08:00
  • ed974ddf8d Revise README.md to improve clarity and organization of Flakestorm's features and usage instructions. Consolidate installation steps, enhance the explanation of mutation types, and introduce a streamlined quick start guide for new users. Emphasize future enhancements aimed at simplifying setup and improving user experience. Francisco M Humarang Jr. 2026-01-05 17:05:54 +08:00
  • 9d3de07352 Refactor README.md to streamline installation instructions and enhance clarity on local testing setup. Consolidate sections on Ollama installation and usage, while removing outdated content to improve user experience and guidance for teams using Flakestorm. Francisco M Humarang Jr. 2026-01-05 16:58:45 +08:00
  • be8a87262a Merge remote changes and resolve README.md conflicts Francisco M Humarang Jr. 2026-01-05 16:55:44 +08:00
  • 9e1204a9fe Enhance README.md to clarify the purpose and functionality of Flakestorm for production AI agents. Update descriptions to emphasize chaos testing, adversarial input handling, and CI/CD integration. Add sections on target users and production deployment patterns, ensuring comprehensive guidance for teams shipping AI agents. Francisco M Humarang Jr. 2026-01-05 16:53:23 +08:00
  • b57b6e88dc Merge remote-tracking branch 'origin/main' Entropix 2026-01-05 00:02:45 +08:00
  • fa35634dac Remove PUBLISHING.md from .gitignore to allow tracking of publishing documentation. Entropix 2026-01-05 00:01:10 +08:00
  • 7f44a647c4
         Update README.md flakestorm 2026-01-05 00:00:25 +08:00
  • 84119ed0ec Merge remote-tracking branch 'origin/main' Entropix 2026-01-04 23:57:11 +08:00
  • 22993d5da2 Add troubleshooting section to README.md with links for fixing installation and build issues. This update aims to assist users in resolving common problems encountered during setup. Entropix 2026-01-04 23:56:13 +08:00
  • 6e1c2d028d
         Update README.md flakestorm 2026-01-04 23:52:03 +08:00
  • af60bef34e
         Update README.md flakestorm 2026-01-04 23:50:50 +08:00
  • d339d5e436 Refactor README.md and USAGE_GUIDE.md to streamline installation instructions and enhance clarity on robustness scoring and mutation strategies. Removed outdated sections and added detailed explanations for mutation types and their applications in testing. This update aims to improve user understanding and facilitate easier setup and usage of Flakestorm. Entropix 2026-01-04 23:39:24 +08:00
  • 732a7bd990 Revise README.md to enhance clarity and user experience by updating the features section, streamlining the quick start guide, and introducing a new section on future improvements for zero-setup usage. The changes aim to provide a more intuitive overview of Flakestorm's capabilities and installation process. Entropix 2026-01-04 23:28:43 +08:00
  • efde15e9cb Update .gitignore to track flakestorm.yaml while excluding other local configuration files, ensuring proper version control of essential settings. Francisco M Humarang Jr. 2026-01-03 00:57:43 +08:00
  • 0b8777c614 Update version to 0.9.0 in pyproject.toml and __init__.py, enhance CONFIGURATION_GUIDE.md and USAGE_GUIDE.md with aggressive mutation strategies and requirements for invariants, and add validation to ensure at least 3 invariants are configured in FlakeStormConfig. Francisco M Humarang Jr. 2026-01-03 00:18:31 +08:00
  • e673b21b55 Update version to 0.8.0 in pyproject.toml, enhance README.md and USAGE_GUIDE.md with optional Rust extension installation instructions for improved performance, and remove outdated keywords_extractor_agent documentation. v0.9.0 v0.8 Francisco M Humarang Jr. 2026-01-02 22:32:18 +08:00
  • 408c4fed46 Update flakestorm_report2.png to reflect recent changes in report generation and visualization enhancements. Francisco M Humarang Jr. 2026-01-02 21:56:56 +08:00
  • 4f8e0bd386 Add new AI agent for generating search queries using Google Gemini - Introduce keywords_extractor_agent with robust error handling and response parsing - Include multiple fallback strategies for query generation - Update README.md and documentation to reflect new agent capabilities and setup instructions - Remove outdated broken_agent example and associated files. Francisco M Humarang Jr. 2026-01-02 21:52:56 +08:00
  • 2dcaf31712 Update model configuration and enhance documentation for improved user guidance - Change default model to "gemma3:1b" in flakestorm-generate-search-queries.yaml and increase mutation count from 3 to 20 - Revise README.md to include demo visuals and model recommendations based on system RAM - Expand USAGE_GUIDE.md with detailed model selection criteria and installation instructions - Enhance HTML report generation to include actionable recommendations for failed mutations and executive summary insights. Francisco M Humarang Jr. 2026-01-02 20:01:12 +08:00
  • 8fc291d186 Fix .gitignore to exclude root reports folder while tracking src/flakestorm/reports source code - Change reports/ to /reports/ to only ignore root reports directory - Add !src/flakestorm/reports/ to explicitly include source code module - Add reports module source files to repository Entropix 2026-01-02 18:21:08 +08:00
  • 661445c7b8 Add pre-flight validation, flexible response handling, and improved error detection - Add pre-flight check to validate agent with first golden prompt before mutations - Improve response extraction to handle various agent response formats automatically - Add support for non-JSON responses (plain text, HTML) - Enhance error detection for HTTP 200 responses with error fields - Add comprehensive auto-detection for common response field names - Improve JSON parsing error handling with graceful fallbacks - Add example YAML config for GenerateSearchQueries agent - Update documentation with build and installation fixes Entropix 2026-01-02 15:21:20 +08:00
  • c52a28377f Update documentation to clarify the integration process and enhance troubleshooting steps. Revise README.md and USAGE_GUIDE.md to include new integration examples and common error resolutions. Ensure consistency in terminology and provide additional context for users. entropix 2026-01-01 17:46:53 +08:00
  • 13d18e0428 Add Integrations Guide to README.md and outline Phase 7 roadmap in IMPLEMENTATION_CHECKLIST.md entropix 2026-01-01 17:29:41 +08:00
  • 844134920a Enhance mutation capabilities by adding three new types: encoding_attacks, context_manipulation, and length_extremes. Update configuration and documentation to reflect the addition of these types, including their weights and descriptions. Revise README.md, API_SPECIFICATION.md, CONFIGURATION_GUIDE.md, and other relevant documents to provide comprehensive coverage of the new mutation strategies and their applications. Ensure all tests are updated to validate the new mutation types. entropix 2026-01-01 17:28:05 +08:00
  • 859566ee59 Implement flexible HTTP agent adapter with request templates and connection guides - Add request_template, response_path, method, query_params, and parse_structured_input to AgentConfig - Implement structured input parser for key-value extraction from golden prompts - Implement template engine with variable substitution for {prompt} and {field_name} - Implement response extractor supporting JSONPath and dot notation - Update HTTPAgentAdapter to support all HTTP methods (GET, POST, PUT, PATCH, DELETE) - Add comprehensive connection guide explaining localhost vs public endpoints - Update documentation with examples for TypeScript/JavaScript developers - Add tests for all new features Entropix 2025-12-31 23:04:47 +08:00
  • 050204ef42 Enhance installation and troubleshooting instructions in README.md, CONTRIBUTING.md, and USAGE_GUIDE.md. Clarified requirements for Python 3.10+, added detailed steps for creating virtual environments, and provided solutions for common issues related to Ollama and flakestorm installations. Updated license information in README.md. Entropix 2025-12-30 22:33:47 +08:00
  • dbbdac9d43 Revise installation instructions in README.md, CONTRIBUTING.md, and USAGE_GUIDE.md to clarify the installation order for Ollama and flakestorm. Added detailed platform-specific installation steps for Ollama and emphasized the need for a virtual environment for Python packages. Included troubleshooting tips for common installation issues. Entropix 2025-12-30 18:36:42 +08:00
  • cb034b41ff Enhance installation instructions across documentation to emphasize the use of virtual environments for Python. Added details for creating and activating virtual environments in README.md, CONTRIBUTING.md, TEST_SCENARIOS.md, TESTING_GUIDE.md, and USAGE_GUIDE.md. Included pipx installation instructions for CLI use in USAGE_GUIDE.md. Entropix 2025-12-30 18:02:36 +08:00
  • bc0abff246 Update README.md to correct spelling of "FlakeStorm" to "Flakestorm" for consistency throughout the documentation. Entropix 2025-12-30 16:36:24 +08:00
  • 1d45fb2981 - Updated class names and import statements to align with the new naming convention. - Adjusted test commands and report references to use FlakeStorm terminology. - Ensured consistency in configuration and runner references throughout the documentation. Entropix 2025-12-30 16:13:29 +08:00
  • 0c986e268a Refactor documentation and remove CI/CD integration references Entropix 2025-12-30 16:03:42 +08:00
  • 8d752e9746 Remove refactoring script and update .gitignore Entropix 2025-12-30 15:49:58 +08:00
  • 297929af73 Update .gitignore to reflect new cloud repository structure Entropix 2025-12-30 15:40:40 +08:00
  • 69061b14bb Remove PUSH_INSTRUCTIONS.md as it is no longer needed. Update README.md to reflect the new license and add GitHub stars badge. Entropix 2025-12-29 13:10:55 +08:00
  • 344678afd0 Remove cloud references and limits.py, hardcode values Entropix 2025-12-29 13:05:22 +08:00
  • ee10da0b97 Add comprehensive documentation for flakestorm Entropix 2025-12-29 11:33:01 +08:00
  • 69e0f8deeb Fix .gitignore to allow docs files and add documentation files Entropix 2025-12-29 11:32:50 +08:00
  • 4dd882a2d2 Add PUSH_INSTRUCTIONS.md for pushing with Entropix account Entropix 2025-12-29 11:24:47 +08:00
  • 61652be09b Refactor Entropix to FlakeStorm Entropix 2025-12-29 11:15:18 +08:00
  • 7b75fc9530 Implement Open Source edition limits and feature restrictions Entropix 2025-12-29 00:11:02 +08:00
  • 2016be238d
         Update LICENSE entropixai 2025-12-28 21:59:11 +08:00
  • a36cecf255 Add initial project structure and configuration files Frank Humarang 2025-12-28 21:55:01 +08:00