apunkt/flakestorm
1
0
Fork 0
mirror of https://github.com/flakestorm/flakestorm.git synced 2026-04-25 00:36:54 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions
40 commits 1 branch 4 tags 44 MiB
Commit graph

40 commits

This branch
This branch
All branches
Author SHA1 Message Date
Francisco M Humarang Jr.
be8a87262a Merge remote changes and resolve README.md conflicts 2026-01-05 16:55:44 +08:00
Francisco M Humarang Jr.
9e1204a9fe Enhance README.md to clarify the purpose and functionality of Flakestorm for production AI agents. Update descriptions to emphasize chaos testing, adversarial input handling, and CI/CD integration. Add sections on target users and production deployment patterns, ensuring comprehensive guidance for teams shipping AI agents. 2026-01-05 16:53:23 +08:00
Entropix
b57b6e88dc Merge remote-tracking branch 'origin/main' 2026-01-05 00:02:45 +08:00
Entropix
fa35634dac Remove PUBLISHING.md from .gitignore to allow tracking of publishing documentation. 2026-01-05 00:01:10 +08:00
flakestorm
7f44a647c4
Update README.md 2026-01-05 00:00:25 +08:00
Entropix
84119ed0ec Merge remote-tracking branch 'origin/main' 2026-01-04 23:57:11 +08:00
Entropix
22993d5da2 Add troubleshooting section to README.md with links for fixing installation and build issues. This update aims to assist users in resolving common problems encountered during setup. 2026-01-04 23:56:13 +08:00
flakestorm
6e1c2d028d
Update README.md 2026-01-04 23:52:03 +08:00
flakestorm
af60bef34e
Update README.md 2026-01-04 23:50:50 +08:00
Entropix
d339d5e436 Refactor README.md and USAGE_GUIDE.md to streamline installation instructions and enhance clarity on robustness scoring and mutation strategies. Removed outdated sections and added detailed explanations for mutation types and their applications in testing. This update aims to improve user understanding and facilitate easier setup and usage of Flakestorm. 2026-01-04 23:39:24 +08:00
Entropix
732a7bd990 Revise README.md to enhance clarity and user experience by updating the features section, streamlining the quick start guide, and introducing a new section on future improvements for zero-setup usage. The changes aim to provide a more intuitive overview of Flakestorm's capabilities and installation process. 2026-01-04 23:28:43 +08:00
Francisco M Humarang Jr.
efde15e9cb Update .gitignore to track flakestorm.yaml while excluding other local configuration files, ensuring proper version control of essential settings. 2026-01-03 00:57:43 +08:00
Francisco M Humarang Jr.
0b8777c614 Update version to 0.9.0 in pyproject.toml and __init__.py, enhance CONFIGURATION_GUIDE.md and USAGE_GUIDE.md with aggressive mutation strategies and requirements for invariants, and add validation to ensure at least 3 invariants are configured in FlakeStormConfig. 2026-01-03 00:18:31 +08:00
Francisco M Humarang Jr.
e673b21b55 Update version to 0.8.0 in pyproject.toml, enhance README.md and USAGE_GUIDE.md with optional Rust extension installation instructions for improved performance, and remove outdated keywords_extractor_agent documentation. 2026-01-02 22:32:18 +08:00
Francisco M Humarang Jr.
408c4fed46 Update flakestorm_report2.png to reflect recent changes in report generation and visualization enhancements. 2026-01-02 21:56:56 +08:00
Francisco M Humarang Jr.
4f8e0bd386 Add new AI agent for generating search queries using Google Gemini - Introduce keywords_extractor_agent with robust error handling and response parsing - Include multiple fallback strategies for query generation - Update README.md and documentation to reflect new agent capabilities and setup instructions - Remove outdated broken_agent example and associated files. 2026-01-02 21:52:56 +08:00
Francisco M Humarang Jr.
2dcaf31712 Update model configuration and enhance documentation for improved user guidance - Change default model to "gemma3:1b" in flakestorm-generate-search-queries.yaml and increase mutation count from 3 to 20 - Revise README.md to include demo visuals and model recommendations based on system RAM - Expand USAGE_GUIDE.md with detailed model selection criteria and installation instructions - Enhance HTML report generation to include actionable recommendations for failed mutations and executive summary insights. 2026-01-02 20:01:12 +08:00
Entropix
8fc291d186 Fix .gitignore to exclude root reports folder while tracking src/flakestorm/reports source code - Change reports/ to /reports/ to only ignore root reports directory - Add !src/flakestorm/reports/ to explicitly include source code module - Add reports module source files to repository 2026-01-02 18:21:08 +08:00
Entropix
661445c7b8 Add pre-flight validation, flexible response handling, and improved error detection - Add pre-flight check to validate agent with first golden prompt before mutations - Improve response extraction to handle various agent response formats automatically - Add support for non-JSON responses (plain text, HTML) - Enhance error detection for HTTP 200 responses with error fields - Add comprehensive auto-detection for common response field names - Improve JSON parsing error handling with graceful fallbacks - Add example YAML config for GenerateSearchQueries agent - Update documentation with build and installation fixes 2026-01-02 15:21:20 +08:00
entropix
c52a28377f Update documentation to clarify the integration process and enhance troubleshooting steps. Revise README.md and USAGE_GUIDE.md to include new integration examples and common error resolutions. Ensure consistency in terminology and provide additional context for users. 2026-01-01 17:46:53 +08:00
entropix
13d18e0428 Add Integrations Guide to README.md and outline Phase 7 roadmap in IMPLEMENTATION_CHECKLIST.md 2026-01-01 17:29:41 +08:00
entropix
844134920a Enhance mutation capabilities by adding three new types: encoding_attacks, context_manipulation, and length_extremes. Update configuration and documentation to reflect the addition of these types, including their weights and descriptions. Revise README.md, API_SPECIFICATION.md, CONFIGURATION_GUIDE.md, and other relevant documents to provide comprehensive coverage of the new mutation strategies and their applications. Ensure all tests are updated to validate the new mutation types. 2026-01-01 17:28:05 +08:00
Entropix
859566ee59 Implement flexible HTTP agent adapter with request templates and connection guides - Add request_template, response_path, method, query_params, and parse_structured_input to AgentConfig - Implement structured input parser for key-value extraction from golden prompts - Implement template engine with variable substitution for {prompt} and {field_name} - Implement response extractor supporting JSONPath and dot notation - Update HTTPAgentAdapter to support all HTTP methods (GET, POST, PUT, PATCH, DELETE) - Add comprehensive connection guide explaining localhost vs public endpoints - Update documentation with examples for TypeScript/JavaScript developers - Add tests for all new features 2025-12-31 23:04:47 +08:00
Entropix
050204ef42 Enhance installation and troubleshooting instructions in README.md, CONTRIBUTING.md, and USAGE_GUIDE.md. Clarified requirements for Python 3.10+, added detailed steps for creating virtual environments, and provided solutions for common issues related to Ollama and flakestorm installations. Updated license information in README.md. 2025-12-30 22:33:47 +08:00
Entropix
dbbdac9d43 Revise installation instructions in README.md, CONTRIBUTING.md, and USAGE_GUIDE.md to clarify the installation order for Ollama and flakestorm. Added detailed platform-specific installation steps for Ollama and emphasized the need for a virtual environment for Python packages. Included troubleshooting tips for common installation issues. 2025-12-30 18:36:42 +08:00
Entropix
cb034b41ff Enhance installation instructions across documentation to emphasize the use of virtual environments for Python. Added details for creating and activating virtual environments in README.md, CONTRIBUTING.md, TEST_SCENARIOS.md, TESTING_GUIDE.md, and USAGE_GUIDE.md. Included pipx installation instructions for CLI use in USAGE_GUIDE.md. 2025-12-30 18:02:36 +08:00
Entropix
bc0abff246 Update README.md to correct spelling of "FlakeStorm" to "Flakestorm" for consistency throughout the documentation. 2025-12-30 16:36:24 +08:00
Entropix
1d45fb2981 - Updated class names and import statements to align with the new naming convention. 
- Adjusted test commands and report references to use FlakeStorm terminology.
- Ensured consistency in configuration and runner references throughout the documentation.
 2025-12-30 16:13:29 +08:00
Entropix
0c986e268a Refactor documentation and remove CI/CD integration references 
- Updated README.md to clarify local testing instructions and added error handling for low scores.
- Removed CI/CD configuration details from CONFIGURATION_GUIDE.md and other documentation files.
- Cleaned up MODULES.md by deleting references to the now-removed github_actions.py.
- Streamlined TEST_SCENARIOS.md and USAGE_GUIDE.md by eliminating CI/CD related sections.
- Adjusted CLI command help text in main.py for clarity on minimum score checks.
 2025-12-30 16:03:42 +08:00
Entropix
8d752e9746 Remove refactoring script and update .gitignore 
- Deleted the refactor_to_flakestorm.py script as it is no longer needed.
- Updated .gitignore to remove references to the cloud directory and ensure proper exclusion of backend and frontend repositories.
 2025-12-30 15:49:58 +08:00
Entropix
297929af73 Update .gitignore to reflect new cloud repository structure 
- Remove specific cloud directory references and clarify that backend and frontend are in separate private repositories.
- Add entries for flakestorm-cloud-backend and flakestorm-cloud-frontend to ensure they are ignored in the public repository.
 2025-12-30 15:40:40 +08:00
Entropix
69061b14bb Remove PUSH_INSTRUCTIONS.md as it is no longer needed. Update README.md to reflect the new license and add GitHub stars badge. 2025-12-29 13:10:55 +08:00
Entropix
344678afd0 Remove cloud references and limits.py, hardcode values 
- Delete limits.py module entirely
- Delete github_actions.py integration
- Hardcode MAX_MUTATIONS_PER_RUN = 50 in orchestrator
- Hardcode PARALLEL_EXECUTION_ENABLED = False
- Remove all cloud references from code and README
- Remove cloud and limits CLI commands
- Make open source version 100% standalone
- Add nosec comments for bandit false positives
 2025-12-29 13:05:22 +08:00
Entropix
ee10da0b97 Add comprehensive documentation for flakestorm 
- Introduced multiple new documents including API Specification, Configuration Guide, Contributing Guide, Developer FAQ, Implementation Checklist, Module Documentation, Publishing Guide, Test Scenarios, Testing Guide, and Usage Guide.
- Each document provides detailed instructions, examples, and best practices for using and contributing to flakestorm.
- Enhanced overall project documentation to support users and developers in understanding and utilizing the framework effectively.
 2025-12-29 11:33:01 +08:00
Entropix
69e0f8deeb Fix .gitignore to allow docs files and add documentation files 
- Fix .gitignore pattern: un-ignore docs/ directory first, then ignore docs/*, then un-ignore specific files
- Add all documentation files referenced in README.md:
  - USAGE_GUIDE.md
  - CONFIGURATION_GUIDE.md
  - TEST_SCENARIOS.md
  - MODULES.md
  - DEVELOPER_FAQ.md
  - PUBLISHING.md
  - CONTRIBUTING.md
  - API_SPECIFICATION.md
  - TESTING_GUIDE.md
  - IMPLEMENTATION_CHECKLIST.md
- Pre-commit hooks fixed trailing whitespace and end-of-file formatting
 2025-12-29 11:32:50 +08:00
Entropix
4dd882a2d2 Add PUSH_INSTRUCTIONS.md for pushing with Entropix account 2025-12-29 11:24:47 +08:00
Entropix
61652be09b Refactor Entropix to FlakeStorm 
- Rename all instances of Entropix to FlakeStorm
- Rename package from entropix to flakestorm
- Update all class names (EntropixConfig -> FlakeStormConfig, EntropixRunner -> FlakeStormRunner)
- Update Rust module from entropix_rust to flakestorm_rust
- Update README: remove cloud comparison, update links to flakestorm.com
- Update .gitignore to allow docs files referenced in README
- Add origin remote for VS Code compatibility
- Fix missing imports and type references
- All imports and references updated throughout codebase
 2025-12-29 11:15:18 +08:00
Entropix
7b75fc9530 Implement Open Source edition limits and feature restrictions 
- Add 5 mutation types (paraphrase, noise, tone_shift, prompt_injection, custom)
- Cap mutations at 50 per test run
- Force sequential execution only
- Disable GitHub Actions integration (Cloud feature)
- Add upgrade prompts throughout CLI
- Update README with feature comparison
- Add limits.py module for centralized limit management
- Add cloud and limits CLI commands
- Update all documentation with Cloud upgrade messaging
 2025-12-29 00:11:02 +08:00
entropixai
2016be238d
Update LICENSE 2025-12-28 21:59:11 +08:00
Frank Humarang
a36cecf255 Add initial project structure and configuration files 
- Created .gitignore to exclude unnecessary files and directories.
- Added Cargo.toml for Rust workspace configuration.
- Introduced example configuration file entropix.yaml.example for user customization.
- Included LICENSE file with Apache 2.0 license details.
- Created pyproject.toml for Python project metadata and dependencies.
- Added README.md with project overview and usage instructions.
- Implemented a broken agent example to demonstrate testing capabilities.
- Established Rust module structure with Cargo.toml and source files.
- Set up initial tests for assertions and configuration validation.
 2025-12-28 21:55:01 +08:00