Commit graph

28 commits

Author SHA1 Message Date
abigailgold
13a0567183
Make data minimization more consistent and performant (#83)
* Update requirements

* Update incompatible scipy version

* Reduce runtime of dataset assessment tests

* ncp is now a class that contains 3 values: fit_score, transform_score and generalizations_score so that it doesn't matter in what order the different methods are called, all calculated ncp scores are stored.
Generalizations can now be applied either from tree cells or from global generalizations struct depending on the value of generalize_using_transform. Representative values can also be computed from global generalizations.
Removing a feature from the generalization can also be applied in either mode.

* Compute generalizations with test data when possible (for computing better representatives).

* Externalize common test code to methods.
2023-08-21 18:39:15 +03:00
abigailt
64038f76f9 Merge with main 2022-08-01 18:12:03 +03:00
abigailt
dc5cc793ee Merge with main 2022-08-01 18:11:34 +03:00
abigailt
fb534f7a0f BlackboxClassifier based on predictions to work with DatasetWithPredictions 2022-07-25 16:31:45 +03:00
Ron Shmelkin
15d7008224
remove self from array2numpy and array2torch_tensor functions 2022-07-24 15:32:09 +03:00
Ron Shmelkin
c77e34e373
update pytorch wrapper to use torch loaders
fix tests
and dataset style
2022-07-24 14:31:47 +03:00
abigailt
bc28f7f26a Return None where no predictions are available 2022-07-12 09:47:32 +03:00
abigailgold
00f9c16863
Support additional use cases for data (#46)
* Make ART black box classifier not apply preprocessing to data
* Add option to store predictions (in addition to x,y) in Dataset and Data classes
2022-07-11 14:28:09 +03:00
Natalia Razinkov
bb224cd3dd
Bug fix for PytorchData dataset 2022-06-26 15:15:51 +03:00
Shlomit Shachor
1c4b963add
Wrappers no train (#40)
1) Handle train None in Data
2) Update BB Classifier to handle None either for train or test (x or y)
2022-06-26 14:43:22 +03:00
olasaadi
302d0c4b8c update 2022-06-02 15:25:07 +03:00
abigailgold
fe676fa426
New model wrappers (#32)
* keras wrapper + blackbox classifier wrapper (fix #7)

* fix error in NCP calculation

* Update notebooks

* Fix #25 (incorrect attack_feature indexes for social feature in notebook)

* Consistent naming of internal parameters
2022-05-12 15:44:29 +03:00
abigailgold
fd6be8e778
Documentation updates (#29)
* Bump version to 0.1.0 (breaking changes to some APIs)

* Update documentation

* Update requirements

* gitignore
2022-05-02 11:46:18 +03:00
abigailgold
2b2dab6bef
Data and Model wrappers (#26)
* Squashed commit of wrappers:

    Wrapper minimizer

    * apply dataset wrapper on minimizer
    * apply changes on minimization notebook
    * add black_box_access and unlimited_queries params

    Dataset wrapper anonymizer

    Add features_names to ArrayDataset
    and allow providing features names in QI and Cat features not just indexes

    update notebooks

    categorical features and QI passed by indexes
    dataset include feature names and is_pandas param

    add pytorch Dataset

    Remove redundant code.
    Use data wrappers in model wrapper APIs.

    add generic dataset components 

    Create initial version of wrappers for models

* Fix handling of categorical features
2022-04-27 12:33:27 +03:00
Ola Saadi
ac5d82aab6 Wrapper minimizer (#20)
* apply dataset wrapper on minimizer
* apply changes on minimization notebook
* add black_box_access and unlimited_queries params
2022-04-18 13:14:49 +03:00
Ola Saadi
5f6a258f8f Merge branch 'wrappers' into dataset_wrapper_anonimizer 2022-03-28 17:11:41 +03:00
olasaadi
3bc1341dad update docstring 2022-03-28 00:07:04 +03:00
olasaadi
66c86dc595 fix notebook and add features_names to ArrayDataset
and allow providing features names in QI and Cat features not just indexes
2022-03-24 19:32:24 +02:00
olasaadi
06158c8508 update 2022-03-23 17:54:37 +02:00
olasaadi
8aa7bb8281 categorical features and QI passed by indexes
dataset include feature names and is_pandas param
2022-03-21 21:57:11 +02:00
olasaadi
3263f92bee anonymizer works with numpy and return numpy/pandas as original dataset 2022-03-19 18:06:10 +02:00
Ron Shmelkin
a432b8f5f9 add pytorch Dataset 2022-03-19 17:03:44 +02:00
abigailt
a9162fbc43 Add more to wrappers 2022-03-19 17:03:44 +02:00
Ron Shmelkin
f99bf31030 add pytorch Dataset 2022-03-15 15:33:14 +02:00
abigailt
45cc9180b8 Add more to wrappers 2022-03-15 11:42:57 +02:00
abigailt
f2df2fcc8c Renaming 2022-03-07 19:09:31 +02:00
abigailt
3d82db80c4 Remove redundant code.
Use data wrappers in model wrapper APIs.
More typing.
2022-03-06 21:15:07 +02:00
RON SHMELKIN
9f4d649934 add generic dataset components (#7)
* add generic dataset components
2022-02-22 12:00:04 +02:00