Commit graph

72 commits

Author SHA1 Message Date
abigailgold
57e38ea4fa
Support for many new model output types (#93)
* General model wrappers and methods supporting multi-label classifiers
* Support for pytorch multi-label binary classifier
* New model output types + single implementation of score method that supports multiple output types. 
* Anonymization with pytorch multi-output binary model
* Support for multi-label binary models in minimizer. 
* Support for multi-label logits/probabilities
---------
Signed-off-by: abigailt <abigailt@il.ibm.com>
2024-07-03 09:04:59 -04:00
abigailgold
cb70ca10e6
Fix calculation of score for pytorch models when a single column of probabilities is used for binary classification (#91)
Signed-off-by: abigailt <abigailt@il.ibm.com>
2024-01-21 06:56:57 -05:00
abigailgold
5dce961092
Support 1-hot encoded features in anonymization + fixes related to encoding in minimization (#86)
* Support 1-hot encoded features in anonymization (#72)
* Fix anonymization adult notebook + new notebook to demonstrate anonymization on 1-hot encoded data

* Minimizer: No default encoder, if none provided data is supplied to the model as is. Fix data type of representative values. Fix and add more tests.

Signed-off-by: abigailt <abigailt@il.ibm.com>
2023-10-19 11:48:15 +03:00
abigailgold
13a0567183
Make data minimization more consistent and performant (#83)
* Update requirements

* Update incompatible scipy version

* Reduce runtime of dataset assessment tests

* ncp is now a class that contains 3 values: fit_score, transform_score and generalizations_score so that it doesn't matter in what order the different methods are called, all calculated ncp scores are stored.
Generalizations can now be applied either from tree cells or from global generalizations struct depending on the value of generalize_using_transform. Representative values can also be computed from global generalizations.
Removing a feature from the generalization can also be applied in either mode.

* Compute generalizations with test data when possible (for computing better representatives).

* Externalize common test code to methods.
2023-08-21 18:39:15 +03:00
abigailgold
8a9ef80146
Increase version to 0.2.0 (#74)
* Remove tensorflow dependency if not using keras model
* Remove xgboost dependency if not using xgboost model
* Documentation updates

Signed-off-by: abigailt <abigailt@il.ibm.com>
2023-05-08 12:50:55 +03:00
abigailgold
d52fcd0041
Formatting (#68)
Fix most flake/lint errors and ignore a few others

Signed-off-by: abigailt <abigailt@il.ibm.com>
2022-12-25 15:13:57 +02:00
Maya Anderson
89bdcfc00e Prepare project for CI: cleanup dependencies, fix test data location, cleanup assert.
Signed-off-by: Maya Anderson <mayaa@il.ibm.com>
2022-12-20 16:00:36 +02:00
abigailt
805a489201 Add method to get predict function from blackbox classifier, add loss and optimizer params for pytorch models to generate shadow models
Signed-off-by: abigailt <abigailt@il.ibm.com>
2022-11-09 14:42:55 +02:00
abigailt
44d012857f Add loss and optimizer as properties
Signed-off-by: abigailt <abigailt@il.ibm.com>
2022-10-19 17:29:40 +03:00
abigailt
64038f76f9 Merge with main 2022-08-01 18:12:03 +03:00
abigailt
dc5cc793ee Merge with main 2022-08-01 18:11:34 +03:00
abigailt
a9e2a35e18 Add support for xgboost XGBClassifier (#53) 2022-07-28 17:21:24 +03:00
olasaadi
74ce92acc4 fix 2022-07-26 18:37:44 +03:00
abigailt
a13415ad67 Externalize BlackboxClassifier dataset (x and predictions) 2022-07-25 16:31:45 +03:00
abigailt
fb534f7a0f BlackboxClassifier based on predictions to work with DatasetWithPredictions 2022-07-25 16:31:45 +03:00
abigailt
77a6e08c8e Keras regression support 2022-07-24 18:45:50 +03:00
Ron Shmelkin
15d7008224
remove self from array2numpy and array2torch_tensor functions 2022-07-24 15:32:09 +03:00
Ron Shmelkin
c77e34e373
update pytorch wrapper to use torch loaders
fix tests
and dataset style
2022-07-24 14:31:47 +03:00
olasaadi
fdc6005fce add validation set 2022-07-22 01:01:45 +03:00
olasaadi
65388da605 fix docstring 2022-07-20 18:39:53 +03:00
olasaadi
c2c7a01078 fix bug 2022-07-20 18:36:58 +03:00
olasaadi
6f69f5557b fix bug 2022-07-20 18:29:48 +03:00
olasaadi
3bf26b67d2 fix 2022-07-20 17:36:00 +03:00
abigailt
a7d156660e Wrap predict method in BlackBoxClassifierPredictMethod to avoid exception in ART when supplied method returns scalars 2022-07-20 13:33:19 +03:00
abigailt
1cc73b3da1 Check for mismatch between model output type and actual output 2022-07-20 13:33:19 +03:00
abigailt
bc7ab0cc7f Add model type to blackbox classifier (#49) 2022-07-20 13:33:19 +03:00
olasaadi
4973fbebc6 fix 2022-07-19 21:16:39 +03:00
abigailt
bc28f7f26a Return None where no predictions are available 2022-07-12 09:47:32 +03:00
abigailgold
00f9c16863
Support additional use cases for data (#46)
* Make ART black box classifier not apply preprocessing to data
* Add option to store predictions (in addition to x,y) in Dataset and Data classes
2022-07-11 14:28:09 +03:00
Shlomit Shachor
e25e58b253
enhance calculation of nb classes + tests (#45)
* update get_nb_classes method to handle 1-hot and scalar input
2022-07-05 11:32:17 +03:00
olasaadi
07e64b1f86 fix 2022-07-04 12:58:35 +03:00
olasaadi
af7d615628 fix 2022-07-04 12:55:58 +03:00
natali
50317a8d67 fix for keras model check_and_transform_label_format requires nb_classes 2022-07-03 09:59:41 +03:00
abigailgold
c6eb553a9f
Blackbox predict method (#43)
* Support output probabilities
* Support black box classifier with predict method
* Update requirements (security alert #1)
2022-06-30 18:23:53 +03:00
Natalia Razinkov
bb224cd3dd
Bug fix for PytorchData dataset 2022-06-26 15:15:51 +03:00
Shlomit Shachor
1c4b963add
Wrappers no train (#40)
1) Handle train None in Data
2) Update BB Classifier to handle None either for train or test (x or y)
2022-06-26 14:43:22 +03:00
olasaadi
21cba95a28 fix 2022-06-06 14:32:34 +03:00
olasaadi
c954f53ad7 fix 2022-06-06 14:02:40 +03:00
olasaadi
302d0c4b8c update 2022-06-02 15:25:07 +03:00
olasaadi
a3fb68fb56 update 2022-05-30 12:52:32 +03:00
olasaadi
8de77f9afd update 2022-05-30 11:52:47 +03:00
olasaadi
023f8764da update 2022-05-30 11:51:22 +03:00
olasaadi
8459d6961f fix 2022-05-23 13:35:09 +03:00
olasaadi
59d8b16bb4 fix 2022-05-23 12:49:38 +03:00
olasaadi
019f49861d fix 2022-05-23 12:15:35 +03:00
olasaadi
e0385b0d04 score 2022-05-19 04:40:02 +03:00
olasaadi
7539ca0ead save checkpoints 2022-05-19 04:29:55 +03:00
olasaadi
521c8ce041 fix 2022-05-17 16:57:21 +03:00
abigailgold
fe676fa426
New model wrappers (#32)
* keras wrapper + blackbox classifier wrapper (fix #7)

* fix error in NCP calculation

* Update notebooks

* Fix #25 (incorrect attack_feature indexes for social feature in notebook)

* Consistent naming of internal parameters
2022-05-12 15:44:29 +03:00
olasaadi
f484135d84 add classes and implement some functions 2022-05-08 13:50:58 +03:00