Commit graph

73 commits

Author SHA1 Message Date
olasaadi
e0385b0d04 score 2022-05-19 04:40:02 +03:00
olasaadi
7539ca0ead save checkpoints 2022-05-19 04:29:55 +03:00
olasaadi
521c8ce041 fix 2022-05-17 16:57:21 +03:00
olasaadi
f484135d84 add classes and implement some functions 2022-05-08 13:50:58 +03:00
abigailt
b8d2535231 Fix handling of categorical features 2022-04-25 17:41:15 +03:00
abigailt
a37ff06df8 Squashed commit of the following:
commit d53818644e
Author: olasaadi <92303887+olasaadi@users.noreply.github.com>
Date:   Mon Mar 7 20:12:55 2022 +0200

    Build the dt on all features anon (#23)

    * add param to build the DT on all features and not just on QI
    * one-hot encoding only for categorical features

commit c47819a031
Author: abigailt <abigailt@il.ibm.com>
Date:   Wed Feb 23 19:40:11 2022 +0200

    Update docs

commit 7e2ce7fe96
Merge: 7fbd1e4 752871d
Author: abigailt <abigailt@il.ibm.com>
Date:   Wed Feb 23 19:26:44 2022 +0200

    Merge remote-tracking branch 'origin/main' into main

commit 7fbd1e4b90
Author: abigailt <abigailt@il.ibm.com>
Date:   Wed Feb 23 19:22:54 2022 +0200

    Update version and docs

commit 752871dd0c
Author: olasaadi <92303887+olasaadi@users.noreply.github.com>
Date:   Wed Feb 23 14:57:12 2022 +0200

    add minimization notebook (#22)

    * add german credit notebook to showcase new features (minimize only some features and categorical features)

    * add notebook to show minimization data on a regression problem
2022-04-25 17:39:30 +03:00
ABIGAIL GOLDSTEEN
fb2413c4aa Fix boolean property return types 2022-04-19 15:24:14 +03:00
Ola Saadi
ac5d82aab6 Wrapper minimizer (#20)
* apply dataset wrapper on minimizer
* apply changes on minimization notebook
* add black_box_access and unlimited_queries params
2022-04-18 13:14:49 +03:00
ABIGAIL GOLDSTEEN
6b04fd5564 Remove failing assert
Regression scores do not necessarily have to be between 0 and 1 (as opposed to classification scores).
2022-04-05 14:51:02 +03:00
Ola Saadi
8290be0173 Merge pull request #15 from HRLDataSecurityAndPrivacy/dataset_wrapper_anonimizer
Dataset wrapper anonymizer
2022-03-28 17:12:19 +03:00
Ola Saadi
5f6a258f8f Merge branch 'wrappers' into dataset_wrapper_anonimizer 2022-03-28 17:11:41 +03:00
olasaadi
31e278fe60 fix bug 2022-03-28 00:07:54 +03:00
olasaadi
6172385d91 update docstring 2022-03-28 00:07:23 +03:00
olasaadi
3bc1341dad update docstring 2022-03-28 00:07:04 +03:00
olasaadi
b54f0a2382 fix tests 2022-03-24 19:35:26 +02:00
olasaadi
66c86dc595 fix notebook and add features_names to ArrayDataset
and allow providing features names in QI and Cat features not just indexes
2022-03-24 19:32:24 +02:00
olasaadi
137167fb0c update notebooks 2022-03-23 21:52:06 +02:00
olasaadi
06158c8508 update 2022-03-23 17:54:37 +02:00
olasaadi
312469212e fix docstring and fix assert in test 2022-03-22 13:59:28 +02:00
olasaadi
5b3476071f fix 2022-03-21 21:59:14 +02:00
olasaadi
8aa7bb8281 categorical features and QI passed by indexes
dataset include feature names and is_pandas param
2022-03-21 21:57:11 +02:00
olasaadi
3263f92bee anonymizer works with numpy and return numpy/pandas as original dataset 2022-03-19 18:06:10 +02:00
olasaadi
7b788b9018 using dataset wrapper on anonymizer 2022-03-19 17:03:53 +02:00
Ron Shmelkin
a432b8f5f9 add pytorch Dataset 2022-03-19 17:03:44 +02:00
abigailt
a9162fbc43 Add more to wrappers 2022-03-19 17:03:44 +02:00
Ron Shmelkin
f99bf31030 add pytorch Dataset 2022-03-15 15:33:14 +02:00
abigailt
45cc9180b8 Add more to wrappers 2022-03-15 11:42:57 +02:00
olasaadi
a2b560920f apply changes 2022-03-15 10:52:45 +02:00
olasaadi
c5d3be2390 Merge remote-tracking branch 'origin/dataset_wrapper_anonimizer' into dataset_wrapper_anonimizer
# Conflicts:
#	apt/anonymization/anonymizer.py
#	apt/utils/dataset_utils.py
#	apt/utils/models/sklearn_model.py
#	tests/test_anonymizer.py
#	tests/test_model.py
2022-03-10 13:49:43 +02:00
olasaadi
b4eddabd37 apply changes after rebase with wrappers 2022-03-10 13:49:05 +02:00
olasaadi
6afb175d6f add dataset wrapper to docstring 2022-03-10 13:42:49 +02:00
olasaadi
eefad206cd fix bug and update test_model 2022-03-10 13:42:47 +02:00
olasaadi
1280b849f4 using dataset wrapper on anonymizer 2022-03-10 13:41:57 +02:00
olasaadi
c0dbb200e7 add dataset wrapper to docstring 2022-03-10 13:04:39 +02:00
olasaadi
300e391432 fix bug and update test_model 2022-03-10 12:56:41 +02:00
abigailt
f2df2fcc8c Renaming 2022-03-07 19:09:31 +02:00
abigailt
3d82db80c4 Remove redundant code.
Use data wrappers in model wrapper APIs.
More typing.
2022-03-06 21:15:07 +02:00
olasaadi
fd9f134336 using dataset wrapper on anonymizer 2022-03-01 02:28:41 +02:00
RON SHMELKIN
9f4d649934 add generic dataset components (#7)
* add generic dataset components
2022-02-22 12:00:04 +02:00
ABIGAIL GOLDSTEEN
b0c6c4d28e Create initial version of wrappers for models (#1)
* New wrapper classes for models
2022-02-10 15:36:41 +02:00
abigailgold
9de078f937
Update readme's with paper citations (#21) 2022-02-01 12:27:22 +02:00
olasaadi
3feebe8973
Regression minimization (#20)
* support regression in minimization and add test

* fix #10
2022-01-27 15:57:55 +02:00
olasaadi
cb9278ddb5
Support regression models (#19)
* support DecisionTreeRegressor

* support regression models

* Update membership_inference_dp_diabetes_reg.ipynb
2022-01-26 14:30:58 +02:00
olasaadi
a9a93c8a3a
Train just on qi (#15)
* QI updates
* update code to support training ML on QI features
* fix code so features that are not from QI should not be part of generalizations
and add description
* merging two branches, training on QI and on all data
* adding tests and asserts
2022-01-12 17:01:27 +02:00
olasaadi
2eb626c00c
Sup cat features (#14)
* support categorical features

* update the documentation and readme
added a test for the case where cells are supplied as a param.

* add big tests (adult test and iris)
and fixed bugs

* update transform to return numpy if original data is numpy

* added nursery test

* break loop if there is an illegal level

* Stop pruning one step before passing accuracy threshold

* adding asserts and fix DecisionTreeClassifier init

* Fix tests

Co-authored-by: abigailt <abigailt@il.ibm.com>
2022-01-11 09:51:04 +02:00
abigailt
c1450865b1 Add link to Slack 2021-11-02 14:19:22 +02:00
abigailt
e44da7d1b5 Notebook fix 2021-08-18 07:51:23 +03:00
abigailgold
43952e2332
Minimization fixes (#12)
* Fixes related to corner cases in calculating generalizations

* Fix print

* Fix corner cases in transform as well

* Improve prints + bug fixes in calculation of feature to remove

* Notebook demonstrating ai minimization
2021-08-17 21:19:48 +03:00
abigailgold
d2591d7840
Update README.md 2021-08-12 14:44:49 +03:00
abigailt
dc43c9db94 Fix link in notebook 2021-08-02 11:50:43 +03:00