29 Commits

Author SHA1 Message Date
9985b91b75 Added the benchmarking script (Not working properly) 2026-05-29 15:52:49 +01:00
f9798b9cf8 Adding some missing files from the last commits. 2026-05-29 15:51:30 +01:00
7c72462e53 Moving the description generation to its own function and expanding it. 2026-05-07 17:13:47 +01:00
92db500bd0 Added prototype code for dataset distribution evaluation. 2026-05-06 16:29:13 +01:00
536c29978d Capability enum change COLOR=>TONE. 2026-05-06 16:28:28 +01:00
e2790d2d5d Moving the gini function to metrics.py. 2026-05-06 16:26:52 +01:00
4b6a2b2335 Formatting buffer and fixing imports. 2026-05-05 15:43:04 +01:00
8d3f039bba Adjusting the metrics for age bracket and gender. More below.
Added metrics for age bracket (`n_off_accuracy`), as well as
binary/multiclass false-{positive,negative} rates (`binary_fpr_fnr`
and `multiclass_fpr_fnr`). Also, added mutual agreement between models
`agreement_fraction` and `agreement_elements`.
2026-05-05 15:19:21 +01:00
af43c00aa0 Commenting out the ethnicity prediction for FairFace. Minor changes. 2026-05-05 15:18:43 +01:00
20cf80d94e Added the possible_capability_values base method for estimators...
New `possible_capability_values` base method for estimators. The goal
is to return a list of possible values for each non-numerical
capability, as some performance metrics may benefit from this complete
listing.

Additionally, added a new exception to indicate when a capability is
invalid in a given context, e.g., when the model does not support it.
2026-04-22 13:49:32 +01:00
a265fd24a1 Some auxiliary rules for make. 2026-04-22 13:31:02 +01:00
1d14f71f8b Removed redundant requirements-dev. 2026-04-21 16:51:26 +01:00
a3ee18748b Added pandas as dependency. More below.
The rationale of using `csvfile` instead of `pandas` directly, was to
avoid a fairly heavy dependency, since we were only reading the CSV
data. Now, since we need to do some fairly convoluted filtering to
calculate the subgroup metrics, its better to use pandas now.
2026-04-20 16:50:29 +01:00
Guilherme G. Schardong
923c0aeff7 Added metrics per subgroup and related functions. 2026-04-19 00:37:19 +01:00
Guilherme G. Schardong
0ebca5c450 Updating Makefile to create the models dir. Added nuke rule. 2026-04-19 00:36:02 +01:00
eafd64f150 Adding the metrics file. 2026-04-17 17:00:17 +01:00
993ed2284d Adding the Makefile. 2026-04-17 16:58:52 +01:00
874337d7c8 Moved the get_face_boxes function to the correct place. 2026-04-17 16:58:24 +01:00
42093be21f Removing all Optional instances. 2026-04-17 16:58:05 +01:00
8b241e09cd Removed commented code, added docstrings and references. 2026-04-16 17:35:18 +01:00
b828450a09 Adding gdown to the requirements list. 2026-04-16 15:04:53 +01:00
dc3e913f7b Added docstring, and load_metadata function. 2026-04-16 14:01:31 +01:00
adadf4c7fd Added missing imports. 2026-04-16 14:01:23 +01:00
250d218f9b Added capabilities (Capability) to the estimators. 2026-04-16 14:00:55 +01:00
27efada40e Adding the MiVOLOv1 Face only estimator. Minor refactoring. 2026-04-16 13:59:49 +01:00
Guilherme G. Schardong
bceea16708 Updating requirements list. 2026-04-15 22:26:17 +01:00
Guilherme G. Schardong
e46d0d6d60 Adding gitignore. 2026-04-15 22:26:02 +01:00
Guilherme G. Schardong
1c11b41329 Added setup and basic module sources. 2026-04-15 22:24:58 +01:00
Guilherme Schardong
3e1e491a99 Adding requirements. 2026-04-09 19:28:13 +01:00