Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Method refactor dataloaders #7

Open
wants to merge 5 commits into
base: method_refactor
Choose a base branch
from

Conversation

nikkifalicov
Copy link
Collaborator

Reason: The previous logic to retrieve the dataloaders and apply image transformations needed to be modified individually for each dataset, which is clunky when we try to run labeled-set only training for multiple datasets.

Fix: Add in a get_dataloaders function to hyper_search.py that can create and return the dataloaders necessary for training without separate logic for each dataset. Created different dataloaders for unlabeled data as well as CheXpert, to handle differences in label processing. Added in argument specifying path to unlabeled data.

Verification: Verified that data is processed and returned correctly by creating dataloaders for train, test, and validation (unlabeled data is not applicable for label-set only training at the moment, but logic to handle it was included), and manually saved outputs to qualitatively evaluate that the images were correct. Images are not included here since they contain sensitive medical information.

@PatrickFeeney
Copy link
Collaborator

Added some TODO comments in the code. Code also needs to apply Flake8 formatting. Should be ready to merge after that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants