Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Map more datasets #26

Open
blotero opened this issue Dec 19, 2023 · 12 comments
Open

Map more datasets #26

blotero opened this issue Dec 19, 2023 · 12 comments

Comments

@blotero
Copy link
Owner

blotero commented Dec 19, 2023

Add API's for mapping more datasets

@blotero
Copy link
Owner Author

blotero commented Dec 19, 2023

Add MORPHO MNIST support https://github.com/dccastro/Morpho-MNIST

@blotero
Copy link
Owner Author

blotero commented Dec 19, 2023

Add Longitudinal Multiple Sclerosis Lesion Segmentation Challenge support: https://smart-stats-tools.org/lesion-challenge-2015

@blotero
Copy link
Owner Author

blotero commented Dec 19, 2023

@blotero
Copy link
Owner Author

blotero commented Dec 19, 2023

@blotero
Copy link
Owner Author

blotero commented Dec 19, 2023

QSMSC at UCL (real-world multiple sclerosis lesion dataset) does not seem to be a publicly available dataset. I've contacted first author and now I find myself waiting for a response.

@blotero
Copy link
Owner Author

blotero commented Jan 3, 2024

@blotero
Copy link
Owner Author

blotero commented Jan 4, 2024

I think we could use the tf native MNIST dataset instead of Morpho. This way, we can apply a similar disturbance strategy to the one applied to oxford pet instead of applying morphological transformations. https://www.tensorflow.org/api_docs/python/tf/keras/datasets/mnist

blotero added a commit that referenced this issue Jan 11, 2024
- initialized support for mnist
- added train module for training a simple unet segmentation model
  with mnist
blotero added a commit that referenced this issue Jan 11, 2024
- initialized support for mnist
- added train module for training a simple unet segmentation model
  with mnist
blotero added a commit that referenced this issue Jan 12, 2024
- loss plot for mnist train
blotero added a commit that referenced this issue Jan 12, 2024
- loss plot for mnist train
@blotero
Copy link
Owner Author

blotero commented Feb 6, 2024

@blotero
Copy link
Owner Author

blotero commented Feb 6, 2024

Add support for tomato seeds: https://gcpds-image-segmentation.readthedocs.io/en/latest/notebooks/02-datasets.html#Tomato-Seeds

This dataset is way too small for being meaningful, a typical UNet actchitecture training will have loss curves like the following:

image

This is unacceptable for achieving decent annotators emulation.

We will be using the augmented version with detection target instead. However, it would still require to adapt it as tf generator dataset.

@blotero
Copy link
Owner Author

blotero commented Feb 6, 2024

Add support for tomato seeds: https://gcpds-image-segmentation.readthedocs.io/en/latest/notebooks/02-datasets.html#Tomato-Seeds

This dataset is way too small for being meaningful, a typical UNet actchitecture training will have loss curves like the following:

image

This is unacceptable for achieving decent annotators emulation.

We will be using the augmented version with detection target instead. However, it would still require to adapt it as tf generator dataset.

Successful results for tomato seeds disturbing model:

image

Implementation will be included in nexts PR's

blotero added a commit that referenced this issue Feb 8, 2024
- included roboflow in env
blotero added a commit that referenced this issue Apr 15, 2024
- included roboflow in env
blotero added a commit that referenced this issue Apr 24, 2024
- initialized mapping for crowd seg histopatology dataset
@blotero
Copy link
Owner Author

blotero commented Apr 24, 2024

blotero added a commit that referenced this issue Apr 24, 2024
- initialized mapping for crowd seg histopatology dataset
blotero added a commit that referenced this issue Apr 30, 2024
- further definitions on crowd seg dataset generator
blotero added a commit that referenced this issue Apr 30, 2024
- further definitions on crowd seg dataset generator
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant