Skip to content

Commit

Permalink
deploy: c7478b9
Browse files Browse the repository at this point in the history
  • Loading branch information
jeandut committed Jun 12, 2024
0 parents commit debd160
Show file tree
Hide file tree
Showing 114 changed files with 21,378 additions and 0 deletions.
4 changes: 4 additions & 0 deletions .buildinfo
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
config: 5a95befbf787dbab18242f13e781c7a1
tags: 645f666f9bcd5a90fca523b33c5a78b7
Binary file added .doctrees/contributing.doctree
Binary file not shown.
Binary file added .doctrees/datasets.doctree
Binary file not shown.
Binary file added .doctrees/docker.doctree
Binary file not shown.
Binary file added .doctrees/environment.pickle
Binary file not shown.
Binary file added .doctrees/faq.doctree
Binary file not shown.
Binary file added .doctrees/fed_camelyon.doctree
Binary file not shown.
Binary file added .doctrees/fed_heart.doctree
Binary file not shown.
Binary file added .doctrees/fed_isic.doctree
Binary file not shown.
Binary file added .doctrees/fed_ixi.doctree
Binary file not shown.
Binary file added .doctrees/fed_kits19.doctree
Binary file not shown.
Binary file added .doctrees/fed_lidc.doctree
Binary file not shown.
Binary file added .doctrees/fed_tcga_brca.doctree
Binary file not shown.
Binary file added .doctrees/fedbiomed.doctree
Binary file not shown.
Binary file added .doctrees/fedml.doctree
Binary file not shown.
Binary file added .doctrees/index.doctree
Binary file not shown.
Binary file added .doctrees/installation.doctree
Binary file not shown.
Binary file added .doctrees/quickstart.doctree
Binary file not shown.
Binary file added .doctrees/reproducing.doctree
Binary file not shown.
Binary file added .doctrees/strategies.doctree
Binary file not shown.
Binary file added .doctrees/substra.doctree
Binary file not shown.
Empty file added .nojekyll
Empty file.
Binary file added _images/logo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added _images/output_27_0.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
432 changes: 432 additions & 0 deletions _modules/flamby/datasets/fed_camelyon16/dataset.html

Large diffs are not rendered by default.

441 changes: 441 additions & 0 deletions _modules/flamby/datasets/fed_heart_disease/dataset.html

Large diffs are not rendered by default.

368 changes: 368 additions & 0 deletions _modules/flamby/datasets/fed_isic2019/dataset.html

Large diffs are not rendered by default.

404 changes: 404 additions & 0 deletions _modules/flamby/datasets/fed_ixi/dataset.html

Large diffs are not rendered by default.

524 changes: 524 additions & 0 deletions _modules/flamby/datasets/fed_kits19/dataset.html

Large diffs are not rendered by default.

401 changes: 401 additions & 0 deletions _modules/flamby/datasets/fed_lidc_idri/dataset.html

Large diffs are not rendered by default.

281 changes: 281 additions & 0 deletions _modules/flamby/datasets/fed_tcga_brca/dataset.html

Large diffs are not rendered by default.

341 changes: 341 additions & 0 deletions _modules/flamby/strategies/cyclic.html

Large diffs are not rendered by default.

352 changes: 352 additions & 0 deletions _modules/flamby/strategies/fed_avg.html

Large diffs are not rendered by default.

817 changes: 817 additions & 0 deletions _modules/flamby/strategies/fed_opt.html

Large diffs are not rendered by default.

269 changes: 269 additions & 0 deletions _modules/flamby/strategies/fed_prox.html

Large diffs are not rendered by default.

390 changes: 390 additions & 0 deletions _modules/flamby/strategies/scaffold.html

Large diffs are not rendered by default.

156 changes: 156 additions & 0 deletions _modules/index.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,156 @@
<!DOCTYPE html>
<html class="writer-html5" lang="en" data-content_root="../">
<head>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
<title>Overview: module code &mdash; FLamby 0.0.1 documentation</title>
<link rel="stylesheet" type="text/css" href="../_static/pygments.css?v=80d5e7a1" />
<link rel="stylesheet" type="text/css" href="../_static/css/theme.css?v=19f00094" />


<!--[if lt IE 9]>
<script src="../_static/js/html5shiv.min.js"></script>
<![endif]-->

<script src="../_static/jquery.js?v=5d32c60e"></script>
<script src="../_static/_sphinx_javascript_frameworks_compat.js?v=2cd50e6c"></script>
<script src="../_static/documentation_options.js?v=d45e8c67"></script>
<script src="../_static/doctools.js?v=9a2dae69"></script>
<script src="../_static/sphinx_highlight.js?v=dc90522c"></script>
<script src="../_static/js/theme.js"></script>
<link rel="index" title="Index" href="../genindex.html" />
<link rel="search" title="Search" href="../search.html" />
</head>

<body class="wy-body-for-nav">
<div class="wy-grid-for-nav">
<nav data-toggle="wy-nav-shift" class="wy-nav-side">
<div class="wy-side-scroll">
<div class="wy-side-nav-search" >



<a href="../index.html" class="icon icon-home">
FLamby
</a>
<div role="search">
<form id="rtd-search-form" class="wy-form" action="../search.html" method="get">
<input type="text" name="q" placeholder="Search docs" aria-label="Search docs" />
<input type="hidden" name="check_keywords" value="yes" />
<input type="hidden" name="area" value="default" />
</form>
</div>
</div><div class="wy-menu wy-menu-vertical" data-spy="affix" role="navigation" aria-label="Navigation menu">
<p class="caption" role="heading"><span class="caption-text">Installation</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../installation.html">Installation</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Getting Started Instructions</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../quickstart.html">Quickstart</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Datasets informations</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../fed_tcga_brca.html">Fed-TCGA-BRCA</a></li>
<li class="toctree-l1"><a class="reference internal" href="../fed_heart.html">Fed-Heart Disease</a></li>
<li class="toctree-l1"><a class="reference internal" href="../fed_ixi.html">Fed-IXI</a></li>
<li class="toctree-l1"><a class="reference internal" href="../fed_isic.html">Fed-ISIC 2019</a></li>
<li class="toctree-l1"><a class="reference internal" href="../fed_camelyon.html">Fed-Camelyon16</a></li>
<li class="toctree-l1"><a class="reference internal" href="../fed_lidc.html">Fed-LIDC-IDRI</a></li>
<li class="toctree-l1"><a class="reference internal" href="../fed_kits19.html">Fed-KiTS19</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Integration with FL-frameworks</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../substra.html">Using FLamby with Substra</a></li>
<li class="toctree-l1"><a class="reference internal" href="../fedbiomed.html">Using FLamby with Fed-BioMed</a></li>
<li class="toctree-l1"><a class="reference internal" href="../fedml.html">Using FLamby with FedML</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Reproducible results with docker</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../docker.html">Containerized execution</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Reproducing results</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../reproducing.html">Reproduction instructions</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">FAQ</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../faq.html">FAQ</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Extending FLamby</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../contributing.html">Extending FLamby</a></li>
<li class="toctree-l1"><a class="reference internal" href="../contributing.html#contribution-guidelines">Contribution Guidelines</a></li>
</ul>
<p class="caption" role="heading"><span class="caption-text">Code Documentation</span></p>
<ul>
<li class="toctree-l1"><a class="reference internal" href="../strategies.html">FL Strategies</a></li>
<li class="toctree-l1"><a class="reference internal" href="../datasets.html">Datasets</a></li>
</ul>

</div>
</div>
</nav>

<section data-toggle="wy-nav-shift" class="wy-nav-content-wrap"><nav class="wy-nav-top" aria-label="Mobile navigation menu" >
<i data-toggle="wy-nav-top" class="fa fa-bars"></i>
<a href="../index.html">FLamby</a>
</nav>

<div class="wy-nav-content">
<div class="rst-content">
<div role="navigation" aria-label="Page navigation">
<ul class="wy-breadcrumbs">
<li><a href="../index.html" class="icon icon-home" aria-label="Home"></a></li>
<li class="breadcrumb-item active">Overview: module code</li>
<li class="wy-breadcrumbs-aside">
</li>
</ul>
<hr/>
</div>
<div role="main" class="document" itemscope="itemscope" itemtype="http://schema.org/Article">
<div itemprop="articleBody">

<h1>All modules for which code is available</h1>
<ul><li><a href="flamby/datasets/fed_camelyon16/dataset.html">flamby.datasets.fed_camelyon16.dataset</a></li>
<li><a href="flamby/datasets/fed_heart_disease/dataset.html">flamby.datasets.fed_heart_disease.dataset</a></li>
<li><a href="flamby/datasets/fed_isic2019/dataset.html">flamby.datasets.fed_isic2019.dataset</a></li>
<li><a href="flamby/datasets/fed_ixi/dataset.html">flamby.datasets.fed_ixi.dataset</a></li>
<li><a href="flamby/datasets/fed_kits19/dataset.html">flamby.datasets.fed_kits19.dataset</a></li>
<li><a href="flamby/datasets/fed_lidc_idri/dataset.html">flamby.datasets.fed_lidc_idri.dataset</a></li>
<li><a href="flamby/datasets/fed_tcga_brca/dataset.html">flamby.datasets.fed_tcga_brca.dataset</a></li>
<li><a href="flamby/strategies/cyclic.html">flamby.strategies.cyclic</a></li>
<li><a href="flamby/strategies/fed_avg.html">flamby.strategies.fed_avg</a></li>
<li><a href="flamby/strategies/fed_opt.html">flamby.strategies.fed_opt</a></li>
<li><a href="flamby/strategies/fed_prox.html">flamby.strategies.fed_prox</a></li>
<li><a href="flamby/strategies/scaffold.html">flamby.strategies.scaffold</a></li>
</ul>

</div>
</div>
<footer>

<hr/>

<div role="contentinfo">
<p>&#169; Copyright 2022, Collaboration.</p>
</div>

Built with <a href="https://www.sphinx-doc.org/">Sphinx</a> using a
<a href="https://github.com/readthedocs/sphinx_rtd_theme">theme</a>
provided by <a href="https://readthedocs.org">Read the Docs</a>.


</footer>
</div>
</div>
</section>
</div>
<script>
jQuery(function () {
SphinxRtdTheme.Navigation.enable(true);
});
</script>

</body>
</html>
54 changes: 54 additions & 0 deletions _sources/contributing.rst.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
Extending FLamby
----------------

FLamby is a living project and contributions by the FL community are
welcome.

If you would like to add another cross-silo dataset **with natural
splits**, please fork the repository and do a Pull-Request following the
guidelines described below.

Similarly, you can propose pull requests introducing novel training
algorithms or models.

Contribution Guidelines
-----------------------

After installing the package in dev mode
(``pip install -e .[all_extra]``) You should also initialize
``pre-commit`` by running:

::

pre-commit install

The ``pre-commit`` tool will automatically run
`black <https://github.com/psf/black>`__ and
`isort <https://github.com/PyCQA/isort>`__ and check
`flake8 <https://flake8.pycqa.org/en/latest/>`__ compatibility. Which
will format the code automatically making the code more homogeneous and
helping catching typos and errors.

Looking and or commenting the open issues is a good way to start. Once
you have found a way to contribute the next steps are:

- Following the installation instructions (with -e and all_extra)
- Installing pre-commit by running: ``pre-commit install`` at the root of the repository
- Creating a new branch following the convention name\_contributor/short\_explicit\_name-wpi:
``git checkout -b name_contributor/short_explicit_name-wpi``
- Potentially pushing the branch to origin with :
``git push origin name_contributor/short_explicit_name-wpi``
- Working on the branch locally by making commits frequently:
``git commit -m "explicit description of the commit's content"``
- Once the branch is ready or after considering you have made significant
progresses opening a Pull Request using Github interface, selecting your
branch as a source and the target to be the main branch and creating the
PR **in draft mode** after having made **a detailed description of the
content of the PR** and potentially linking to related issues.
- Rebasing the branch onto main by doing ``git fetch origin`` and
``git rebase origin/main``, solving potential conflicts adding the
resolved files ``git add myfile.py`` then continuing with
``git rebase --continue`` until the rebase is complete. Then pushing the
branch to origin with ``git push origin --force-with-lease``.
- Waiting for reviews then commiting and pushing changes to comply with the reviewer's requests
- Once the PR is approved click on the arrow on the right of the merge button to select rebase and click on it
55 changes: 55 additions & 0 deletions _sources/datasets.rst.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
Datasets
==========


Fed-ISIC2019
------------

.. autoclass:: flamby.datasets.fed_isic2019.FedIsic2019
:members:
:undoc-members:

Fed-Camelyon16
--------------

.. autoclass:: flamby.datasets.fed_camelyon16.FedCamelyon16
:members:
:undoc-members:

Fed-LIDC-IDRI
-------------

.. autoclass:: flamby.datasets.fed_lidc_idri.FedLidcIdri
:members:
:undoc-members:


Fed-TCGA_BRCA
-------------

.. autoclass:: flamby.datasets.fed_tcga_brca.FedTcgaBrca
:members:
:undoc-members:


Fed-Heart-Disease
-----------------

.. autoclass:: flamby.datasets.fed_heart_disease.FedHeartDisease
:members:
:undoc-members:

Fed-IXITiny
-----------------

.. autoclass:: flamby.datasets.fed_ixi.FedIXITiny
:members:
:undoc-members:

Fed-Kits19
-----------------

.. autoclass:: flamby.datasets.fed_kits19.FedKits19
:members:
:undoc-members:

34 changes: 34 additions & 0 deletions _sources/docker.rst.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
Containerized execution
=======================

A good step towards float-perfect reproducibility in your future
benchmarks is to use docker. We give a base docker image and examples
containing dataset download and benchmarking. For
:any:`fed_heart`,
``cd`` to the flamby dockers folder, replace ``myusername`` and
``mypassword`` with your git credentials (OAuth token) in the command
below and run:

::

docker build -t flamby-heart -f Dockerfile.base --build-arg DATASET_PREFIX="heart" --build-arg GIT_USER="myusername" --build-arg GIT_PWD="mypassword" .
docker build -t flamby-heart-benchmark -f Dockerfile.heart .
docker run -it flamby-heart-benchmark

If you are convinced you will use many datasets with docker, build the
base image using ``all_extra`` option for flamby's install, you will be
able to reuse it for all datasets with multi-stage build:

::

docker build -t flamby-all -f Dockerfile.base --build-arg DATASET_PREFIX="all_extra" --build-arg GIT_USER="myusername" --build-arg GIT_PWD="mypassword" .
# modify Dockerfile.* line 1 to FROM flamby-all by replacing * with the dataset name of the dataset you are interested in
# Then run the following command replacing * similarly
#docker build -t flamby-* -f Dockerfile.* .
#docker run -it flamby-*-benchmark

Checkout ``Dockerfile.tcga``. Similar dockerfiles can be theoretically
easily built for the other datasets as well by replicating instructions
found in each dataset folder following the model of
``Dockerfile.heart``. Note that for bigger datasets execution can be
prohibitively slow and docker can run out of time/memory.
Loading

0 comments on commit debd160

Please sign in to comment.