Skip to content

Instantly share code, notes, and snippets.

@w601sxs

w601sxs/gist:f16d5d9b83429b419bc840cff82ab867

Created December 16, 2019 16:22
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save w601sxs/f16d5d9b83429b419bc840cff82ab867 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save w601sxs/f16d5d9b83429b419bc840cff82ab867 to your computer and use it in GitHub Desktop.
Download ZIP
Dask distributed dockerfile
Raw
gistfile1.txt
FROM continuumio/miniconda3:4.3.14
# Dumb init
RUN wget -O /usr/local/bin/dumb-init https://github.com/Yelp/dumb-init/releases/download/v1.2.0/dumb-init_1.2.0_amd64
RUN chmod +x /usr/local/bin/dumb-init
RUN conda update conda && conda install "conda=4.4.7"
RUN conda install --yes \
python-blosc \
cytoolz \
dask \
distributed \
nomkl \
numpy \
pandas \
s3fs \
&& conda clean -tipsy
RUN pip install modin[dask]
RUN export MODIN_ENGINE=dask
COPY prepare.sh /usr/bin/prepare.sh
RUN chmod +x /usr/bin/prepare.sh
RUN mkdir /opt/app /etc/dask
COPY dask.yaml /etc/dask/
ENTRYPOINT ["/usr/local/bin/dumb-init", "/usr/bin/prepare.sh"]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment