Deployments — Pangeo documentation

Pangeo provided Cloud Deployments¶

Test, development and Binder hubs¶

Those are deployments managed by Pangeo collaborators and open to everyone, usually by Pangeo github organization public membership for the standard Jupyterhubs, and with no restriction for Binder hubs. All of them rely on dask-kubernetes for (auto)scaling.

hub.pangeo.io Description: Flagship Pangeo JupyterHub server for scalable interactive data analysis running on Google Cloud Platform Cloud provider: Google Cloud Platform Jupyter Deployment: JupyterHub Access: Need a github account part of the Pangeo organization with affiliaton set to public
example.pangeo.io Description: Pangeo demo and model for domain specific deployments Cloud provider: Google Cloud Platform Jupyter Deployment: JupyterHub Access: Need a github account part of the Pangeo organization with affiliaton set to public
staging.pangeo.io Description: Validation and integration environment for Pangeo platform Cloud provider: Google Cloud Platform Jupyter Deployment: JupyterHub Access: Used by Pangeo core developers, need a github account and specific authorization
dev.pangeo.io Description: Develoment environment for Pangeo platform, highly unstable Cloud provider: Google Cloud Platform Jupyter Deployment: JupyterHub Access: Used by Pangeo core developers, need a github account and specific authorization
pangeo.pydata.org Description: Former flagship Pangeo JupyterHub server for scalable interactive data analysis running on Google Cloud Platform Cloud provider: Google Cloud Platform Jupyter Deployment: JupyterHub Access: Soon being closed
binder.pangeo.io Description: Flagship Pangeo BinderHub deployment running on Google Cloud Platform Cloud provider: Google Cloud Platform Jupyter Deployment: BinderHub Access: Anyone, look at http://binder.pangeo.io/v2/gh/pangeo-data/pangeo-example-notebooks/master
staging.binder.pangeo.io Description: Developement and integration Pangeo BinderHub deployment running on Google Cloud Platform Cloud provider: Google Cloud Platform Jupyter Deployment: BinderHub Access: Used by Pangeo core developers

Domain specific deployments¶

Those are designed specifically for domain use cases and communities, allowing to customize both infrastructure and software environment toward a particular need. If you’re interested in one of this deployment, please contact one of its responsible.

All deployments here use standard Jupyterhub and dask-kubernetes.

atmos.pangeo.io Description: Pangeo platform for developing atmospheric use cases Cloud provider: Google Cloud Platform Access: Ask @charlesbluca and @biasuttimic on https://github.com/pangeo-data/atmos.pangeo.io-deploy/
hydroshare.pangeo.io Description: Pangeo platform for developing hydrologic use cases Cloud provider: Google Cloud Platform Access: Ask @jhamman or @bartnijssen
polar.pangeo.io Description: Pangeo platform for developing polar use cases Cloud provider: Google Cloud Platform Access: Ask @NicWayand on https://github.com/NicWayand/polar.pangeo.io-deploy
astro.pangeo.io Description: Pangeo platform for developing astronomic use cases Cloud provider: Google Cloud Platform Access: Ask @SimonKrughoff and @wtbarnes on https://github.com/pangeo-data/astro.pangeo.io-deploy
ocean.pangeo.io Description: Pangeo platform for developing ocean use cases Cloud provider: Google Cloud Platform Access: Ask @raphaeldussin on https://github.com/raphaeldussin/example.pangeo.io-deploy

Other Cloud deployments¶

Lamont Real-Time Earth Pangeo Cluster Description: JupyterHub server used Earth/ocean science research Cloud provider: Microsoft Azure Cloud Dask Deployment: dask-kubernetes Jupyter Deployment: JupyterHub
RGH-Hub Description: JupyterHub server used for interactive data analysis by Rhodium Group staff for climate research and analysis Cloud provider: Google Cloud Platform Dask Deployment: dask-kubernetes Jupyter Deployment: Jupyterhub
Met Office Informatics Lab Description: A prototype cluster for the Met Office. Cloud provider: Amazon Web Services Dask Deployment: dask-kubernetes Jupyter Deployment: Jupyterhub
Dask Tutorial Cluster Description: JupyterHub server used for dask tutorials Cloud provider: Google Cloud Platform Dask Deployment: dask-kubernetes Jupyter Deployment: Jupyterhub

High Performance Computing Deployments¶

NCAR Cheyenne Cluster Description: Large HPC cluster (5.34-petaflops) running at the National Center for Atmospheric Research Platform: HPC Dask Deployment: dask-jobqueue and dask-mpi Jupyter Deployment: Single user notebook servers
NASA Pleiades Cluster Description: Large HPC cluster (7.24-petaflops) running at the NASA High-End Computing Capability Project Platform: HPC Dask Deployment: dask-mpi with custom launch scripts Jupyter Deployment: Single user notebook servers
Columbia Habanero Cluster Description: Research cluster at Columbia University Platform: HPC Dask Deployment: dask-mpi with custom launch scripts Jupyter Deployment: Single user notebook servers
CNES HAL Description: CNES research and productioncluster Platform: HPC Dask Deployment: dask-jobqueue and dask-mpi Jupyter Deployment: Jupyterhub server on a VM connected to PBSPro
USGS Yeti Description: USGS's Advanced Research Computing cluster Platform: HPC Dask Deployment: dask-jobqueue and custom launch scripts Jupyter Deployment: Single user notebook servers
UW Hyak Description: The University of Washington's shared supercomputing cluster. Platform: HPC Dask Deployment: dask-mpi and custom launch scripts Jupyter Deployment: Single user notebook servers
DOD HPC Systems at AFRL and ERDC Description: Unclassified Department of Defense High Performance Computing Modernization Program Supercomputing Clusters (Thunder, Topaz, Utility Servers, etc.) Platform: HPC Dask Deployment: dask-jobqueue, dask-mpi, and custom launch scripts Jupyter Deployment: Single user notebook servers
GFDL Post-processing and Analysis Cluster Description: HPC cluster running at the NOAA Geophyiscal Fluid Dynamics Laboratory Platform: HPC Dask Deployment: dask-jobqueue with a custom PBSCluster subclass Jupyter Deployment: Single user notebook servers
Princeton Tiger Cluster Description: Research computing cluster running at Princeton University Platform: HPC Dask Deployment: dask-jobqueue Jupyter Deployment: Single user notebook servers
Pawsey Supercomputing Centre Description: Western Australian Supercomputing Centre Platform: HPC Dask Deployment: dask-jobqueue Jupyter Deployment: Single user notebook servers
Pegasus Supercomputer Description: University of Miami Supercomputer Platform: HPC Dask Deployment: dask-jobqueue Jupyter Deployment: Single user notebook servers