​​​🕘​ Meeting notes: Machine Learning WG

​​June 1, 2020

​​​@Lindsey H​
​​​@Ryan A​
​​​@Stephan R​
​​​@David G​
​​​@Noah B​
​​​@Tom​
​​​@Joe H​ 
​​@Jeffrey Sadler
​​

​​Agenda

  • ​​Round
  • ​​Blog post
  • ​​rechunking-reshaping data
  • ​​file format
  • ​​dask-ml’s blockwise ensemble methods.
​​

​​Rounds

  • ​​Noah
  • ​​Data Engineering stuff, Apache Beam pipelines, kubernetes stuff
  • ​​Drafted a blogpost
  • ​​Lindsey
  • ​​Looking for postdoc to join Jupyter meets earth group (on Pangeo discourse)
  • ​​Ryan
  • ​​Student making progress on surface currents project again. Could use a GPU on the cloud.
  • ​​Stephan
  • ​​Working on weatherbench dataset, building models.
  • ​​Hitting RAM limits (700 GB). Looking into converting the problem (possibly TFRecords)
  • ​​David
  • ​​Management, hiring / onboarding data scientists.
  • ​​Prepping for AI for earth systems summer school. All virtual, webinars, hackathon.
  • ​​NN emulators fortran-neural network interface
  • ​​Tom
​​
  • ​​Joe
  • ​​Jeff
  • ​​pangeo gpu article. attached gpu to notebooks node for deep learning.
  • ​​snakemake workflow for hyperparameter search

​​Agenda

  • ​​Reproducibility
  • ​​docker image to start jupyter lab session