{"id":404,"date":"2017-06-13T15:55:54","date_gmt":"2017-06-13T05:55:54","guid":{"rendered":"http:\/\/cosima.org.au\/?p=404"},"modified":"2017-06-13T16:06:24","modified_gmt":"2017-06-13T06:06:24","slug":"technical-working-group-meeting-june-2017","status":"publish","type":"post","link":"https:\/\/cosima.org.au\/index.php\/2017\/06\/13\/technical-working-group-meeting-june-2017\/","title":{"rendered":"Technical Working Group Meeting, June 2017"},"content":{"rendered":"<h2>Minutes<\/h2>\n<p>Date: 13th June 2017<br \/>\nAttendees:<\/p>\n<ul>\n<li>Marshall Ward (NCI, Chair)<\/li>\n<li>Aidan Heerdegen (ARCCSS ANU)<\/li>\n<li>Scott Wales (ARCCSS Melbourne Uni)<\/li>\n<li>Nicholas Hannah (ARCCSS\/Double Precision)<\/li>\n<li>Russ Fiedler and Matt Chamberlain (CSIRO Hobart)<\/li>\n<li>Justin Freeman (BoM)<\/li>\n<li>Peter Dobrohotoff and Roger Bodman (CSIRO Aspendale)<\/li>\n<\/ul>\n<h3>COSIMA Workshop<\/h3>\n<ul>\n<li>\u00a0Marshall:\u00a0Good meeting. A couple of main messages:\n<ol>\n<li>Must have convergence of source code<\/li>\n<li>System for efficient sharing of model configurations<\/li>\n<\/ol>\n<\/li>\n<li>First item we are well on the way to achieve. Second has never been addressed.<\/li>\n<\/ul>\n<h3>Configuration Sharing<\/h3>\n<ul>\n<li>Marshall:\u00a0Should focus our energies on configuration sharing.<\/li>\n<li>Marshall: having configurations in OceansAus is close to what we want?<\/li>\n<li>Currently when using payu configs are saved\u00a0into local git repos, free floating. This could work for everyone. Should gather config files for runs.<\/li>\n<li>Aidan: can have a GitHub organisation and push configurations there, or push to own GitHub accounts and tag repositories to allow search and discovery. Use OceansAus or dedicated GitHub organisation for more canonical configurations.<\/li>\n<li>Peter agreed it is ok to have many thousands of configurations. Scott agreed as long as there is a canonical version that is easily identifiable for others to fork from.<\/li>\n<li>Nic felt that unless there was a good pay off most\u00a0individuals would not make the effort to push their configurations up to shared spaces, or make the visible to others, but there is a pay-off for everyone if configurations are shared.<\/li>\n<li>Nic:\u00a0How do create a searchable index or database for others to find the stuff? May be bigger problem than storing data.<\/li>\n<li>\n<div>Marshall: Payu users can be forced to do it. Tracking history not seem such a big deal but a pay off for users down the track<\/div>\n<\/li>\n<li>\n<div>Pete: if someone wants to use my config I give them my config and people branch off that. rosie-graph will show relationships between them.<\/div>\n<\/li>\n<li>\n<div>Marshall: rose solves a lot of these problems already. We don\u2019t benefit from that. Do we need to just use rose or emulate what it does best?<\/div>\n<\/li>\n<li>\n<div>Scott: rose setup: metadata file in each repo branch, hook within repo which reads meta data file and adds to database. Currently there is not a lot of meta data in most branches.<\/div>\n<\/li>\n<li>\n<div>Justin: does rose use git? Scott: should be back-end agnostic. Nic: possible solution? Use GitHub for configs, but use rose DB to share and index configurations?<\/div>\n<\/li>\n<li>\n<div>Marshall: should we draft a plan?<\/div>\n<\/li>\n<li>\n<div>Nic: Just try with rose? Gives us DB which is searchable and viewable. Doesn\u2019t stop anyone from working in the way we want?<\/div>\n<\/li>\n<li>\n<div>Marshall: Do we need accessdev to do this? Scott: I think it is a just a sqlite DB, so can just be on filesystem. Hooks in GitHub repo won\u2019t work the same way to update it however.<\/div>\n<\/li>\n<li>\n<div>Marshall: just start with something searchable? Nic: yeah, see what people are running.<\/div>\n<\/li>\n<li>\n<div>Scott: Just start with a simple list. Nic: would want a GitHub repo and commit hash in meta data as a minimum.<\/div>\n<\/li>\n<li>\n<div>Justin: make notes about what we think is possible. Common set of functionality will guide us. Rose sounds good, but may be too large a solution? Want something that won\u2019t get in my way and lightweight. Don\u2019t know too much about rose.\u00a0Everyone agrees this is a good idea.<\/div>\n<\/li>\n<li>\n<div>Scott: can just have a list of experiments. Don\u2019t need the editor. Will send around link so Justin and others can take a look.<\/div>\n<\/li>\n<li>\n<div>Marshall: really need a bunch of git repos and a way to organise them. Justin: metadata would be a great, to find things without bothering others.<\/div>\n<\/li>\n<li>\n<div>Marshall: how do we share input data?<\/div>\n<\/li>\n<li>\n<div>Justin: share through RDS? Jingbo working on this.<\/div>\n<\/li>\n<li>\n<div>Nic: Justin said all our data sources should be pointing to URLs. Great idea! Never have to care about where data is coming from. Input through THREDDS URIs. Marshall: too ambitious? If you\u2019re using netCDF interface, the library takes care of network. Should all happen under netCDF. Model thinks it is a file.<\/div>\n<\/li>\n<li>\n<div>Aidan: slower? Nic: might not be slower?<\/div>\n<\/li>\n<\/ul>\n<h3>COSIMA\u00a0Models<\/h3>\n<ul>\n<li>\n<div>Marshall: talking with Peter and Roger at optimisation meetings, seem to be bit-reproducibility issues with CM2. Has Nic ever looked at bit repro in OM2?<\/div>\n<\/li>\n<li>\n<div>Nic: have checksums, and make sure they don\u2019t change with code changes under same layout etc. haven\u2019t noticed things aren\u2019t reproducible in a typical short run. As soon as processor layout changes you\u2019ll run into issues.<\/div>\n<\/li>\n<li>\n<div>Peter: if run model 3 months and then 1 month at a time, get different answers. A few degrees over a few months. Restarts are not reproducible. CMIP5 worked ok. Now doesn\u2019t work. Maybe need to check that the ice dumping ok.<\/div>\n<\/li>\n<li>\n<div>Marshall: have faith in MOM5 core. Issues with flux exchange reproducibility. Anyone got issues with that?<\/div>\n<\/li>\n<li>\n<div>Russ: Fabio Dias and Russ have been working on an energy leakage issue. MOM-SIS conserves, MOM-CICE has small leakage. Is a computational issue. ASCII diagnostics don\u2019t close. Should close 10^-12 W\/m2, only 10^-6 W\/m2.<\/div>\n<\/li>\n<li>\n<div>Marshall: Has CM2 been subjected to same scrutiny for flux exchange. How far has Dave Bi got?<\/div>\n<\/li>\n<li>\n<div>Peter: does UM have this issue? Scott: bit repro is heavily tested. Processor decomp and run length shouldn\u2019t be an issue.<\/div>\n<\/li>\n<li>\n<div>Peter: maybe CICE is\u00a0a bit more vulnerable? Nic: if someone hasn\u2019t made an effort to make it reproducible, odds on that is isn\u2019t. As far as Nic knows no checking has been done on the ACCESS-CM\/OM specific boundary code. Suspicious this might be the issue.<\/div>\n<\/li>\n<li>\n<div>Roger: reproducibility tends to be over the higher latitudes and higher altitudes. A couple of degrees over a few months.<\/div>\n<\/li>\n<li>\n<div>Marshall: MOM5 is not reproducible over processor layout changes north of tripole. There is an expensive operation in the MOM5 flux exchange that isn\u2019t turned on by default. Scott: MPI reduce is not generally reproducible unless special steps taken.<\/div>\n<\/li>\n<li>\n<div>Nic: repro needs to be tested with correct compiler flags turned on. Normally optimised code will not reproduce. Roger did this, but will double check this for CICE. Should have fpmodel precise across all 3 models.<\/div>\n<\/li>\n<li>\n<div>Russ: fixed ice salinity issue that Nic had heard of before from Dave Bi. Was a default namelist option that people don\u2019t often change.\u00a0Nic: will forward the conversation to Roger.<\/div>\n<\/li>\n<li>\n<div>Marshall: if we routinely shared configs this would not be an issue.<\/div>\n<div><\/div>\n<\/li>\n<\/ul>\n<h3>Actions<\/h3>\n<p>New:<\/p>\n<ul>\n<li>Create document outlining options for configuration sharing (?)<\/li>\n<\/ul>\n<p>Existing:<\/p>\n<ul>\n<li>Nic to present MATM code re-write proposal to TWG for feedback before sign-off. Will then be presented to Andy Hogg for approval.<\/li>\n<li>Nic create a discussion document (on COSIMA?) to document current approaches and strategies for future<\/li>\n<li>Move FMS to submodule of MOM5 github repo (Marshall). Liase with Nic on implementation?<\/li>\n<li>Test Nic&#8217;s access-om model config on OceansAus (All)<\/li>\n<li>Work up test cases to cover the nudging code (Justin, Mirko) and supply them to Nic.<\/li>\n<li>Add new test cases to Jenkins test suite (Nic).<\/li>\n<li>Start a new google doc about coupler issues and MATM (Marshall)<\/li>\n<li>Ask Dale Roberts about effects of OpenMP for Roger (Marshall)<\/li>\n<li>Make a proper plan for model release \u2014 discuss at COSIMA meeting. Ask students\/researchers what they need to get started with a model (Marshall and TWG)<\/li>\n<li>Blog post around issues with high core count jobs and mxm mtl (Nic)<\/li>\n<li>Do longer runs with\u00a0Nic&#8217;s 1 deg and 0.25 deg ACCESS-OM2-JRA55 configs (Andy and Aidan)<\/li>\n<li>Try repeat year forcing with Nic&#8217;s configurations (Nic and Andy)<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Minutes Date: 13th June 2017 Attendees: Marshall Ward (NCI, Chair) Aidan Heerdegen (ARCCSS ANU) Scott Wales (ARCCSS Melbourne Uni) Nicholas Hannah (ARCCSS\/Double Precision) Russ Fiedler and Matt Chamberlain (CSIRO Hobart) Justin Freeman (BoM) Peter Dobrohotoff and Roger Bodman (CSIRO Aspendale) COSIMA Workshop \u00a0Marshall:\u00a0Good meeting. A couple of main messages: Must have convergence of source code&hellip;<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[4,3],"_links":{"self":[{"href":"https:\/\/cosima.org.au\/index.php\/wp-json\/wp\/v2\/posts\/404"}],"collection":[{"href":"https:\/\/cosima.org.au\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cosima.org.au\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cosima.org.au\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/cosima.org.au\/index.php\/wp-json\/wp\/v2\/comments?post=404"}],"version-history":[{"count":3,"href":"https:\/\/cosima.org.au\/index.php\/wp-json\/wp\/v2\/posts\/404\/revisions"}],"predecessor-version":[{"id":407,"href":"https:\/\/cosima.org.au\/index.php\/wp-json\/wp\/v2\/posts\/404\/revisions\/407"}],"wp:attachment":[{"href":"https:\/\/cosima.org.au\/index.php\/wp-json\/wp\/v2\/media?parent=404"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cosima.org.au\/index.php\/wp-json\/wp\/v2\/categories?post=404"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cosima.org.au\/index.php\/wp-json\/wp\/v2\/tags?post=404"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}