This is a hands-on workshop where participants will apply presented techniques to their own codes.
The workshop will cover:
Optimal Pinning processes for the AMD architecture
AMD Compilers and libraries
This will be an in-person workshop, held in Durham. Participants will use their normal DiRAC site.
The workshop will run over 3 days. Each day will normally start introducing a topic which is then followed by a lengthy practical session where participants have an opportunity to apply what was taught to their code. Support will be there from AMD and from DiRAC support teams. During the event, there will be feedback and Q&A sessions to help spread good practice and address any issues.
On the afternoon of the 3-days, teams will be given time to develop a presentation that will be presented by themselves at DiRAC day on the 8th of December at UCL.
The target audience are researchers who want to:
Optimising their code for today and tomorrow on AMD CPUs.
Get the most out of our new DiRAC-3 AMD systems.
Run their code efficiently to get the best performance.
Learn about and take advantage of the new AMD features and tools.
Build links with other research groups and AMDs technical team.
At least one member of a team needs good experience in a programming language. Also in-depth knowledge of your own codes. Technical support can be arranged if required.
This is a hands-on workshop where participants will use code snippets to illustrate the best approach to accessing the power of our new AMD ROME CPUs based at Durham & Leicester. This training will also be useful to anyone using the AMD CPUs on the GPU systems at Cambridge and Edinburgh.
The workshop will cover:
The ROME Microarchitecture & Memory channels
AMD Compilers and libraries
Hands-on examples spread throughout the day
The virtual workshop will be run on multiple DiRAC sites so you will be able to experience exactly what you need to do on the system you use.
Support will be there from AMD and the local technical support teams.
A shared slack channel will be available to ask questions, highlight any issues and share good practice between sites.
The target audience is researchers:
Those who are interested in building and running their code on our new DiRAC-3 AMD systems.
Those who want to run their code efficiently to get the best performance.
Those who want to take advantage of the new AMD features and tools.
Only basic experience of a language is required C/C++, or Python.
Science is undergoing a data explosion and the advent of Artificial Intelligence and Machine Learning techniques is revolutionizing the way scientists tackle their research. Simulations and observations now generate Petabytes of data and machine learning is providing novel and powerful methods for analysing those experimental datasets and extracting essential science in ways that have not been possible before.
The course provided a practical, and hands-on introduction to the concepts, methods, and toolkits for applying machine learning to fundamental scientific problems. Held virtually over five consecutive mornings, lectures, including worked examples to reinforce the concepts, and hands-on practical sessions were delivered. The practical sessions, where participants had access to dedicated GPU resources, were meant to ensure that participants learned to apply their newly learned skills on practical problems stemming from physics, astronomy and other domains. The course covered.
Conventional machine learning techniques (such as decision trees),
Neural and deep neural networks, the cornerstone of modern AI
Generative models to enable you to generate synthetic, yet realistic, datasets with labels, and
Debugging and RSE aspects of the machine learning
The course was provided by DiRAC in collaboration with STFC’s Scientific Machine Learning Research Group (SciML) in the Scientific Computing Department.
“I found the course to be the ideal mix between theory and practical examples. Very informative on how to use ML for cutting-edge science research questions.”
“This course was the perfect introduction to machine learning from a scientific perspective; instructors were enthusiastic and very helpful, and the lectures and materials were approachable for someone with no previous experience, while remaining detailed enough to be of practical use. I felt I gained a good overview of a range of important techniques and algorithms and will certainly apply the knowledge gained during my chemistry PhD.”
Places on the Machine Learning Techniques for Science course are allocated giving priority to individuals who are part of a DiRAC project. If you would like find out how to become a DiRAC user, please see our latest call for proposals.
Registration is now closed.
Follow us on Twitter @DiRAC_HPC for future ML course announcements.
At DiRAC, we believe one of our most important responsibilities to our user-base is to offer comprehensive training. The better trained our researcher cohort, the more efficiently we can use our HPC systems, thereby increasing our scientific productivity and generating more research from our existing systems. In addition we can deploy more bleeding-edge and innovative HPC technology in our services, increasing our capability and energy efficiency, and enabling calculations which would otherwise not be feasible.
On this page you can find information on the DiRAC Essentials Level Training and other External Opportunities that will be useful to our users and community.
The DiRAC Essentials Level Training (formerly the DiRAC Driving Licence), is a basic introduction to the principles of HPC and the tools needed to work on an HPC system. The course consists of seven modules covering everything from the Unix Environment to Good Network Practices and is presented as a series of links to external sources that we have selected for you. After working through the modules you will know the Essentials of how to work with, and get the best out of, DiRAC’s HPC systems.
The training is mandatory for those studying for advanced degrees, such as M.Sc. and Ph.D., and those employed as Post-Doctoral Research Assistants/Associates who have less than two years HPC experience. The Essentials Level culminates in a basic on-line test and the training material covers all aspects of HPC competency that are included.
Information on accessing the training and registering for a training account can be found here.
At DiRAC, we believe one of our most important responsibilities is to offer our community comprehensive training. We have a responsibility to make sure that our HPC resources are used as efficiently as possible and we have an even greater duty of care to make sure you are well trained in advanced IT techniques and are confident in using them.
Essentials Level Training Overview
The DiRAC Essentials Level Training (formerly the Driving Licence), is a basic introduction to the principles of HPC and the tools needed to work on an HPC system. Once you have completed the course you will be able to do more science of higher impact (and we hope you will have more fun as well!). And if we have a well-trained cohort we can invest in much more powerful equipment that is much closer to the bleeding edge and so allow you to generate the new high impact results that will let you and your group to be seen as leaders in your field.
It will also make you much more employable. Real programming and IT skills are making a big comeback both in Academia and Industry. We need to equip you with these skills to improve your career progression. In short, we are trying to create a virtuous circle that will benefit both you, your science and your group’s scientific reputation.
Essentials Level Content
The Essentials Training assumes a familiarity with desktop computers, but no programming, Linux or HPC experience is required. For our users who have a small amount of existing knowledge from undergraduate experience the material is intended to refresh prior knowledge and in some cases, fill in any gaps. We have seven generic modules and a final module 8 which covers efficiently compiling and running a job on each of our four DiRAC Resources.
The training material for all our modules is presented as a list of links to external sources. There is a vast amount of training material available on the internet, some of which is useful, some of which not so much (!) so we’ve gathered together in one place the links we think will be most helpful to you as you start to use HPC. We have tried to cover the material in both text and video format so there is some overlap, but after working through the modules you will know the Essentials of how to work with, and get the best out of, our HPC systems.
Accessing the Training
We ask all our users to register for an account to get access to our training portfolio. You will also have the option during registration to sign up for direct email alerts for appropriate courses and other training opportunities.
The 2021/22 test round opened on the 17th November 2021 and closed on the 28th February.
The Essentials Level training culminates in a short on-line test – the training material provided covers all aspects of HPC competency that are included in the test.
The Essentials Level Test is mandatory for those who are studying for advanced degrees, such as M.Sc. and Ph.D., and those employed as Post-Doctoral Research Assistants/Associates who have less than two years HPC experience.
The test is graded as follows:
Pass: 70% – the examinee completed the exam successfully
Conditional pass: 60-69% – the examinee did not complete the entire exam successfully, but it is believed they are capable of doing so. They will have three months to re-take the exam and pass.
No pass: 59% and below – the examinee was clearly unable to complete the exam on their own. They will be offered additional help by the Director.
If you have not taken/passed the test by the deadline we will contact you and your supervisor to discuss your case. At this point, we will be able to arrange further assistance for you so you can pass the test and continue to use DiRAC resources in your research. Failure to take this test may result in you account on all DiRAC facilities being suspended.
Following the test we will ask you to complete a small number of multiple-choice questions designed to assess how useful you found the training and offer you the option to give us feedback and suggestions. If you took the training we encourage you to take the survey so we can improve the content for future generations. The survey only takes a couple of minutes to complete.
We use the information from the survey to help us better understand the needs of our user community and to identify areas where we can improve and more closely target our training offering to those needs. Our aim is to continually develop and innovate DiRAC’s training offering as those needs evolve.
The information you give will not be shared with anyone outside our small training team and we will never share your personal contact information with any external organisation. Your responses to the survey are fully anonymised before any analysis is undertaken.