Analyze data or do compute intensive simulations

UITS Research Technologies provides and manages supercomputing systems designed specifically to be able to handle research related workflows such as data analysis and simulations that would be too resource intensive or time consuming to run on standard workstations. Your code may need to be optimized and/or parallelized to fully take advantage of the performance offered by supercomputing environments. To request programming support for your research project, contact the Research Applications and Deep Learning group.

Prerequisites

  1. Secure your own environment
  2. Decide which supercomputing system best fits your needs. For most workloads. (e.g. statistics/SAS), Carbonate is the supercomputer to use.

Directions

  1. Request an account on the system you intend to use.
  2. Access the system. Most systems require access via SSH, for Carbonate you also have the option to access from a web browser via Research Desktop (RED).
  3. Transfer the data from your workstation to the appropriate location.
  4. Perform data analysis using the tools available on the system.
    1. To find out which tools or software are available on a given supercomputer, use the "HPC Software" tool on HPC Everywhere.
    2. Use the Modules commands to find and manage software packages installed on the system.
    3. To learn more about how to use the tools and software on the IU supercomputers, see this KB document.
  5. Encrypt your data while it is not being worked on to help ensure it's confidentiality.
  6. Once your analysis is complete, transfer the data back to your workstation as necessary.

Additional Resources

We want your feedback

Please email securemyresearch@iu.edu to report errors/omissions and send critiques, suggestions for improvements, new use cases/recipes, or any other positive or negative feedback you might have.  It will be your contribution to the Cookbook and appreciated by all who use it.