Skip to main content
IT Service Status
IT Service Status

Quest High-Performance Computing Cluster

Quest is Northwestern’s high-performance computing cluster. It is housed in the University Data Center. Quest supports a variety of computational workflows to align with the varied needs of researchers in different domains.

High-Performance Computing (HPC)

In total, Quest comprises over 1200 nodes (80,000 cores) running Red Hat Enterprise Linux and interconnected with an InfiniBand HDR network. The newest Quest nodes have Intel Emerald Rapids Xeon Platinum processors. It uses the Slurm job management system to support over 3000 researchers using Quest’s compute nodes each year.

GPU Computing

Quest includes 200 NVIDIA GPU cards (A100's and H100's) with both SXM and PCIe architectures that are available to General Access users.

Access Via a Web Browser

Quest users can access files and submit jobs or work in interactive computing sessions through a web browser via:

  • Quest Analytics Nodes - provides RStudio, Jupyter, and SAS Studio for interactive analysis workflows.
  • Quest OnDemand - enables users to access any software or computing resources on Quest by submitting batch or interactive computing jobs.

Quest has a General Parallel File System (GPFS) backed by a 12 PB capacity IBM Elastic Storage Server (ESS) system to store research data. It also includes a flash-tier scratch space for temporary data storage, and each user has an 80 GB home directory for storing code files and applications.

Please note that Quest is not approved for use with sensitive or restricted data; refer to the Quest Data Security Guidance for details.

Additional details about Quest’s architecture can be found in the Quest technical specifications.

Please include the Acknowledgment of Use when publishing research done using Quest.

Getting Access to Quest

University-Supported General Access

Northwestern provides compute and data storage resources on Quest for use by the entire Northwestern research community at no cost to researchers and for classroom use. Approximately half of Quest’s CPU and most of Quest’s GPU nodes are reserved for General Access. Short-running jobs under 4 hours from General Access users can also utilize open capacity on reserved, Priority Access resources. Quest General Access users can also use the Quest Analytics Nodes and Quest OnDemand for interactive work.

Access to Quest is granted through requests for storage and compute resources. General Access resources provide a set amount of storage or a certain priority level for using compute resources. Compute load on Quest is managed through a fair share mechanism that balances utilization of General Access resources when demand exceeds availability. General Access resources are valid for one year and can be renewed. Compute and storage resources can be shared with other Northwestern researchers who work on the same research project or need access to the same files.

Learn More and Request a Quest Resource

Group-Supported Resources

Specialized or dedicated resources are available to research centers, departments, or schools who have invested in resources on Quest to support their members.

Genomics Compute Cluster (GCC)

The Genomics Compute Cluster (GCC) is funded by the Feinberg School of Medicine and Weinberg College of Arts and Sciences. The GCC provides compute nodes, GPU nodes, high memory nodes, and scratch storage space for Northwestern researchers from any school or center who are engaged in genomics research.

Kellogg Linux Cluster (KLC)

The Kellogg Linux Cluster (KLC) provides researchers access to multiple high-memory nodes designed for interactive workflows, along with dedicated storage. Researchers using the KLC can also apply for a general access allocation to utilize other Quest resources.

Pilot Computer Science Enclave

The Computer Science Enclave provides priority access to GPU and CPU resources along with shared storage on Quest to support the research needs of the Computer Science Department in the McCormick School of Engineering at Northwestern.

Priority Access Resources

Researchers or research groups requiring compute or storage beyond General Access can purchase Priority Access to compute resources on Quest.

Storage

Researchers can purchase additional Quest storage. Purchased Quest storage does not have backups nor snapshots, and files that are deleted cannot be recovered. Large storage requests are subject to availability. Quest storage is intended only for actively used data on Quest. Therefore, users must be utilizing the storage for high-performance computing purposes to purchase Quest storage.

Compute Resources

Priority Access compute resources are available by purchasing nodes. Purchasing nodes on Quest has many advantages over running stand-alone systems. The nodes are administered by the professionals, including system updates, patches, account management, and troubleshooting, in a facility configured for high-performance computing. The cost of supporting infrastructure for the nodes, such as networking, cooling, and access to Quest storage system is covered by the University.

Standard compute nodes, high-memory nodes, and GPU nodes are all available for purchase. Full node details are available in Purchasing Resources on Quest. Contact quest-help@northwestern.edu with any questions.

Getting Started with Quest

After setting up or getting access to Quest resources, there are tutorials, videos, consultations, and workshops to help you get started using Quest.

Documentation and Tutorials

Extensive written documentation and tutorials are available for Quest. The Quest User Guide will help you get started transferring files, submitting jobs, and troubleshooting any issues you encounter.

Orientation Sessions and Workshops

The Research Computing and Data Services team holds several Quest orientation sessions and workshops on other topics each year. There are also monthly orientation sessions for the Genomics Compute cluster. See the workshop schedule for virtual and in-person options.

Video Tutorials

If you cannot attend a workshop, the Introduction to Quest video tutorial, will help you get started, especially if you are new to using an HPC cluster.

Consultations

Individual or small group consultations are also available. Schedule a consultation with a computational specialist by filling out the consultation request form.

Ongoing Support

You can always reach the team of computational specialists supporting Quest by submitting an IT help ticket to quest-help@northwestern.edu.

Access the Quest User Guide