Stack Overflow
Stack Overflow

Questions tagged [amazon-parallelcluster]

9 questions
1
vote
1 answer

How to run multi-node parallel job with AWS ParallelCluster in R

I am interested in running a multi-node parallel job with AWS ParallelCluster in R. Is there any useful documentation, guide or R package helping with it? As far as I understand library(paws) does not support that service. Thank you.
Telis
  • 311
  • 1
  • 9
1
vote
1 answer

AWS Parallel Cluster software installation

I am very new to generic HPC concepts, and recently I need to use AWS parallel cluster to conduct some large-scale parallel computation. I went through this tutorial and successfully build a cluster with the Slurm scheduler. I can successfully log…
beedrill
  • 344
  • 3
  • 17
0
votes
1 answer

Automatically cancel slurm jobs if there are insufficient instances on AWS ParallelCluster

I recently started playing around with AWS ParallelCluster and I noticed that when I submit a job that requires more instances than there are currently available in my region/AZ then the available instances are brought up and idle until all…
Omar Awile
  • 140
  • 1
  • 6
0
votes
1 answer

Does Terraform AWS provider allow to create AWS Parallel Cluster instances?

I have checked the latest Terraform AWS provider (4.64.0) docs here: https://registry.terraform.io/providers/hashicorp/aws/latest/docs But I can't find AWS Parallel Cluster related resources on the list in the docs for the latest version. I would…
Alexander Ites
  • 155
  • 2
  • 9
0
votes
1 answer

AWS ParallelCluster Graviton Rest API Connection Refused

I am trying to follow a tutorial using AWS ParallelCluster (AWS Research Workshop) and once I get CloudFormation up and running, I cannot connect to the cluster via the Rest API. I am using Slurm 21.08.8 and ParallelCluster 3.1.4. I am able to SSH…
Super Loud
  • 1
  • 1
0
votes
2 answers

AWS ParallelCluster compute nodes failing to start properly

I am a new parallelCluster 2.11 user and am having an issue where my compute nodes fail to spin up properly resulting in the eventual failure of pcluster create. Here is my config file: [aws] aws_region_name = us-east-1 [aliases] ssh = ssh…
notKnotTheory
  • 41
  • 3
0
votes
1 answer

How to use AWS sbatch (SLURM) inside docker on an EC2 instance?

I am trying to get OpenFOAM to run on an AWS EC2 cluster using AWS parallelCluster. One possibility is to compile OpenFOAM. Another is to use a docker container. I am trying to get the second option to work. However, I am running into trouble…
FenryrMKIII
  • 1,068
  • 1
  • 13
  • 30
0
votes
1 answer

How to stop a compute node with SLURM?

I am using SLURM on AWS to manage jobs as part of AWS parallelcluster. I have two questions : When using scancel *jobid* to cancel a job, the associated node(s) do not stop. How can I achieve that ? When starting, I made the mistake of not making…
FenryrMKIII
  • 1,068
  • 1
  • 13
  • 30
0
votes
1 answer

Access other account's s3 bucket in AWS Parallelcluster post-install script

I would like to be able to access (read) another account's S3 bucket in my AWS ParallelCluster post-install script. The bucket is shared with my account through the Bucket's ACL settings using my canonical Account ID. I can access the bucket from my…
Thomas Kainrad
  • 2,542
  • 21
  • 26