Selecting an Instance Type

General Information about Instance Type

Instance Type Overview

Naming

AWS naming of instance types is broken down here:

Choosing an Instance Type

Question

Focus on this

Does the software utilize multiple cores?

mem2_ssd1_v2_x16

How much memory does the software use (per core)?

mem2_ssd1_v2_x16

How much disk space is needed for the software (per core)?

mem2_ssd1_v2_x16

Always use version 2 of an instance type!

mem2_ssd1_v2_x16

Instance Classes and Cores

  • Each class (like mem1) is scaled so that each core in an instance has access to the same amount of memory/disk space:

  • Example: mem1_ssd1_v2_x2:

  • 4 Gb total memory / 2 cores =

  • 2 Gb / Core

  • Example: mem1_ssd1_v2_x8:

  • 16 Gb total memory / 8 cores =

  • 2 Gb / core

Choosing a Good Instance Type

  • Scale usage/instance type according to usage statistics and dataset size

  • If it doesn't utilize all resources

  • Use a smaller instance type

  • Runs out of memory, or is slow

  • Consider using a larger instance type

Multistep Workflows

  • Each stage of a workflow is run by a different set of workers

  • Each stage can be customized in terms of instance type

Last updated

Was this helpful?