Skip to content

Course home

x
Sign up
x

Why computers round real numbers

Why computers round real numbers

Computers have a finite number of bits, so they can store only a finite number of bit patterns. A real number is exact only if its binary expansion fits into the available bits.

Rounding errors, range, precision and normalisation Lesson

  1. A Level
  2. /Computer Science
  3. /Rounding errors, range, precision and normalisation

Step-by-step lessons on AQA A Level Computer Science Rounding errors, range, precision and normalisation. Each one builds up to exam-style questions.

Lessons