Skip to main content
MathOverflow

Return to Answer

deleted 21 characters in body
Source Link
Sridhar Ramesh
Sridhar Ramesh
  • 5.8k
  • 1
  • 34
  • 45

I would guess youYou are hitting overflow with 32 bit "integers" at around the point where things stop off in your calculations. In other words, your graph stops being accurate because you are using machine numeric types which only store 32 bits, not the full number.

I would guess you are hitting overflow with 32 bit "integers" at around the point where things stop off in your calculations. In other words, your graph stops being accurate because you are using machine numeric types which only store 32 bits, not the full number.

You are hitting overflow with 32 bit "integers" at the point where things stop off in your calculations. In other words, your graph stops being accurate because you are using machine numeric types which only store 32 bits, not the full number.

Source Link
Sridhar Ramesh
Sridhar Ramesh
  • 5.8k
  • 1
  • 34
  • 45

I would guess you are hitting overflow with 32 bit "integers" at around the point where things stop off in your calculations. In other words, your graph stops being accurate because you are using machine numeric types which only store 32 bits, not the full number.