KODE | Academy - Floating Point Precision Loss - KODE|Academy Forums | KODE

Root

guild

Forums

Welcome, Guest
Please Login or Register. Lost Password?

KODE|Academy Forums

General Programming

C++

Floating Point Precision Loss

(1 viewing) (1) Guest

Page: 1

TOPIC: Floating Point Precision Loss

Forum Tools

#228

Floating Point Precision Loss 2 Months, 1 Week ago

Karma: 5

2.34x10²² = 2340000000000000000000.0

Add one to it:
2340000000000000000000.0 + 1.0 = 2340000000000000000001.0

Subtract the Original Number:
2340000000000000000001.0 - 2340000000000000000000.0 = 0.000000000000000000001

Since floating points can only represent 6 significant figures the result is
interpreted as:

0.000000 = 0

support.microsoft.com/kb/145889

en.wikipedia.org/wiki/Loss_of_significance

Manuj

Administrator

Posts: 75

Last Edit: 2010/06/23 03:56 By Manuj.

The administrator has disabled public write access.

"There is a principle which is a bar against all information, which is a proof against all argument, and which cannot fail to keep a man in everlasting ignorance - that principle is condemnation before investigation." - Herbert Spencer

#229