Recent questions tagged precision

0 votes

378 views

1 answer

precision - generating pi to nth digit java

I wanted to know how I can generate pi to the nth digit. I have a couple of basic ideas. Use Math.PI ... to implement my ideas of generating PI. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

263 views

1 answer

precision - Is specifying floating-point type sufficient to guarantee same results?

I'm writing a specification that describes some arithmetic that will be performed by software. The intention is ... not the overall precision. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

348 views

1 answer

precision differences in matlab and c++

I am trying to make equivalence tests on an algorithm written in C++ and in Matlab. The algorithm contains some ... tests on matlab and c++? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

354 views

1 answer

precision - Dealing with very small numbers in R

I need to calculate a list of very small numbers such as (0.1)^1000, 0.2^(1200), and then ... Any suggestions will be appreciated, thanks See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

289 views

1 answer

precision - Why does Visual Studio 2008 tell me .9 - .8999999999999995 = 0.00000000000000055511151231257827?

When I type this into the Visual Studio 2008 immediate window: ? .9 - .8999999999999995 It gives me this ... that extra precision coming from? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

299 views

1 answer

precision - Weird error in R when importing (64-bit) integer with many digits

I am importing a csv that has a single column which contains very long integers (for example: ... 9 "4082620101129165548" 4082620101129165312 See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

627 views

1 answer

precision - C++ calculating more precise than double or long double

I'm teaching myself C++ and on this practice question it asks to write code that can calculate PI to >30 digits ... free to offer it. Thank you! See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

Categories

Just Browsing Browsing

Most popular tags