| Re: [eigen] SSE square root |
[ Thread Index |
Date Index
| More lists.tuxfamily.org/eigen Archives
]
- To: eigen@xxxxxxxxxxxxxxxxxxx
- Subject: Re: [eigen] SSE square root
- From: Gael Guennebaud <gael.guennebaud@xxxxxxxxx>
- Date: Fri, 27 Mar 2009 14:30:21 +0100
- Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=N2wOe40FUz8Y4Yh+6a/LKn+G+uQVltkLyrOGATiz8JU=; b=rT8qun19YG+ObhgjnhPbjlYEwtHS84+1l3c6t8QZkpMfOCYm43zepCBqERMrdlIBp3 Sfq+glPTLNHajJHy1cF+y7aUcM+FKPEqQvcahTKqiWKnANUOKNGU3kkTB4SIbs5IreCd 82t9EsOY2wpfWnP2BDxB0hnq7qL3pe7ifBpLA=
- Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=xYvYINlm7frawzyuRXqW2Ujfkja5bfkgseV5hEeonIkOglVOI9vmuU8uH7WPU8m8bk p0npoTDAjdXcaxXAIDB6QBf8Yii8jncpgYVn++C6F0rsdn06V17ZX4TGEt7dkAtT9KxG /YIdQc9hN2s7n2R4z311iyE4lbNvM+oYiP+Jw=
On Fri, Mar 27, 2009 at 1:43 PM, Cyril Flaig <cflaig@xxxxxxxxxxx> wrote:
> Gael Guennebaud wrote:
>> hm, sorry that's not entirely true. I increased the number of samples,
>> and for the fastest version:
>>
>> 1 iter = 42% of failures with max error = 2.78308e-07
>> 2 iter = 36% of failures with max error = 2.15188e-07
>> 3 iter = 34% of failures with max error = 1.87297e-07
>
> In the correct version it gets rounded to a float or just truncated?
rounded to a float
> -cyril
>
>