top bar
QuickTopic free message boards logo
Skip to Messages

TOPIC:

Conjugate Gradient

^     All messages            3-18 of 18  1-2 >>
18
Spam deleted by QuickTopic 08-18-2010 02:02 AM
17
ed hardy
06-14-2010
08:11 PM ET (US)
Look for further information, just log on to our christian audigier
 online, because both the information and the series of the ED Hardy Shoes
 are shown there. As though there are so many hot celebs are brilliant with hardy shirt
 , why not you live with them as well? The easiest way to do that is to ask a white person for their thoughts on people who wear hardy shirts
.
16
longge
06-11-2010
05:09 AM ET (US)
With so many games streaming data from the HAZEL on the fly. The methodology for the tests was remarkably straight for ward first from HAZEL DVD, then from hard disk. As the opportunity to install to HAZEL DVD COLLECTION is obviously a compelling argument for upgrading the hard disk.HERE'S LUCY
  Messages 15-14 deleted by topic administrator between 10-07-2008 02:27 AM and 02-22-2008 04:21 PM
13
Valintino
05-07-2007
11:44 AM ET (US)
Hello, Your site is great. Regards, Valintino Guxxi
12
Deleted by topic administrator 07-22-2006 10:23 AM
11
Rasit Topaloglu
10-09-2004
05:22 PM ET (US)
It is interesting that this technique was used until 1960's, then were forgotten until recently. I think the remedy that brought it back is the introduction of periodic restarts. Otherwise, error build-up would cause the search vectors to lose their A-orthogonality for complex problems.
10
Gary Tedeschi
10-07-2004
03:53 PM ET (US)
Unfortunately, upon first exposure to a topic I usually need a couple of readings to digest the material. So my comments/questions are probably not very insightful.

1. How would one show that performing conjugation on the axial unit vectors makes Conjugate Directions equivalent to Gaussian Elimination? Is there any geometric intuition here? (p. 26)

2. I think the key to understanding the CG method as presented in this paper is understanding section 7.3 Optimality of the Error Term. Luck has it, though, that I do not yet completely follow the author's discussion.
Edited 10-07-2004 03:54 PM
9
Stephen Krotosky
10-07-2004
03:22 PM ET (US)
Interesting. How does it compare to other optimization techniques, such as EM?
8
Sameer
10-07-2004
04:33 AM ET (US)
To answer Robin's question about the size of the problems that conjugate gradient is used to handle. Think BIG, by big here we are talking about simulations containing millions of variables and going upto potentially a billion variables.
7
Sameer
10-07-2004
04:25 AM ET (US)
Since Vincent brought up Bi-Conjugate gradient, the folks who brought us the various pieces of software like LINPACK and LAPACK, also bring us

Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods, SIAM Press

http://netlib2.cs.utk.edu/linalg/html_templates/Templates.html

This is a comprehensive reference and comparison of the various techniques that go into solving large linear systems.
6
Sameer
10-07-2004
04:21 AM ET (US)
In case the history of Conjugate Gradient is of interest, there is a rather remarkable article in SIAM reviews (part of JStor)

Gene H. Golub; Dianne P. O'Leary

SIAM Review, Vol. 31, No. 1. (Mar., 1989), pp. 50-102.

Stable URL: http://links.jstor.org/sici?sici=0036-1445...OTCG%3E2.0.CO%3B2-S
5
Sameer
10-07-2004
04:18 AM ET (US)
Well since you asked,
you do not need to do any hacks for to get symmetric positive semi-definiteness. Instead of solving
Ax = b
consider the system

A^\top A x = A^\top b

Section 13 of the paper discusses this. In case you are wondering if A^\top A is still sparse or not, turns out there is no need to ever actually form A^\top A explicitly. Simple Matrix vector products suffice.

So what is the downside?, well condition number for A^\top A is the square of the condition number of A, and hence convergence is slower.
4
Vincent Rabaud
10-07-2004
04:09 AM ET (US)
cool paper. A bit long, but half of it is just basics of linear algebra so that is fine.
So, this seems cool to solve Ax=b when A is symmetric positive definite, but what is done when it is not the case ? Is there a way of modifying a bit the method like it was done in this fantastic talk on tuesday on LM ? (like you "add" enough to A to have it symmetric positive definite; you find a solution; then you do something with the original A). Or maybe something can only be done if the matrix is purely symmetric, purely positive...
Briefly: how generalizable is it ? (I've heard of biconjugate gradient method but I am not sure of its application)
3
Louka Dlagnekov
10-06-2004
11:59 PM ET (US)
Robin, it is indeed a very well written explanation with a lot of pre-requisites well covered.
Upgrade to PRO

Upload pictures, personalize your board, and more!

^     All messages            3-18 of 18  1-2 >>

Print | RSS Views: 1395 (Unique: 757 ) / Subscribers: 3 | What's this?