Hello to everyone.

What the question means is that different ways of expressing the same relation between the data and unknown variables produce really weird fit results:

The problem: I have the unknown variables $x_1,x_2,x_3,x_4,x_5,x_6$ and the observations $\vec{q}_i=\Big(q_i(1),q_i(2),q_i(3)\Big), i=1\ldots N$
($N$ observations of real valued 3-vectors)

The relation between the unknowns and the observations is:

$\vec{q}_i\cdot(x_1,x_3,x_5)^T=-1$ (1st Set of $N$ equations)
$\vec{q}_i\cdot(x_2,x_4,x_6)^T=3$ (2nd Set of $N$ equations)

If i solve each set of equations as a separate overdetermined linear system the solution error is very bad.

But if i exploit that $3=(-3)*(-1)$ and combine the 2 previous Equations into one equation

$\vec{q}_i\cdot(x_2,x_4,x_6)^T=-3\ \vec{q}_i\cdot(x_1,x_3,x_5)^T$

This is a relation between the observations and the unknowns that results in the following overdetermined homogeneous system:

$3q_i(1)x_1+q_i(1)x_2+3q_i(2)x_3+q_i(2)x_4+3q_i(3)x_5+q_i(3)x_6=0,\ \ \ \ \ i=1\ldots N$

I use MATLAB for calculations.
Solving this for $x_1,x_2,x_3,x_4,x_5,x_6$ using SVD gives excellent fitting results and extremely low error.
What is so bad about solving separately the two overdetermined linear systems?
Are my variables correlated?
What are some guidelines to be followed when formulating overdetermined systems of equations?

I have been frantically looking for answer on this one for days.
  Some article-book references would be really valuable.

Hello to everyone.

What the question means is that different ways of expressing the same relation between the data and unknown variables produce really weird fit results:

The problem: I have the unknown variables $x_1,x_2,x_3,x_4,x_5,x_6$ and the observations $\vec{q}_i=\Big(q_i(1),q_i(2),q_i(3)\Big), i=1\ldots N$
($N$ observations of real valued 3-vectors)

The relation between the unknowns and the observations is:

$\vec{q}_i\cdot(x_1,x_3,x_5)^T=-1$ (1st Set of $N$ equations)
$\vec{q}_i\cdot(x_2,x_4,x_6)^T=3$ (2nd Set of $N$ equations)

If i solve each set of equations as a separate overdetermined linear system the solution error is very bad.

But if i exploit that $3=(-3)*(-1)$ and combine the 2 previous Equations into one equation

$\vec{q}_i\cdot(x_2,x_4,x_6)^T=-3\ \vec{q}_i\cdot(x_1,x_3,x_5)^T$

This is a relation between the observations and the unknowns that results in the following overdetermined homogeneous system:

$3q_i(1)x_1+q_i(1)x_2+3q_i(2)x_3+q_i(2)x_4+3q_i(3)x_5+q_i(3)x_6=0,\ \ \ \ \ i=1\ldots N$

I use MATLAB for calculations.
Solving this for $x_1,x_2,x_3,x_4,x_5,x_6$ using SVD gives excellent fitting results and extremely low error.
What is so bad about solving separately the two overdetermined linear systems?
Are my variables correlated?
What are some guidelines to be followed when formulating overdetermined systems of equations?

I have been frantically looking for answer on this one for days.

EDIT: The homogeneous representation is the only one that is correct. It turns out that the inhomogeneous representation using constants on the right side for the equations is wrong.

In my problem the equations are multiples of each other and not exact numbers. That's why the fitting is successful with the homogeneous representation that depends on the ratio. It fails otherwise.

After noticing that the correct solution norm is bad for the inhomogeneous equations i figured out the problem.