I have found a workaround to fix this issue.
If the module was previously used with an older OS. You must use the JTAG port and erase completely the flash memory and then flash back everything config, firmware, uboot, etc..
Set the console variable and everything will work correctly.
The reason I didn't have this issue with my other module is that they were brand new module out of the box without any firmware on it beside u-boot.
Hope this will help out someone else