The man who stabbed an elderly man to death on a quiet California street on Thursday had been released from jail a day earlier for burglary cases.