Residents have lost their battle to prevent the first phase of a 1,050 home development on farmland going ahead.