The Hidden Costs of 'Set It and Forget It' Automation