Engineering Secure AI Agent Infrastructure Through Observability-Driven Reliability Practices