I had my "aha moment" here when you multiplied the grad by the delta to calculate the directional derivative and then the resulting term resembled the second term of the multi-variate Taylor series. Thank you very much.
Convex problem means it can be approximated locally by a convex quadratic function. The quadratic function being convex is equivalent to the hessian being positive definite.
