Computation Graph:
Instantiating Variable objects as well as Ops objects adds to a graph of computation that is tracked by tf.
After building your computation graph, where nodes are Variables or Ops or Constants, you can retrieve the executed and resulting value of any of the nodes in the graph.
The difference between Ops and Variables:
- Ops take Tensor inputs and return Tensor outputs, they have no internal state.