Wrong linking mechanism for all the backends

[rrcarlosrodriguez]

We should use LIBADD and not LDFLAGS to avoid linking problems.

Fix was already applied to TFLITE and was tracked by #69