Cooperative Design Of Machine Learning And Gpu-Based Systems For Inference