On the link between hyperparameters and convergence