Bayesian Inference for the parameters of a boundary value problem: specialized Markov chain Monte Carlo schemes