It's definitely a struggle, and there are no easy answers. First I would see how long you expect to be working to hit your savings goals. If it's 5 years, and the high-paying job is 2 years, you have a good idea of the trade-off.
There could be other factors that sway your decision. Is the commute for each job the same? The location? Could you end up with higher expenses for the better-paying job (working in different area, expensive commute, expensive clothing, no time/energy to cook on your own, requisite dinners with co-workers)? Do you have a spouse or significant other who could work a lighter job and take care of some housework?
On the other hand, maybe you'll learn and grow more in the high-paying job. Is it stressful to you to have a 'pointless' job, or a job where your co-workers don't seem to do anything?
I am in a similar situation - or rather, I have a high-paying job and I'm sure I could find a laid-back low-paying job.
It's a struggle all the time with stress, but the money I make is so good that I don't really have much choice. Even during a bad year I look at the numbers and realize how lucky I am. However, if I had to choose between a relaxed job paying 65k and a very stressful job paying 80k, I would take the relaxed job. If I had to choose between a relaxed job paying 25k and a stressful job paying 40k, I would probably take the stressful job.
It all depends on the details - let me know if you have questions.