It really depends on what pieces you're playing. Most pieces by bach are meant to play with legato, and not staccato, so I can see why many people who play bach that play in a staccato style would be guilty, especially because Bach was one of the best pianist composers of any time (including pipe organ composer).
Although he said legato playing was correct and you should keep notes connected in an orderly fashion, this really applies mostly to his pieces. There are a variety of Chopin pieces for the piano, for example, that involve Staccato like the jumping key etude. So it really depends on the piece for which style you should play.
Legato is when the notes are held down a tad bit harder and longer and are smoothly connected and not disconnected. Staccato is when the notes just jump up and down with your fingers and are disconnected.
This is the main reason why a lot of Bach's pieces are played legato style, simply because he plays fast pieces with many tricky note combinations that would sound jumbled and messed up with staccato. A lot of notes would be drowned out as well.
Staccato is more for really exciting pieces where moving your fingers up and down is required, and although sometimes they involve tricky note combinations, the tricky notes of Bach and how each note sounds makes the tricky fingers of smoothly connecting each note in legato style for John Sebastian Bach truly an amazing thing to watch.
There is something wrong if you play a Bach piece in staccato style if it says to do it in legato style, but if it sounds nice and beautiful music is produced, you shouldn't really feel guilty in how worse your playing sounds, really only of how bad the composer would feel if they were alive knowing you would play it that way.
Although in certain pieces it is pleasurable to play Staccato, you shouldn't do it if it doesn't say to. However, if you only listen to a recording like this, there's no need to be guilty. Music can be appreciated (even if it's not the most amount possible) even if not played entirely correctly.
I wouldn't call it a guilty pleasure if someone else was playing it, but that's just me. Imagine how much worse the person feels (including embarrassed) to have made recordings that don't even resemble how the composer wanted the music to be played. He or she must have felt really bad.
Moral of the story- you can play staccato if you feel like it, but it won't sound as good as it is supposed to be played if it was written as legato.
P.S.- Staccato is actually good practice in order to make your fingers nimble and fast and easy to move around the keyboard. Staccato makes your fingers more able to move freely across the keyboard and play fast. With legato, your fingers are next to each other and already there. With staccato, it's a good workout with all the jumping.
So enjoy playing staccato at first if it helps you practice, and definitely don't be guilty about anything.
Best regards.