I would recommend A Course in Miracles to an atheist who is on the fence, but probably not to you. But I'll chime in anyway.
I don't believe in a God who demands we bow down and "worship", and as the Course of Miracles is written, either does Jesus (my own drug of choice in the spiritual world).
I would ask you this, though. Where do you think this moral conscience of yours comes from? Science? Science is God's language, in my opinion, but he also is not ashamed to use magic.
I really do hate to borrow anything at all from the intelligent design people, but they do have a relevant point on DNA. Francis Collins, he of DNA fame, sees no possibility that DNA structure is not designed by an intelligent being. If that's the case, the aliens are probably not folks that should be trifled with. But of course, it isn't aliens.
John 13:1–17 points to Jesus washing the feet of his disciples. He was worshipping THEM in his own way. That's the theme throughout the Course of Miracles, that we are, in fact, extensions of God, and equal to Christ in every way, no matter how much we struggle with "sin" - a word that is avoided in that rather dense and somewhat difficult to parse tome.
Sarah Ruden, in her excellent translation of the Gospels from early Greek, points out that the Greek word for Lord, kurios, has no known analogy in modern Western language. In the context of the Gospels (called, "The Gospels", lol), she says it can mean almost any kind of semi-authoritative reference to another person/being. Mark Zuckerberg, therefore, can be considered the Lord of Facebook, or perhaps even social media.
I find that much atheist objection is based on faulty interpretation of scripture. Not THEIR faulty interpretation, but rather the faulty interpretation of the MEN, and it was always men, who were behind the earliest translations. Faulty interpretation passed around for 2,000 years by patriarchs with an agenda.
To make matters worse, the U.S. is a significant breeding ground of evangelicals who cherry-pick obscure, rather primitive scripture like Leviticus to decry homosexuality and abortion, subjects for which Jesus offers only crickets. And while they are pulling their pants down on yachts for selfies, they are demanding that you atone for your sins and worship the only God, and that if you are gay, you will burn in hell.
I'd be a terrible evangelist, because I think we all meet our maker the same way, in the end. "Sin" is just science run amok, brains that don't fire properly. I don't think a benevolent God ruins your eternity because you inherited faulty equipment.
What I do know is that I can feel what I would call a spirit guide that helps me through things, and weighs in on my decision-making process. I don't always listen, but I won't be condemned to hell for that. It's the same spirit guide that guides your morality. You don't need to believe it for it to be so.
It's my belief that a Holy Spirit resides in all of us, whether we like it or not. He'd love it if you communicate with him (I doubt gender is important to him, but him/he become the prevalent gender reference). But a God who insists that we love and forgive everyone, no matter what they've done to us, is obviously in no position to throw a hissy fit if you refuse.