I was building a chatbot for my church and realized I was training it on bias

For about six months, I volunteered to help my local church in Boise make a simple chatbot to answer common questions. I was pulling text from old newsletters and sermon notes to feed it. Last week, a new member asked it about our stance on community aid, and its answer only referenced programs from twenty years ago, completely ignoring our recent food bank work. It hit me then: I wasn't just giving the bot information, I was accidentally locking in an old, incomplete view of what the church does. I was so focused on the tech working that I didn't think about the ethics of what I was teaching it. That single wrong answer showed me I was building a system that could mislead people based on my own narrow data choices. How do you even start to audit for that kind of hidden bias in a small project?

3 comments

3 Comments

jakewhite26d agoMost Upvoted

Nah, that's overthinking it. @grant_knight79 has a point about old papers, but a church bot just needs basic facts, not a perfect history. If someone wants the latest food bank hours, they should just call the office. It's a free tool made by a volunteer, not some official record. The old newsletters are still true info, just not the newest.

grant_knight7926d ago

Yeah that's a real problem with any kind of database or AI thing. Read an article a while back about a library that digitized its old local paper, and the search results made it look like the town was stuck in the 1950s because that's when the paper was most active. They had to actively go find newer community bulletins and school newsletters to add, otherwise anyone researching would get a totally wrong idea. For your church bot, maybe you need a checklist of all the big areas the church works in now, like the food bank or youth programs, and then go hunt for source material that talks about that recent stuff. It's like you have to force yourself to look for the gaps in your own knowledge, which is super hard lol.

the_max26d ago

Used to think Jake was right about keeping it simple, but grant_knight79's library example really shows the risk. If the bot only pulls from old newsletters, it'll tell people the youth group meets in a room that got turned into a closet five years ago. You gotta go find those recent bulletins, even if it's a pain.