Who's Accountable When AI Gets It Wrong?

As AI systems influence more decisions, accountability becomes harder to ignore. A system may produce the recommendation, but people and organizations still have to decide who is responsible for the consequences.

This collection from The Human Protocol explores responsible AI, trust, ethics, governance, transparency, human oversight, and the difficult questions that emerge when intelligent systems become part of consequential decisions.

Who is accountable when AI makes a mistake? How much decision-making should be delegated to a machine? What does meaningful human oversight look like? How can organizations build trust with employees, customers, and communities? And where should leaders draw boundaries even when technology makes something possible?

These conversations connect ethics to implementation. Responsible AI is not simply a philosophical question—it affects adoption, leadership, risk, governance, organizational trust, and the relationship people have with increasingly capable systems.

Key Topics Covered:
• Accountability when AI gets it wrong
• Responsible AI and ethical implementation
• Trust in AI systems
• Human oversight and human-in-the-loop decisions
• AI governance and organizational responsibility
• Transparency and explainability
• Bias, risk, and unintended consequences
• Leadership accountability for AI decisions
• Building employee and customer trust
• Deciding where automation should stop

Keywords
The Human Protocol, Mykel Salomon, responsible AI, AI ethics, AI trust, AI accountability, AI governance, human oversight, human in the loop, ethical AI, trustworthy AI, AI risk, AI transparency, AI bias, responsible innovation, human agency, AI leadership, technology ethics, AI decision making, responsible AI implementation

Hashtags
#TheHumanProtocol #ResponsibleAI #AIEthics #AITrust #AIGovernance

Call to Action:

Explore the conversations examining who remains responsible as AI becomes more capable and more influential. Subscribe to The Human Protocol and join the discussion about where human oversight, accountability, and trust must remain non-negotiable.

View the Responsible AI playlist on YouTube

Episodes in this topic

  1. 1,588 AI Disasters Nobody Is Talking About | Latha Karthigaa,

    Everyone is talking about what AI can do. Far fewer people are talking about what happens when AI gets it wrong. @Latha-ai-governance PhD, runs the Global AI Certification Council and publishes daily breakdowns of real-world AI incidents, looking at what went wrong, why it happened, and how it could have been prevented. In this episode of The Human Protocol, she takes Mykel Salomon through some of the most disturbing examples she has uncovered. From a Dutch childcare benefits algorithm that contributed to families losing homes and children being placed in foster care, to AI falsely accusing a Yale student of cheating, to chatbots giving dangerous advice, the conversation shows what happens when AI systems make decisions without sufficient human oversight. Latha also explains why AI governance isn't simply bureaucracy slowing innovation down. She compares governance to the guardrails on a highway: they allow organizations to move faster because the boundaries are clear. The conversation moves from today's AI failures into tomorrow's risks, including autonomous AI agents, prompt injection, deepfakes, misinformation, and the difficulty of knowing what AI systems are doing when thousands of agents operate inside an organization. The bigger question isn't whether AI will fail. It's whether we're learning from the failures that have already happened. YOUTUBE CHAPTERS Time Chapter 00:00 Introduction 01:12 Why AI incidents matter 02:38 The 1,588 AI incident database 04:10 AI failures before ChatGPT 05:35 The hidden cost of AI mistakes 07:05 AI and the future of jobs 08:30 When AI gets people wrong 10:05 The student accused of cheating 12:00 Why AI output is not evidence 13:42 AI governance vs. AI hype 15:20 The Dutch childcare benefits scandal 18:05 How algorithmic bias becomes real harm 20:10 What happens when models drift 22:05 AI systems and accountability 24:00 Agentic AI changes the risk 26:10 When AI can take actions 28:15 Prompt injection explained 30:00 The $1 Chevy Tahoe incident 32:05 How attackers manipulate AI 34:10 Deepfakes and trust 36:00 The $25M deepfake fraud 38:20 Why humans still get fooled 40:10 AI regulation and governance 42:00 What organizations should document 44:05 Human oversight in high-stakes systems 46:00 The problem with unknown unknowns 48:05 We do not know what we do not know 49:30 How businesses should approach AI 51:05 Where AI should not replace humans 52:50 Building better governance 54:10 Advice for AI leaders 55:25 What responsible AI looks like 56:40 The human role in an AI future 58:05 Final thoughts 59:15 Closing 59:56 End ABOUT THE GUEST Latha Karthigaa, PhD is Director and Head of AI Governance at the Global AI Certification Council (GAICC). GAICC focuses on AI governance, certification, training, and professional development, including work aligned with ISO/IEC 42001. Latha holds a PhD in Software Engineering from the University of Auckland, New Zealand, awarded in 2017. She founded an AI and marketing consulting firm in 2019 and has built and led AI solutions for finance and legal firms across the USA, UK, Australia, and New Zealand. In this episode, Latha brings a governance-focused lens to real AI incidents, helping explain how failures happen, why they can scale quickly, and what organizations should do to build stronger controls and human oversight. Guest social links: Instagram: https://www.instagram.com/global.aicertification.council YouTube: https://www.youtube.com/@Latha-ai-governance LinkedIn: https://www.linkedin.com/in/lathakarthigaa/ GAICC: https://gaicc.org/ AI Strategy & Execution Roadmap Thinking about implementing AI in your business? Download Mykel Salomon's free 10-Step AI Strategy & Execution Roadmap to clarify the business problem, identify the right opportunities, decide what should remain human, and move from idea to execution. Clarity first. Tools second. Humans always. Roadmap: https://dub.sh/thp-roadmap-riverside The Human Protocol Newsletter Technology is changing quickly. The human questions matter just as much. Subscribe to The Human Protocol newsletter for weekly perspectives on AI, leadership, work, and what it means to stay human while building the future. Newsletter: https://dub.sh/thp-newsletter-riverside

  2. The AI Future Nobody's Talking About: Trust as Infrastructure

    In this episode of The Human Protocol, host Mykel Salomon sits down with James Robson, former data protection officer for the UK Labour Party, Founder & CEO of Datus Longevitus, to challenge the idea that data protection is a barrier to progress. Drawing on a decade of GDPR work, James argues that governance is what actually enables innovation, comparing data safeguards to the brakes on a car that let you drive faster, not slower. The conversation moves from the differences between US and European approaches to privacy, to practical ways individuals can protect themselves online, to inspiring real-world examples of data used for public good, including a King's College London study on cash grants for people experiencing homelessness. James and Mykel also confront the darker side of the AI era, from echo chambers and self-radicalization to addictive algorithms and the erosion of critical thinking, before landing on a hopeful vision of trusted data intermediaries and an ethical, transparent future where trust becomes the real infrastructure. In this episode, you'll learn: - Why compliance and data protection can be the condition for innovation rather than its enemy, using the brakes-on-a-car analogy - How storytelling skills translate into understanding data systems and getting people excited about ethical data use - The key philosophical difference between US data law (consumer-focused) and European GDPR (human rights-focused) - Practical steps individuals can take to protect their data, including ad blockers, password managers, and rejecting cookies and trackers - What rights GDPR gives you to request your data, and how that compares to the US patchwork like the CCPA in California - How connecting datasets responsibly can improve outcomes in social care, education, problem gambling, and homelessness prevention - The technical safeguards that make data sharing safe, including end-to-end encryption, immutable ledgers, and the UK's Five Safes framework - Why echo chambers can quietly radicalize people and how dependence on AI threatens independent and critical thinking - The link between addictive algorithms, screen time, and mental health, including recent rulings against Meta and Google - What a trustworthy data future could look like, from trusted data intermediaries to ethical trust scores and nutrition-label-style transparency - Concrete advice for individuals, AI leaders, and governments navigating data responsibility and AI regulation Chapters 00:00 The Importance of Data Governance 05:00 Data Protection as an Enabler of Innovation 10:01 Understanding Data's Role in Organizations 14:47 GDPR: A Barrier or a Blueprint for Innovation? 19:49 Protecting Ourselves in the Age of AI 24:58 Data for Public Good: Real-World Applications 27:39 Data Oversight and Ethical Use 29:22 Addressing Homelessness with Data 33:11 Understanding Adverse Childhood Experiences 35:35 Concerns About Echo Chambers 41:39 The Role of Trust in AI 46:29 The Future of Trusted Data Intermediaries 49:24 Advice for Individuals Navigating AI 51:30 Guidance for AI Company Leaders 53:30 Regulatory Recommendations for Governments Connect with James Robson LinkedIn: https://www.linkedin.com/in/-james-robson/ Thinking about implementing AI in your business? Download Mykel Salomon's free 10-Step AI Strategy & Execution Roadmap to clarify the business problem, identify the right opportunities, decide what should remain human, and move from idea to execution. Clarity first. Tools second. Humans always: https://dub.sh/thp-roadmap-yt Technology is changing quickly. The human questions matter just as much. Subscribe to The Human Protocol newsletter for weekly perspectives on AI, leadership, work, and what it means to stay human while building the future: https://act-3-agency.link/thp-news-yt

  3. Most AI Failures Don't Start With the Code. They Start With the Contract w/ Rory O'Keeffe | S2E15

    In this episode, we break down why AI deployment is not just a tech decision, it is a legal, commercial, and risk decision. Rory O'Keeffe, Commercial & AI Lawyer, shares how most failures do not come from the code itself, but from the contracts, the assumptions, and the lack of clarity around data. Founders often rush into AI tools thinking they are buying software, when in reality, they are taking on a new layer of risk. If you cannot clearly explain where your data goes, you are not deploying AI, you are outsourcing control. We also dive into what founders consistently miss, from weak contract terms to misunderstanding how data is used, stored, and even reused to train models. Rory explains why things like anonymization, auditability, and explainability are not just legal language, they are critical safeguards. The conversation highlights real examples of how AI can go wrong, not because of bad intent, but because of poor inputs, lack of oversight, or blind trust in automation. It is a reminder that AI is a tool, not the decision-maker. This episode is also a practical playbook for founders navigating AI. From asking the right questions before signing contracts to planning your exit before you even start, the focus is on staying in control. The biggest takeaway is simple, AI will not replace you, but someone using AI better than you might. The advantage goes to those who understand both the technology and the responsibility that comes with it. Tune in and learn how to deploy AI with clarity, protect your business, and make better decisions in a fast-moving world. -- TIMESTAMPS: 00:00 Intro 01:05 Most AI failures start in the contract, not the code 02:10 Welcome to The Human Protocol 03:20 Rory O’Keefe – Irish lawyer, founder of RMLK Legal & Beyond the Fine Print 05:40 What founders misunderstand: AI vs automation vs robotics 08:20 Eyes wide open — rushing AI can cripple your company 10:50 Most common contract mistake: Click-through terms & data use clauses 13:40 “We will anonymize your data” — what that really means (and the risks) 17:10 GDPR, CCPA & global privacy laws every founder must know 20:30 Auditability & explainable AI — can they show where it went wrong? 24:10 Agentic AI horror story: Booking a hotel with voice cloning & credit cards 28:50 Power of prompting + why “how” matters more than ever 32:40 Data privacy & security in law firms — on-prem, private instances & hyperscalers 37:20 IP ownership: Who owns prompts, outputs & generated content? 42:10 Indemnification, liability & who pays if AI causes harm 47:30 Termination & exit clauses — avoid tech debt & lock-in 52:10 Human in the loop: Left-brain data vs right-brain critical thinking 56:40 Advice to younger Rory & every founder in the AI era Thinking about implementing AI in your business? Download Mykel Salomon's free 10-Step AI Strategy & Execution Roadmap to clarify the business problem, identify the right opportunities, decide what should remain human, and move from idea to execution. Clarity first. Tools second. Humans always: https://dub.sh/thp-roadmap-yt Technology is changing quickly. The human questions matter just as much. Subscribe to The Human Protocol newsletter for weekly perspectives on AI, leadership, work, and what it means to stay human while building the future: https://act-3-agency.link/thp-news-yt

  4. The AI Paradox: What AI Reveals About Us w/ Ty Givens | S2E10

    AI is not the solution. It is the mirror. In this episode of The Human Protocol, Mykel Salomon sits down with Ty Givens to unpack a hard truth about AI in customer support, CX, and leadership. As more companies rush to adopt AI automation, chatbots, and AI agents, many are finding that AI does not fix broken systems. It exposes them. From messy workflows and weak documentation to unclear escalation paths and poor ownership, this conversation shows what leaders need to face before they can scale AI the right way. Ty Givens shares real-world lessons from years of experience in support operations, CX leadership, AI deployment, and scaling teams. She explains why AI in customer service still needs human judgment, why leaders must become more technical, how poor documentation creates weak AI outcomes, and why the future of support will depend on curiosity, execution, and accountability. This episode is for anyone leading customer experience, customer support, operations, AI transformation, or service strategy. Key Topics: - Why AI exposes broken processes instead of fixing them - The truth about AI in customer support and CX - Why leaders need to become more technical in the AI era - How bad documentation leads to bad AI answers - What companies get wrong when deploying AI agents and chatbots - Why ownership and accountability matter more than ever - Where human support still matters most - How to build the right foundation before scaling AI automation -- TIMESTAMPS 00:57 Ty Givens introduction & career journey 03:59 Founding CX Collective – helping leaders build better 04:37 AI pressure in CX & support teams today 05:31 What really breaks when you deploy AI? 07:58 Real client story – sales vs support AI bots 13:00 Why leaders must understand frontline work in AI era 18:00 Programming systems is now part of leadership 22:40 Curiosity VS pretending to be strategic 28:00 How AI exposes burnout & unclear escalation paths 33:20 Don't automate broken processes – fix them first 38:50 Humans should handle complex, meaningful problems 43:10 CSAT often drops after AI rollout – here's why 48:20 Customers don't care if it's AI or human – they want fast, correct answers 52:40 Transparent AI vs pretending it's a person 57:37 Final advice to younger Ty: stay curious --------------------------- Thinking about implementing AI in your business? Download Mykel Salomon's free 10-Step AI Strategy & Execution Roadmap to clarify the business problem, identify the right opportunities, decide what should remain human, and move from idea to execution. Clarity first. Tools second. Humans always: https://dub.sh/thp-roadmap-yt Technology is changing quickly. The human questions matter just as much. Subscribe to The Human Protocol newsletter for weekly perspectives on AI, leadership, work, and what it means to stay human while building the future: https://act-3-agency.link/thp-news-yt

  5. Ep #15 - Scaling Ethics: Architecture, Accountability, and the Future of Leadership w/ Ryan Roberts

    TakeawaysEthics must be integrated into the architecture of AI systems.Curiosity drives innovation and leadership.AI poses risks that require proactive archi...

Related Insights

  1. Edition #41: The Guardrails Are the Speed

    Why the companies slowing down for AI governance are the ones still running

  2. Edition #20 - AI Doesn’t Fix Your Operation. It Exposes It.

    AI doesn’t create the mess. It makes the mess visible. Fast.

  3. Edition #6: Ethics in AI Is Non-Negotiable

    We are building systems that move faster than our conversations, faster than our policies, faster than our caution, faster than our ethics.