Ethics & Society
Building responsible AI: grappling with power, justice, and the human impact of machines
What You'll Learn
- ✓Philosophical foundations: consequentialism, deontology, and virtue ethics applied to AI
- ✓Power dynamics in AI: who builds it, who benefits, and who is harmed
- ✓Surveillance and privacy: understanding data collection, tracking, and consent
- ✓Algorithmic justice: definitions of fairness, disparate impact, and real cases
- ✓Deep case studies of racial bias in facial recognition, hiring algorithms, predictive policing, and healthcare disparities
- ✓Practical frameworks for auditing AI systems and personal checklists for ethical use
- ✓Industry-specific guidelines for healthcare, education, criminal justice, and finance
- ✓Red-team exercises and scenario-based dilemmas to build ethical reflexes
Key Ideas
AI technology can amplify both benefits and harms. When used in high-stakes contexts like hiring or policing, errors and biases can ruin lives. Recognizing AI's social impact is an ethical imperative. Three key philosophical frameworks guide AI ethics: consequentialism (evaluating actions based on outcomes), deontology (focusing on duties and rules), and virtue ethics (emphasizing character and intentions).
Examples:
- • Consequentialism: Does AI maximize benefits and minimize harm?
- • Deontology: Are some practices wrong regardless of outcomes (e.g., collecting data without consent)?
- • Virtue ethics: Are designers and users honest, prudent, and respectful of human dignity?
Not all AI use is equal. High-stakes situations (hiring, medical advice, legal decisions, policing) need extreme caution and human oversight. Low-stakes uses (brainstorming, drafts, learning) are safer for experimentation.
Examples:
- • High-stakes: Resume screening, medical diagnosis, risk assessment, content moderation
- • Medium-stakes: Content creation, customer support, research assistance
- • Low-stakes: Brainstorming, learning, personal organization, creative exploration
Dive Deeper
Explore the mechanism, mastery techniques, and critical thinking considerations. Click to expand each layer.
Power Dynamics and Surveillance
AI is built by a small number of companies and research labs. This concentration of power influences whose values are encoded. Historically marginalized groups may have little voice in data collection, algorithm design, and deployment. Modern AI is enabled by large-scale data collection: social media posts, shopping patterns, biometric data. Facial recognition technology often misidentifies people of color and women; a 2018 study found error rates as high as 34.7% for dark-skinned women versus 0.8% for light-skinned men.
Key Points:
- •Power concentration: Few companies control AI development and deployment
- •Data collection risks: Surveillance, privacy violations, and potential misuse
- •Facial recognition bias: Dramatically higher error rates for women and people of color
- •NIST studies show demographic differentials in face recognition algorithms
Practical Ethical Frameworks
Before deploying or using an AI tool, ask: What data does it use? Who could be harmed by errors? Are there less intrusive alternatives? Does the model performance differ across demographic groups? Have domain experts and affected communities been consulted?
Techniques:
- •Healthcare: Ensure datasets represent diverse populations; validate models on out-of-sample groups; abide by HIPAA
- •Education: Avoid surveillance; use AI to augment rather than replace human support; evaluate for bias against students with disabilities
- •Finance: Adhere to anti-discrimination laws; test for redlining; ensure explainability
- •Criminal justice: Use risk scores as one input among many; implement transparency and appeal mechanisms; audit regularly
- •Red-team exercises: Simulate adversarial scenarios where AI is misused or attacked
Deep Case Studies
Real-world examples reveal how AI can entrench inequalities: 1) Facial recognition 'Gender Shades' study found commercial systems misclassified darker-skinned women at much higher rates. 2) Amazon's recruiting engine penalized resumes containing words like 'women's'. 3) COMPAS risk scores overpredicted recidivism for Black defendants. 4) Healthcare algorithms recommended less care for Black patients by using spending as a proxy for health need.
Considerations:
- •Regulation and policy: Engage with emerging AI regulations (EU AI Act, U.S. executive orders)
- •Societal implications: AI influences employment, democracy, and culture through job displacement, deepfakes, and misinformation
- •Future research: Follow work on differential privacy, algorithmic interpretability, robustness, and value alignment
- •Cross-disciplinary collaboration: Between computer scientists, ethicists, and social scientists
Case Studies
Source: MIT Media Lab Gender Shades Study
The 'Gender Shades' study found that commercial face analysis systems misclassified darker-skinned women at error rates of 34.7% compared to 0.8% for light-skinned men. This raises critical questions about whether these systems should be used in law enforcement.
Source: Reuters 2018 Investigation
Amazon's recruiting engine penalized resumes containing words like 'women's' and downgraded women's colleges. This case explores how training data determines bias and how transparency and human oversight can mitigate harm.
Source: ProPublica COMPAS Investigation
COMPAS risk scores used in criminal justice were found to overpredict recidivism for Black defendants at nearly twice the rate of white defendants. This raises debates about whether such algorithms should inform sentencing.
Source: Science Magazine 2019
An algorithm used by health systems to allocate care recommended less care for Black patients because it used healthcare spending as a proxy for need, perpetuating existing inequalities.
Suggested Resources
University of Helsinki
UNESCO
Try This Now
Put your learning into practice with these hands-on exercises. Copy the prompts and try them in your favorite AI tool.
Use a loan application dataset. Build a simple classifier. Measure accuracy, false positive rate, and false negative rate for different demographic groups. What disparities do you find?
Should AI be used in hiring decisions? Argue from three perspectives: consequentialist (outcomes), deontological (duties/rules), and virtue ethics (character/intentions)
How could someone fool a facial recognition system? Consider adversarial makeup, photo spoofing, or other techniques. What defenses could prevent these attacks?
Related Prompts from the Library
Practice what you've learned with these prompts from our library.
ROLE: You are a assistant. GOAL: Design the user experience and website design for [online business] that should highlight [qualities]. CONTEXT: Input details: online business, qualities. Ask clarifying questions if any input details are missing. TASK: Design the user experience and website design for [online business] that should highlight [qualities]. Give precise instructions and recommendations for each step. Online business = Artisanal Goods - An online marketplace that connects you with independent artisans and makers from around the world. From handmade ceramics to handcrafted jewelry, Artisanal Goods offers a unique selection of one-of-a-kind products. Qualities = Uniqueness, Quality, Ethical and Sustainable, Storytelling, Personalization I’m starting a business and need to identify my ideal customer. What steps can I take to develop a buyer person OUTPUT FORMAT: Text CONSTRAINTS:
View Prompt →ROLE: You are a assistant. GOAL: Explain the principles of ethical investing and its growing importance. CONTEXT: Ask clarifying questions if any input details are missing. TASK: Explain the principles of ethical investing and its growing importance. Discuss the pros and cons of real estate investment. OUTPUT FORMAT: Text CONSTRAINTS:
View Prompt →ROLE: You are a assistant. GOAL: Suggest 20 metaphors to describe the benefits of Insert product/service], make them short no more than 6 words and use friendly tone and must include novelty. CONTEXT: Input details: expert name, ideal customer persona, new product, person, product details, product/service, service. Observe constraints: Friendly tone; Concise output; Word limit as specified; Include novelty. Ask clarifying questions if any input details are missing. TASK: Suggest 20 metaphors to describe the benefits of Insert product/service], make them short no more than 6 words and use friendly tone and must include novelty. Product: Insert here] "Write a marketing campaign outline using the 'Reciprocity Bias' framework to create a sense of obligation in [ideal customer persona] to try our [product/service]. Include value-adds or bonuses, and encourage reciprocity by asking for a favor or action in return." Ideal customer persona: Customer Persona] Service: [service] I'm giving you some content strategies of <person>, read it carefully and generate a content plan for my <new product> for next 12 weeks as the <person> do. Person: [expert name] New product: [product details]. Content strategy: Insert here. OUTPUT FORMAT: Text CONSTRAINTS: Friendly tone; Concise output; Word limit as specified; Include novelty
View Prompt →ROLE: You are a assistant. GOAL: I want to increase my website's backlinks to improve its ranking. CONTEXT: Ask clarifying questions if any input details are missing. TASK: I want to increase my website's backlinks to improve its ranking. What are some ethical ways to <build> backlink My website's search engine ranking is low. How can I optimize my website's on-page <keywords> to improve my "I've heard a lot about backlinks and their importance for SEO, but I'm not sure where to start. Can you provide s "I'm interested in optimizing my website for voice search, but I'm not sure where to start. Can you provide some t My email marketing campaigns aren't converting as well as I'd like. What are some tips for improving my email s My brand has a presence on multiple social media platforms, but I'm having trouble maintaining a consistent bra I'm starting a business and need to identify my ideal customer. What steps can I take to develop a buyer persona I'm interested in launching a YouTube channel to promote my business and products, but I'm not sure how to ma I'm struggling to differentiate my brand from competitors. What are some key factors to consider when developin OUTPUT FORMAT: Email CONSTRAINTS:
View Prompt →ROLE: You are a assistant. GOAL: Explain the basics of forex trading and its risks. CONTEXT: Ask clarifying questions if any input details are missing. TASK: Explain the basics of forex trading and its risks. Describe how to create a sustainable and responsible budget. Discuss the impact of student loans on financial planning. OUTPUT FORMAT: Text CONSTRAINTS:
View Prompt →ROLE: You are a assistant. GOAL: Develop a product description template to improve <online store> sales. CONTEXT: Observe constraints: Friendly tone. Ask clarifying questions if any input details are missing. TASK: Develop a product description template to improve <online store> sales. Your online store is struggling to conver ts winning factors in future content? h. How do you use storytelling to connect with this audience and convey the value of your product/service? ze the content that's causing the drop, and how do you make data-driven decisions to address the issue? ieve their goals. How can you craft a compelling narrative that highlights the customer's journey and clearl campaign. What kind of story can you tell to captivate your audience and create buzz around the launch? nce. What changes will you make to the persona to better align with your market? me ways to measure the success of your campaign?<Campaign metrics>, <Measurement methods> pactful and memorable campaign that resonates with your target audience? ur target audience? What content promotion and distribution techniques can you employ to maximize its re and distribution tactics to increase awareness and drive sales? s for getting your message out to your target audience?<Target audience>, <Promotion methods> include to ensure a successful persona that transcends borders? do you curate and edit content that represents a range of perspectives and voices? people? What content promotion and distribution strategies can you use to ensure it's downloaded and rea ach ad to grab your audience's attention and encourage them to take action? g and reach its target audience? d calls-to-action to drive more action from your audience? gather insightful information about your target audience? ases your company's strengths and unique value proposition, while still providing relevant data and informa asing visibility and engagement? credited. What steps do you take to ensure ethical curation practices? What steps do you take to analyze its performance and identify areas of improvement? ents do you need to consider in order to optimize its impact? putation. How can you use storytelling to acknowledge the mistake, show your company's values, and ultim r content and identify areas for improvement? eflect the new combined company and identify potential opportunities for growth? ou use to curate and optimize SEO-friendly content? curate content that supports the organization's mission and values? promotion and distribution tactics can you use to generate interest and increase downloads? ce it up and keep it engaging for your audience? otion and distribution strategies do you use? omoting your product to your target audience?<Product>, <Promotional tactics> are some strategies for maintaining a consistent and engaging content pipeline? n order to accurately represent their ideal customer? ling to craft a response that addresses the issue transparently and authentically, while still maintaining the ategy to create buzz and excitement among potential customers? What steps do you take to research and develop this new persona? ow do you conduct an audience analysis to ensure your content is meeting their needs and preferences? ure your campaign is effective and captures your target audience's attention? se to gather information and curate high-quality content for your client? report, and you need to promote it to reach a wider audience. Your task is to develop an outreach strategy latest industry trends and gather insights from your target audience. Your task is to conduct a survey that t or service, and you need to promote it on social media. Your task is to create a social media content cale service that requires a longer sales cycle. Your task is to write an email series that educates and nurtures ct customers and establish thought leadership in your industry. Your task is to brainstorm content topics an rt visitors into customers, and you need to improve your product descriptions. Your task is to develop a pro ? y demonstrates the value of your offering? each? ad by your target audience? ation? mately regain the trust of your customers? trust of your customers? y that will generate interest and increase visibility for the report. Think about who your target audience is, w will provide valuable data and insights on a relevant industry trend. Think about the questions you need to endar that aligns with your launch goals and target audience. Think about the social media platforms that y leads throughout the sales funnel. Think about the pain points and questions that your leads have, how yo nd keywords that align with your company's mission and expertise. Think about what your customers are s oduct description template that highlights the features and benefits of your products, while also addressing which channels are best for reaching them, and what kind of messaging will be most effective in convincing o ask, the survey platform to use, and how you can analyze and use the data to inform your strategy. your target audience uses, the type of content that resonates with them, and how you can track and measu our product or service can solve their problems, and how you can build trust and credibility through your em searching for, what questions they have, and what kind of content they would find valuable. common objections and questions. Think about the tone and language that resonates with your target aud g them to download and read the re ure engagement. mail content. dience, as well as the visual and for OUTPUT FORMAT: Script CONSTRAINTS: Friendly tone
View Prompt →Related Workshops
Workshop: AI Ethics Team Discussion
A 90-minute team workshop for leads and educators. Work through a hands-on bias detection exercise, conduct a context audit of your AI tools…
Reflection Questions
- 1.What ethical framework resonates most with you? How would you apply it to a concrete AI use case?
- 2.How can individuals push back against harmful AI systems in their workplaces or communities?
- 3.What role should governments play in regulating AI? Where do you draw the line between innovation and safety?