Skip to content

feat: Integrate AI moderation into discussions 🤖 #17

@JustinhSE

Description

@JustinhSE

Overview

Use AI moderation to ensure safety and positivity in discussions. This will help maintain a supportive environment within the app's community chats.

Todo

  • Research available AI moderation tools compatible with Next.js (e.g., Google Cloud Natural Language).
  • Integrate AI moderation into Firestore chatrooms by analyzing each message before it is written to Firestore:
    chatrooms/
      <roomId>/
        messages/
          <messageId>/
            text: <string> (moderated before being stored)
    
  • Build a mechanism to flag or filter inappropriate content automatically before saving it in Firestore.
  • Notify admins when flagged messages require manual review (e.g., store flagged messages in a separate subcollection).
  • Remove mock flagged content from admins file and integrate a read/write firestore system
  • Test moderation accuracy across different contexts.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions