Hack the Act!

Hack the Act! is a chatbot designed to demystify the European Union AI Act.

Overview

This project employs a Retrieval-Augmented Generation (RAG) approach to deliver an interactive chatbot that answers questions about the EU AI Act. It leverages NVIDIA's AI endpoints for both the language model and embeddings:

• Language Model: Colosseum 355B by iGenius, a model tailored for regulated industries.
• Embeddings: NeMo Retriever Llama3.2 embeddings, to create vector representations of document chunks based on official publications by the European Commission:
  • EU AI Act Regulation, 13 June 2024
  • Guidelines on Prohibited AI Practices, 4 February 2025

Powered by Langchain and deployed via Streamlit for an easy-to-use web interface.

Setup

1. Clone the repository:

   git clone https://github.com/gianluigilopardo/hacktheact.git
   cd hacktheact

2. Install the dependencies:

   pip install -r requirements.txt

3. Set up environment variables: Create a .streamlit/secrets.toml file in the root directory with the following variables:

   [api_keys]
   NVIDIA_API_KEY=your_nvidia_api_key
   

   Replace your_nvidia_api_key with your actual API keys. You can request a free NVIDIA API key at https://build.nvidia.com/.

Usage

Run the Streamlit app:

streamlit run main.py