🚗 Agentic Connected Vehicle Platform

An AI agent-driven car management system: control, diagnostics, and insights via agents.

Important: The code in this repository was developed during a hackathon and implemented within a limited timeline. It is intended for demonstration purposes only.

✨ Features

• 🗣️ Natural-language agent interface for intuitive commands and queries
• 🚗 In-vehicle assistant for real-time driver and passenger support
• 🔒 Remote access: lock/unlock, engine start/stop
• 📍 Smart integration of weather, traffic, and points of interest (via Model Context Protocol)
• 🎛️ In-car controls for climate, lighting, and windows
• 🔧 Diagnostics and proactive maintenance
• 🔔 Real-time alerts with notifications

🛠️ Tech Stack

• Backend: Python 3.12+, FastAPI, Semantic Kernel
• DB: Azure Cosmos DB (AAD auth)
• AI: Azure OpenAI (fallback to OpenAI if configured)
• Frontend: React, Material-UI
• MCP: Weather, Traffic, POI, Navigation via FastMCP (sample data in plugin/sample_data.py)

Full architecture, agent specs, and API list: see PROJECT.md.

Data / Naming Conventions

• External (API, frontend, Cosmos stored docs): camelCase via Pydantic CamelModel.
• Backend Python attributes: snake_case.
• Do not manually recase dict keys—always return model instances.

🚀 Quick Start

# Authenticate with Azure (if needed for cloud services)
az login

# --- Frontend (web) ---
cd web
# Copy example env files and edit values before running
cp .env.example .env.development
cp .env.example .env.production
yarn install

# --- Backend / Vehicle service ---
cd ../vehicle
# Copy backend env and edit values
cp .env.sample .env
poetry install

# --- Run services (use two terminals) ---
# Terminal A: start frontend
cd ../web
yarn start

# Terminal B: start backend
cd ../vehicle
python main.py

Deployment

# (Optional) Create Azure Resource Group in your subscription
az group create --name <resource-group-name> --location <location-name>

# (Optional) Create Azure OpenAI and Speech Service.
# Be sure to edit values in params.json before deployment.

# Deploy Azure infrastructure
cd infra
powershell ./run_infra_deploy.ps1
cd ..

# Deploy your FastAPI web app to Azure App Service
# (this script should internally call `az webapp deploy`)
# If you encounter any issues, use the Visual Studio Code Azure extension to deploy your web app to Azure.
run_webapp_deploy.cmd

# Set the startup command in your Azure Web App configuration:
az webapp config set --resource-group <resource-group-name> --name <app-name> --startup-file "python main.py"

# Azure Portal: Add your webapp URL to Entra ID > Authentification > Single-page application > Redirect URIs

# Assing Data Contributor role to Cosmos DB: Webapp > Identity > System assigned > On
az cosmosdb sql role assignment create --account-name <cosmos-db-account-name> --resource-group <resource-group-name> --scope / --principal-id <web-app-principal-id> --role-definition-id 00000000-0000-0000-0000-000000000002

Note: MCP services use deterministic sample data in plugin/sample_data.py.

📖 Documentation

For full API reference, architecture, and examples, see the project documentation.

Dashboard Overview

Natural Language Agent Interface

Vehicle Simulation & Control

In-Vehicle Assistant

Remote Drive Control

UI only: The gateway.py module needs to be implemented to connect with the server of this machine.

• The original code is implemented in the Python GUI client. To expose the controls to the frontend, a gateway.py is required to convert and transport the payload for use in the UI. Refer to the original client application in doc/remote-client for details on controlling the machine.

Create Test Data (Dev Seed)

Use the built-in dev seed endpoint to create a demo vehicle and initial status for local testing.

• Default seed (creates demo vehicle if not present):

curl -X POST http://localhost:8000/api/dev/seed

• Seed a specific vehicleId:

curl -X POST "http://localhost:8000/api/dev/seed?vehicleId=a640f210-dca4-4db7-931a-9f119bbe54e0"

• Verify the status:

curl http://localhost:8000/api/vehicles/a640f210-dca4-4db7-931a-9f119bbe54e0/status

Bulk seed multiple demo vehicles and related data into Cosmos DB:

curl -X POST http://localhost:8000/api/dev/seed/bulk \
  -H "Content-Type: application/json" \
  -d '{
    "vehicles": 5,
    "commandsPerVehicle": 2,
    "notificationsPerVehicle": 2,
    "servicesPerVehicle": 1,
    "statusesPerVehicle": 1
  }'

Check last seed summary:

curl http://localhost:8000/api/dev/seed/status

VS Code REST Client

• Open vehicle/seed_test_vehicle.rest and click “Send Request” on:
  • POST {{host}}/api/dev/seed
  • POST {{host}}/api/dev/seed?vehicleId={{vehicleId}}
  • POST {{host}}/api/dev/seed/bulk

Note: This endpoint is for development only. Do not expose it in production.

🔐 Entra ID (formerly Azure AD) Authentication — App Registration & Access Token

Set your backend env (vehicle/.env):

AZURE_TENANT_ID=<tenant-guid>
AZURE_CLIENT_ID=api://<your-app-client-id> or <your-app-client-id>   # Application ID URI (aud)
AZURE_AUTH_REQUIRED=true

Frontend requests the scope (note: scope = audience + "/access_as_user"):

REACT_APP_AZURE_CLIENT_ID=<client-guid>   # NOT the api:// Application ID URI
REACT_APP_AZURE_TENANT_ID=<tenant-guid>
REACT_APP_AZURE_SCOPE=api://<client-guid>/access_as_user

📜 License

MIT © kimtth