Skip to content

Create minimal example database with SQLAlchemy and/or DuckDB #331

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
tsmbland opened this issue Jun 10, 2024 · 0 comments · May be fixed by #379
Open

Create minimal example database with SQLAlchemy and/or DuckDB #331

tsmbland opened this issue Jun 10, 2024 · 0 comments · May be fixed by #379
Assignees
Labels

Comments

@tsmbland
Copy link
Collaborator

Before going forward with a full database for all the inputs, it's worth putting together a small database for a subset of the inputs, just to test out the approach and the tooling.

This should consist of:

  • a set of csv files containing the data
  • an in-memory database that reads in the csv files, with all the necessary validation steps. I think we've identified SQLAlchemy as an appropriate tool
  • retrieval of data from the database into xarray and/or pandas

I'd probably go with the commodities section of the database to start with as it's relatively self contained.

@github-project-automation github-project-automation bot moved this to 📋 Backlog in MUSE Jun 10, 2024
@tsmbland tsmbland self-assigned this Jun 10, 2024
@tsmbland tsmbland moved this from 📋 Backlog to 🔖 Ready in MUSE Jun 10, 2024
@tsmbland tsmbland changed the title Create minimal example database with SQLAlchemy Create minimal example database with SQLAlchemy and/or DuckDB Jun 17, 2024
@tsmbland tsmbland moved this from 🔖 Ready to 🏗 In progress in MUSE Jun 27, 2024
@tsmbland tsmbland linked a pull request Jun 28, 2024 that will close this issue
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: 🏗 In progress
Development

Successfully merging a pull request may close this issue.

2 participants