# Spotify Weekly Market Share ETL

## To Set Up

* Set up the local env 

```bash
$ python -m venv env
$ source env/bin/activate
$ pip install -r requirements.txt
$ cp .env.shadow .env
```
* Load your AWS keys into `.env` file
* Run:

```bash
$ source .env
```

* Add your AWS and Snowflake credentials to the `config.py` file. 
* You can update the Snowflake Database/Schema in the `config.py` if you wish

## To Use

* Create a new directory called `archive` and create subfolder `preprocessed` and 
`processed`
* Upload raw xlsx file to the directory `archive/preprocessed`
* Update `INGEST_WEEK` value in `spotify_weekly_ms_ingest.py` (and  `INGEST_YEAR` 
if neccessary)
* Run `python spotify_spotify_weekly_ms_ingest.py`