STEPS all tables go in schema: prod.spot_metadata Ultimately, we want to hit the API for a playlist, check if it has changed since we last hit the api, if not do nothing, if yes, download the data. Thus, Lets keep a running table, spot_metadata.all_playlist_uris Playlist_URI (PK) | Latest_SnapshotID | Last_updated this will be different from a database that contains all the different snapshots per playlist this table will have only one row (and hence one snapshot) per playlist playlists for which we have never downloaded the data will have a NULL snapshot 1. Get all the Playlists & Snapshots from spot_metadata.all_playlist_uris 2. Hit the API and check the latest snapshot id a. get an oath token b. create an API call from the current uri