Commit graph

13 commits

Author SHA1 Message Date
484c8b34c8 Fix issues with Summon and Weapon importers 2025-01-13 05:07:24 -08:00
fab7b94655 Final ASCII changes 2025-01-13 04:53:16 -08:00
aa82929925 Change some ASCII characters 2025-01-12 22:35:20 -08:00
dbe77ef949 More logging adjustments
Trying to get a nice-looking output
2025-01-12 20:21:24 -08:00
21f9b5c6c8 Clean up logs with LoggingHelper 2025-01-12 19:50:15 -08:00
d16680c8ec Rebuild search indices in post deploy 2025-01-12 19:03:39 -08:00
901a7398fa Updates only require values that will change
When updating a row, fields that don't have a provided value will not be changed
2025-01-12 19:03:25 -08:00
7c42693db1 Modify importer to handle updates
This way we can also add FLBs and other uncaps easier.
2025-01-12 17:27:06 -08:00
e287176873 Create download_manager.rb
Creates an appropriate downloader for each Granblue ID it receives
2025-01-12 16:04:46 -08:00
577e597864 Create data_importer.rb
* Fetches a list of all CSV files present in the updates folder
* Checks which have already been imported
* Sends unimported data to the appropriate Importer to handle
2025-01-12 16:04:13 -08:00
551c2609b0 Add downloaders
Downloaders take Granblue IDs and download images for those items from the Granblue Fantasy server in all relevant sizes.

Downloaders can download to disk or stream the file directly to S3.
2025-01-12 16:02:51 -08:00
9099849ee3 Add importers
The Importer libraries take CSV data and import them into the database for each type. We currently support characters, summons and weapons.
2025-01-12 16:01:52 -08:00
5668c5c686 Add aws-sdk-s3 and create aws_service.rb
AwsService handles streaming game image files from the Granblue Fantasy server to our S3 instance.
2025-01-12 16:01:06 -08:00