During the meeting, the team discussed the concept of storing data in a JSON file and whether it was a good idea to have a temporary holding area for the file. They also discussed the potential issues that could arise if something went wrong during the parsing process and the importance of saving the original data. The team agreed that storing the JSON file in a text field with low overhead was a reasonable solution. They also talked about the challenge of handling a large amount of data and the potential need for scaling. The team suggested using a relational database and mentioned the benefits of using a data processing-oriented stack like Rosano. The meeting ended with positive feedback for the helpfulness of the discussion.
(Source: Office Hours 4/14 )
