Maker Logs - Day 653
Written by Basile Samel
Published Aug 28, 2020. Last edited Aug 28, 2020.
Cowriters
- I migrated the PHP logic of the text editor (models, controllers) to NodeJS and rewrote the React components to use React Hooks instead of the traditional Oriented-Object Programming design. It makes the code easier to read and build upon.
- I had to rewrite the debounced autosave feature to use the useCallback hook, or it wouldn’t work otherwise.
- I rewrote the extraction phase of the data migration process to use a remote MySQL connection I configured instead of a local JSON file. It increases the speed of the import process (no need to log in phpmyadmin and export the data manually as a JSON file), doesn’t overwhelm the database management system with queries, and makes it easier to recover if a download error were to happen (the file is 300Mb and my Internet connection is slow).
- I broke down the database requests by table and by group of 2,000 rows. Each request is staged locally in a JSON file to be transformed and loaded in the target database.
Writing
- Wrote “Database Migration With ETL”
- Wrote my daily log
Total tasks: 6
Mood: Good
Improvement Points: Need to find some time some day to make this little ETL process a fully-configurable script I can use in other projects.