champs-libres/chill-import-from-canvas
7
0
Fork 0
Code Issues 1 Pull Requests Packages Projects Releases Wiki Activity
74 Commits 3 Branches 0 Tags
c388967ebdcd55a8ee49b52ef344d2d41e09c25e
Commit Graph

61 Commits

Author SHA1 Message Date
Boris Waaub
c388967ebd feat: Enhance CSV import process and data cleanup 
- Added support for importing 'periodes' data and adjusted related SQL scripts.
- Introduced a new SQL preparation script to set up the import schema.
- Updated the import_all_csv.sh script to handle new CSV files and tables.
- Implemented checks for required SQL files and improved error handling.
- Modified data types and structures in the import process for better consistency.
- Created a new remove-import-data.sql script to clean up imported data effectively.
- Enhanced the handling of postal codes and addresses in the import logic.
- Added comments and structured the SQL scripts for better readability and maintainability.
 2026-03-16 13:48:12 +01:00
Boris Waaub
5a90126f98 Ajout de la gestion des actions sociales dans l'importation des données et correction des colonnes dans les fichiers CSV 2026-03-14 10:50:10 +01:00
nobohan
45755bf797 Correction of finding postcode + set the center postcode as coordinates for address without reference 2025-09-16 13:41:48 +02:00
nobohan
08e87503f0 Correction: do not attribute center_id = 1 to person 2025-09-16 10:52:37 +02:00
nobohan
20517a109b Improved person import with the linkage to reference addresses 2025-09-02 12:42:29 +02:00
nobohan
c17b2ae524 FIXED import person with the new gender entity 2025-09-02 11:03:35 +02:00
nobohan
5bfc7f4a02 Small typos in import.sql 2025-08-29 13:01:54 +02:00
julien
6b8ca0caa3 Add sql for third party 2025-08-14 18:14:13 +02:00
nobohan
c5f892c27d FEATURE import users 2025-07-11 15:53:40 +02:00
nobohan
82f69f9845 FEATURE add sql for import location_type and location 2025-07-11 11:48:24 +02:00
nobohan
3651b1a09b Improve/correct import SQL queries 2024-09-19 17:59:44 +02:00
Mathieu Jaumotte
543a4569fd update script with resinam troubles 2023-05-05 17:16:30 +02:00
Mathieu Jaumotte
290a9b917f Things to think when running script 2023-03-14 12:05:52 +01:00
Mathieu Jaumotte
b68e0399cc 62-63. Add and link comments to periods, pin last comment 2023-03-11 16:53:26 +01:00
Mathieu Jaumotte
07df6c4292 default value for socialissue_id, user_id, scope_id 2023-03-11 16:50:11 +01:00
Mathieu Jaumotte
d9152fc090 60. Link jobs to periods 2023-03-11 15:30:28 +01:00
Mathieu Jaumotte
12f0ec0ae4 59. Link origin to periods 2023-03-11 15:30:24 +01:00
Mathieu Jaumotte
264fdb5888 58. Link scopes to periods 2023-03-11 15:29:53 +01:00
Mathieu Jaumotte
7893eb3c81 57. Link referrer to periods 2023-03-11 13:43:44 +01:00
Mathieu Jaumotte
1adf47e63e 56. Link socialissues to periods 2023-03-11 13:42:38 +01:00
Mathieu Jaumotte
314e625c91 55. Copy period in period_location_history 2023-03-10 19:58:25 +01:00
Mathieu Jaumotte
59daee4790 53-54. Link period to person or temporary address location 2023-03-10 19:27:31 +01:00
Mathieu Jaumotte
6900d66206 52. Link participations to periods 2023-03-10 18:32:09 +01:00
Mathieu Jaumotte
f513dd1b36 Add a setval() query after INSERT INTO when id is not nextval() 2023-03-10 17:53:05 +01:00
Mathieu Jaumotte
67d020d322 50-51. Insert in accompanyingPeriods table 2023-03-10 17:51:58 +01:00
Mathieu Jaumotte
477565f6e1 Improve undo delete clause to avoid removing still referenced rows 
(foreign key constraint violation)
 2023-03-10 16:51:23 +01:00
Mathieu Jaumotte
e569d77bd2 Fix WHERE jsonb comparison 2023-03-10 16:20:58 +01:00
Mathieu Jaumotte
0ab77b77ed improve setval id if remove all rows 2023-03-10 16:18:51 +01:00
Mathieu Jaumotte
307cfcbe74 46. Add household composition 2023-03-10 16:17:27 +01:00
Mathieu Jaumotte
081ce76085 renaming alias 2023-03-10 16:16:27 +01:00
Mathieu Jaumotte
cadcddddb5 Improve date management for not specified dates 
- use real import date for person createdat field
- use year first day for not specified startdate, comment date, etc.
 2023-03-10 13:21:31 +01:00
Mathieu Jaumotte
dd3769e2a0 use validfrom in address insertion 2023-03-10 12:55:53 +01:00
Mathieu Jaumotte
1cc1b83435 add gendercomment in person insertion 2023-03-10 12:45:23 +01:00
Mathieu Jaumotte
9ac2553eb0 Fix phone numbers format 2023-03-10 12:16:51 +01:00
Mathieu Jaumotte
0c7ea76178 42. Insert query bloc for center history insertion 2023-03-08 23:44:39 +01:00
Mathieu Jaumotte
5f78276762 Rename aliases in undo queries 2023-03-08 23:43:47 +01:00
Mathieu Jaumotte
5a6daae5a4 43-44. Insert household and link to person, address, position 2023-03-08 21:20:52 +01:00
Mathieu Jaumotte
3978ee8b1a Fix WHERE jsonb comparison 2023-03-08 21:20:47 +01:00
Mathieu Jaumotte
838bcb78ff 33-34 Fix phone format 2023-03-08 21:08:02 +01:00
Mathieu Jaumotte
f3170d0c87 cleaning 2023-03-08 18:16:55 +01:00
Mathieu Jaumotte
1a6f3953ca 42. Add address, and link it to person 2023-03-01 21:20:49 +01:00
Mathieu Jaumotte
139dd6209a 33-34. Format phone numbers 2023-03-01 20:57:25 +01:00
Mathieu Jaumotte
25510c1efe fix query for person insertion 2023-03-01 20:56:53 +01:00
Mathieu Jaumotte
a36ee22be6 fix numberofchildren cast 2023-03-01 17:34:47 +01:00
Mathieu Jaumotte
b6f26900a7 20-32. Prepare import personnes and periodes tables 2023-03-01 17:18:00 +01:00
Mathieu Jaumotte
dd89aa6ff1 improve title comment block 2023-02-17 19:43:57 +01:00
Mathieu Jaumotte
4dc09c559a fix setval with coalesce (reset id too if no rows) 2023-02-17 19:28:00 +01:00
Mathieu Jaumotte
cb12f3000b 13. Complete chill_person_social_issue table 2023-02-17 19:23:38 +01:00
Mathieu Jaumotte
e14f6896e3 12. complete users table (referrer) 2023-02-17 19:23:38 +01:00
Mathieu Jaumotte
7b4f04ef40 11. complete scopes table 2023-02-17 19:22:45 +01:00