Boris Waaub
8a9966d84c
Suppression des fichiers README et script d'importation des tiers
2026-03-16 13:55:17 +01:00
Boris Waaub
ced84f50c2
Ajout d'un fichier de paramétrage Excel pour l'importation des données
2026-03-16 13:52:50 +01:00
Boris Waaub
04d1e35ba4
Ajout de la procédure automatisée pour l'importation des données et mise à jour des instructions dans le README
2026-03-16 13:50:06 +01:00
Boris Waaub
c388967ebd
feat: Enhance CSV import process and data cleanup
...
- Added support for importing 'periodes' data and adjusted related SQL scripts.
- Introduced a new SQL preparation script to set up the import schema.
- Updated the import_all_csv.sh script to handle new CSV files and tables.
- Implemented checks for required SQL files and improved error handling.
- Modified data types and structures in the import process for better consistency.
- Created a new remove-import-data.sql script to clean up imported data effectively.
- Enhanced the handling of postal codes and addresses in the import logic.
- Added comments and structured the SQL scripts for better readability and maintainability.
2026-03-16 13:48:12 +01:00
Boris Waaub
8481acfe5d
Ajout du fichier d'exemple de configuration pour la base de données PostgreSQL
2026-03-14 10:50:17 +01:00
Boris Waaub
5a90126f98
Ajout de la gestion des actions sociales dans l'importation des données et correction des colonnes dans les fichiers CSV
2026-03-14 10:50:10 +01:00
45755bf797
Correction of finding postcode + set the center postcode as coordinates for address without reference
2025-09-16 13:41:48 +02:00
08e87503f0
Correction: do not attribute center_id = 1 to person
2025-09-16 10:52:37 +02:00
20517a109b
Improved person import with the linkage to reference addresses
2025-09-02 12:42:29 +02:00
c17b2ae524
FIXED import person with the new gender entity
2025-09-02 11:03:35 +02:00
5bfc7f4a02
Small typos in import.sql
2025-08-29 13:01:54 +02:00
6b8ca0caa3
Add sql for third party
2025-08-14 18:14:13 +02:00
nobohan
c5f892c27d
FEATURE import users
2025-07-11 15:53:40 +02:00
nobohan
82f69f9845
FEATURE add sql for import location_type and location
2025-07-11 11:48:24 +02:00
nobohan
fd4e68faa8
FEATURE ajout reprise de localisations - prepare
2025-07-10 16:21:06 +02:00
nobohan
3651b1a09b
Improve/correct import SQL queries
2024-09-19 17:59:44 +02:00
nobohan
db52c72d22
Add another method to prepare the import tables
2024-09-17 15:37:16 +02:00
nobohan
9c90e5ac07
Add single python script for translating third party information into SQL
2024-02-16 09:48:07 +01:00
Mathieu Jaumotte
543a4569fd
update script with resinam troubles
2023-05-05 17:16:30 +02:00
Mathieu Jaumotte
36e3bf3b4b
modifs mineures du canevas sur les headers (v0.6.1)
2023-03-15 17:02:35 +01:00
Mathieu Jaumotte
ddfe9b53b3
Merge branch 'dev'
2023-03-15 13:25:29 +01:00
Mathieu Jaumotte
cea5190174
update readme
2023-03-15 13:24:52 +01:00
Mathieu Jaumotte
ca3ce608c0
Merge branch 'dev'
2023-03-15 10:25:12 +01:00
Mathieu Jaumotte
f3bda2a22e
add readme
2023-03-15 10:24:39 +01:00
Mathieu Jaumotte
4e866c2d8e
Merge branch 'dev'
2023-03-14 12:21:17 +01:00
Mathieu Jaumotte
6b11efd18e
add v0.6.0 of excel canvas
2023-03-14 12:20:28 +01:00
Mathieu Jaumotte
290a9b917f
Things to think when running script
2023-03-14 12:05:52 +01:00
Mathieu Jaumotte
b68e0399cc
62-63. Add and link comments to periods, pin last comment
2023-03-11 16:53:26 +01:00
Mathieu Jaumotte
07df6c4292
default value for socialissue_id, user_id, scope_id
2023-03-11 16:50:11 +01:00
Mathieu Jaumotte
d9152fc090
60. Link jobs to periods
2023-03-11 15:30:28 +01:00
Mathieu Jaumotte
12f0ec0ae4
59. Link origin to periods
2023-03-11 15:30:24 +01:00
Mathieu Jaumotte
264fdb5888
58. Link scopes to periods
2023-03-11 15:29:53 +01:00
Mathieu Jaumotte
7893eb3c81
57. Link referrer to periods
2023-03-11 13:43:44 +01:00
Mathieu Jaumotte
1adf47e63e
56. Link socialissues to periods
2023-03-11 13:42:38 +01:00
Mathieu Jaumotte
314e625c91
55. Copy period in period_location_history
2023-03-10 19:58:25 +01:00
Mathieu Jaumotte
59daee4790
53-54. Link period to person or temporary address location
2023-03-10 19:27:31 +01:00
Mathieu Jaumotte
6900d66206
52. Link participations to periods
2023-03-10 18:32:09 +01:00
Mathieu Jaumotte
f513dd1b36
Add a setval() query after INSERT INTO when id is not nextval()
2023-03-10 17:53:05 +01:00
Mathieu Jaumotte
67d020d322
50-51. Insert in accompanyingPeriods table
2023-03-10 17:51:58 +01:00
Mathieu Jaumotte
477565f6e1
Improve undo delete clause to avoid removing still referenced rows
...
(foreign key constraint violation)
2023-03-10 16:51:23 +01:00
Mathieu Jaumotte
e569d77bd2
Fix WHERE jsonb comparison
2023-03-10 16:20:58 +01:00
Mathieu Jaumotte
0ab77b77ed
improve setval id if remove all rows
2023-03-10 16:18:51 +01:00
Mathieu Jaumotte
307cfcbe74
46. Add household composition
2023-03-10 16:17:27 +01:00
Mathieu Jaumotte
081ce76085
renaming alias
2023-03-10 16:16:27 +01:00
Mathieu Jaumotte
cadcddddb5
Improve date management for not specified dates
...
- use real import date for person createdat field
- use year first day for not specified startdate, comment date, etc.
2023-03-10 13:21:31 +01:00
Mathieu Jaumotte
dd3769e2a0
use validfrom in address insertion
2023-03-10 12:55:53 +01:00
Mathieu Jaumotte
1cc1b83435
add gendercomment in person insertion
2023-03-10 12:45:23 +01:00
Mathieu Jaumotte
9ac2553eb0
Fix phone numbers format
2023-03-10 12:16:51 +01:00
Mathieu Jaumotte
0c7ea76178
42. Insert query bloc for center history insertion
2023-03-08 23:44:39 +01:00
Mathieu Jaumotte
5f78276762
Rename aliases in undo queries
2023-03-08 23:43:47 +01:00