Commit Graph

Select branches

Hide Pull Requests

dags

dashboard

dbt-dlt

main

Mono Color

• ec19534094 chore: add pyproject dags Bertrand Benjamin 2025-03-02 18:06:43 +01:00
• d4428187d1 Feat: add tests Bertrand Benjamin 2025-03-02 18:04:50 +01:00
• 9118feb4c6 refact: use flux_id instead of name Bertrand Benjamin 2025-01-19 14:59:47 +01:00
• d7716a4b8e Feat: add table logs retreiving Bertrand Benjamin 2025-01-19 06:47:16 +01:00
• 478a8c2403 Feat: register table modifications Bertrand Benjamin 2025-01-18 07:31:30 +01:00
• 8882317a47 Feat: add listing fluxes Bertrand Benjamin 2025-01-17 06:29:54 +01:00
• 2a387a1bc8 Feat: retrieve last log Bertrand Benjamin 2025-01-15 18:12:11 +01:00
• eec3a13dbb refact: rename metadata to log Bertrand Benjamin 2025-01-15 18:01:30 +01:00
• 8623cd5960 Feat: read and write flux logs Bertrand Benjamin 2025-01-15 17:48:44 +01:00
• 543b3fe98e Feat: start working on metadata_repository Bertrand Benjamin 2025-01-15 06:56:46 +01:00
• 1a49158afa refact: move repository to data_repository Bertrand Benjamin 2025-01-14 07:00:19 +01:00
• bb691acc14 refact: rename parameters in converting to graph function Bertrand Benjamin 2025-01-11 06:35:40 +01:00
• 90472ac868 Feat: use fonction to build graphs Bertrand Benjamin 2025-01-06 07:12:08 +01:00
• 0ae6439217 refact: replace edge_kwrds with metadata in models Bertrand Benjamin 2025-01-05 18:40:19 +01:00
• 2f170d91b6 test: add test on graph for dataplatform Bertrand Benjamin 2025-01-05 18:27:26 +01:00
• 5ebde14be9 Feat: add to_graph and is_valid_dag for graph_set Bertrand Benjamin 2025-01-05 16:42:57 +01:00
• 44a7eed5b4 feat: build dataplatform graph and graphset dynamicaly Bertrand Benjamin 2025-01-05 16:25:22 +01:00
• f2ed76c8aa feat: add node in graphset when add flux Bertrand Benjamin 2025-01-05 15:55:50 +01:00
• 041e459ca0 refact: move id and name to flux Bertrand Benjamin 2025-01-05 15:50:51 +01:00
• e4af62b136 refact: move Transformation to flux model Bertrand Benjamin 2025-01-05 15:43:29 +01:00
• 9a5c581f31 refact: move Node, Edge and EdgeOnSet to models Bertrand Benjamin 2025-01-05 15:37:56 +01:00
• 09783f9c1e Feat: flux takes list of tables for sources and targets Bertrand Benjamin 2025-01-05 15:31:40 +01:00
• 8a43a93cda refact: repo id are not based on path but on id Bertrand Benjamin 2025-01-05 15:13:38 +01:00
• ae61fd3c12 refact: use repository id in dataplatform Bertrand Benjamin 2025-01-05 14:55:46 +01:00
• d256fbf169 Fix: repo id use tests Bertrand Benjamin 2025-01-05 14:34:16 +01:00
• 48964ad561 Feat: use id in repository Bertrand Benjamin 2025-01-05 11:27:52 +01:00
• b9dade2701 Feat: add extract_values_from_pattern Bertrand Benjamin 2025-01-05 10:46:30 +01:00
• ed8f91d78b Feat: add tables method to fs_repository Bertrand Benjamin 2025-01-05 07:01:03 +01:00
• d1c1b7420d refact: replace callback with str for arrow in graph_set Bertrand Benjamin 2025-01-05 06:51:14 +01:00
• f0315d09b9 refact: reorganize raw_datas and adapt tests Bertrand Benjamin 2025-01-05 06:42:51 +01:00
• 86f0dcc49e Feat: execute flux on dataplatform Bertrand Benjamin 2025-01-04 21:33:05 +01:00
• d04bfe1d44 Feat: add execute_flux Bertrand Benjamin 2025-01-04 15:30:32 +01:00
• 1446c166ca Feat: add flux in dataplatform Bertrand Benjamin 2025-01-04 13:51:24 +01:00
• beb9fd5465 Feat: add repository to dataplatform Bertrand Benjamin 2025-01-03 16:01:01 +01:00
• 78d6ac12bf Fix: remove recursive schemas for fs repository Bertrand Benjamin 2025-01-03 16:00:40 +01:00
• 350c03dbfe Fix: adapt to new Table form Bertrand Benjamin 2025-01-03 15:56:29 +01:00
• e28ab332a7 feat: move fs_datacatalogue to fs_repository Bertrand Benjamin 2025-01-03 15:54:18 +01:00
• fe780b96ef Refact: change method to access to schema an tables Bertrand Benjamin 2025-01-03 09:53:25 +01:00
• c2813e5adb refact: move fs_files to raw_datas Bertrand Benjamin 2025-01-03 09:16:22 +01:00
• f3036ca40d doc: explain concepts Bertrand Benjamin 2025-01-03 09:07:48 +01:00
• 86912c6d3f clean: remove makefile Bertrand Benjamin 2025-01-03 09:00:44 +01:00
• 646b3cfd92 feat: start datacatalogue Bertrand Benjamin 2025-01-03 08:59:54 +01:00
• db14b4a49a Feat: activate uv Bertrand Benjamin 2025-01-03 08:59:38 +01:00
• 9d45625a5e Feat: move to models and add consume_flux Bertrand Benjamin 2024-11-06 07:00:15 +01:00
• 07fb92e2fa Feat: create fs_datacatalogue Bertrand Benjamin 2024-11-05 06:55:05 +01:00
• 88795fdad3 Feat: create datacatalogue with fs_datacatalogue Bertrand Benjamin 2024-11-03 10:40:23 +01:00
• aa1ead5435 refact: move graph libs to own directory Bertrand Benjamin 2024-10-28 05:38:26 +01:00
• c347deee85 Feat: test on pandas xlsx and ods file reader Bertrand Benjamin 2024-10-07 05:27:46 +02:00
• 5dfc1c9751 Feat: start testing fs_repository Bertrand Benjamin 2024-08-14 10:44:38 +02:00
• 7fc10128da Feat: test consume_flux Bertrand Benjamin 2024-08-14 07:41:36 +02:00
• fe8f76245b Feat: start flux Bertrand Benjamin 2024-08-14 07:22:01 +02:00
• d613bf00df Feat: add __init__ and mod function signature Bertrand Benjamin 2024-08-14 07:21:36 +02:00
• 8a03ba8329 refact: rename stage to repository Bertrand Benjamin 2024-08-07 11:39:33 +02:00
• 8774ec11e4 Feat: put table's callback and layout in factory Bertrand Benjamin 2024-07-28 18:49:07 +02:00
• 30913a2cea Feat: callback to toggle editing Bertrand Benjamin 2024-07-28 17:34:56 +02:00
• 159b4a8275 Feat: add navigation Bertrand Benjamin 2024-07-28 12:29:14 +02:00
• 3c1d275634 feat: organise router path Bertrand Benjamin 2024-07-27 19:19:36 +02:00
• 8313323ca1 feat: global design Bertrand Benjamin 2024-07-27 18:45:20 +02:00
• 12e5dce1b4 feat: add tailwindcss Bertrand Benjamin 2024-07-27 18:21:42 +02:00
• 2f25c219af feat: add recursive schema Bertrand Benjamin 2024-07-27 17:50:29 +02:00
• 13f80d8553 feat: add schema and table listing Bertrand Benjamin 2024-07-27 17:39:09 +02:00
• a533443caf feat: init dashboard Bertrand Benjamin 2024-07-27 15:55:20 +02:00
• 226ce84dce Feat: add is_dag to Graph Bertrand Benjamin 2024-10-27 14:10:33 +01:00
• 9ff68cb285 Feat: add get functions on sources and targets Bertrand Benjamin 2024-10-27 13:48:37 +01:00
• 5c69bb5503 Feat: add pure graph Bertrand Benjamin 2024-10-07 06:17:01 +02:00
• c90f407cfc Feat: init graphs Bertrand Benjamin 2024-10-07 06:09:01 +02:00
• 867747d748 Fix: filename Bertrand Benjamin 2024-10-07 06:08:52 +02:00
• e794242a03 Feat: test on pandas xlsx and ods file reader dashboard Bertrand Benjamin 2024-10-07 05:27:46 +02:00
• 5450de8628 Feat: start testing fs_repository Bertrand Benjamin 2024-08-14 10:44:38 +02:00
• 08c7fbe4c5 Feat: test consume_flux Bertrand Benjamin 2024-08-14 07:41:36 +02:00
• 959b53e6a0 Feat: start flux Bertrand Benjamin 2024-08-14 07:22:01 +02:00
• 91e229eab2 Feat: add __init__ and mod function signature Bertrand Benjamin 2024-08-14 07:21:36 +02:00
• 2de0e5ef5c refact: rename stage to repository Bertrand Benjamin 2024-08-07 11:39:33 +02:00
• 7fb7bc6f5c Feat: put table's callback and layout in factory Bertrand Benjamin 2024-07-28 18:49:07 +02:00
• 612df0a8eb Feat: callback to toggle editing Bertrand Benjamin 2024-07-28 17:34:56 +02:00
• 74882ae572 Feat: add navigation Bertrand Benjamin 2024-07-28 12:29:14 +02:00
• d8f2fb52e1 feat: organise router path Bertrand Benjamin 2024-07-27 19:19:36 +02:00
• f9bfb917bd feat: global design Bertrand Benjamin 2024-07-27 18:45:20 +02:00
• cdad13788a feat: add tailwindcss Bertrand Benjamin 2024-07-27 18:21:42 +02:00
• 29c82ae597 feat: add recursive schema Bertrand Benjamin 2024-07-27 17:50:29 +02:00
• 5b53630688 feat: add schema and table listing Bertrand Benjamin 2024-07-27 17:39:09 +02:00
• ed6d1c87d1 feat: init dashboard Bertrand Benjamin 2024-07-27 15:55:20 +02:00
• 4249e902b2 Feat: add *.duckdb in gitignore dbt-dlt Bertrand Benjamin 2024-06-18 06:30:27 +02:00
• ab36931c06 Feat: create pdf ingest pipeline Bertrand Benjamin 2024-06-18 06:26:51 +02:00
• 1ed6ed43ed Feat: add commands in makefile main Bertrand Benjamin 2024-06-11 17:54:25 +02:00
• 215e26b84f Feat: adapt to new excel format Bertrand Benjamin 2024-04-15 11:59:45 +02:00
• b60fa3be17 Feat: add excel export for mart Bertrand Benjamin 2024-04-15 11:59:32 +02:00
• a1578f813b Feat: cleaning Bertrand Benjamin 2024-04-12 08:57:23 +02:00
• d872cd7681 Feat: random things Bertrand Benjamin 2024-03-13 21:06:39 +01:00
• bfebd6b58a Fix: 2023 lot calculation Bertrand Benjamin 2024-03-13 21:06:23 +01:00
• e2805f9af2 Feat: write cli feature, datamart Bertrand Benjamin 2024-03-05 19:20:33 +01:00
• 98691d5531 Feat: start CLI Bertrand Benjamin 2024-03-05 19:00:45 +01:00
• c6932c364b Feat: move assign Lot to featured Bertrand Benjamin 2024-03-05 19:00:17 +01:00
• 05430196d0 Feat: add some print (before logging) Bertrand Benjamin 2024-03-05 18:59:55 +01:00
• 78576270db Feat: adapt to new models Bertrand Benjamin 2024-03-05 18:59:01 +01:00
• 4cc9e7b038 Fix: lot transformation Bertrand Benjamin 2024-03-04 20:09:20 +01:00
• dd0d8af40c Refact: flux have 3 components source, tranformation, destination Bertrand Benjamin 2024-03-03 08:05:25 +01:00
• fcff40adb7 Feat: make lot mart Bertrand Benjamin 2024-03-03 07:46:36 +01:00
• dec284bde1 Fix: recursive call for extract_sources Bertrand Benjamin 2024-03-03 07:15:34 +01:00
• d0961b0909 Feat: add destination in flux definition Bertrand Benjamin 2024-03-03 07:05:10 +01:00