Skip to content

neuraltanh/template-for-ETL

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ExtractTransformLoadTemplate

Template for Extract-Transform-Load ( ETL ).

Prerequisites

Running of this project locally requires the following tools to be present on the host system:

  • docker (version 23.05.0+)
  • docker compose (version 2.21.0+)

Development environment

To run development environment

  1. Go into docker/development/ folder
  2. Execute
docker compose up
  1. Open http://localhost:8000 in browser

Running tests

  1. Build development environment as described above
  2. Execute
docker exec -it etl-template-backend-development make

Admin Panel

Admin Panel is a tool for managing records in a database. The panel is available at http://localhost:8000/admin-panel.

Username: admin
Password: admin

API Documentation

API Documentation is available at http://localhost:8000/api/swagger/.

Working with repository

  1. backend folder must be marked as Sources Root in IDE to make imports work

About

A Python-based ETL template with Dockerized local development, admin panel, and Swagger API docs for building and testing data pipelines.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages