# Data Pipeline Development (ETL/ELT)

> Selected work demonstrating this service.

- [Designed a comprehensive infrastructure framework for DTU impacting 14 departments, featuring flexible modules, unified data pipelines, and structured support strategies for long‑term adoption.](https://software.engineer.company/portfolio/designed-a-comprehensive-infrastructure-framework-for-dtu-impacting-3/)
- [Accelerated geographical data pipeline performance by 50x by improving SQL programming and data modeling across PostgreSQL, MS SQL, and Google Cloud BigQuery.](https://software.engineer.company/portfolio/accelerated-geographical-data-pipeline-performance-by-50x-by-5/)
- [Resolved 1,000 issues in geographical data and time‑series data, using GDAL, ArcGIS, PostGIS, Mapbox, QGIS, SQL (PL/pgSQL, Transact‑SQL), Bash, ensuring high‑quality big data processing.](https://software.engineer.company/portfolio/resolved-1-000-issues-in-geographical-data-and-7/)
- [Designed, implemented, and administered 6 ETL/ELT pipelines, utilizing Google BigQuery, MSSQL, PostgreSQL, Shell scripting, PL/pgSQL, and Transact‑SQL, integrating data for efficient Python API processing.](https://software.engineer.company/portfolio/designed-implemented-and-administered-6-etl-elt-pipelines-8/)
- [Automated GIS SaaS application deployment, data processing, and reporting system using GitHub Actions CI/CD, Python, Bash, and SQL.](https://software.engineer.company/portfolio/automated-gis-saas-application-deployment-data-processing-and-16/)
- [Automated delivery of 20 GIS data pipelines and app data ETL processes, streamlining infrastructure automation and reporting.](https://software.engineer.company/portfolio/automated-delivery-of-20-gis-data-pipelines-and-17/)
- [Led the development, deployment, and support of over 30 GIS projects, demonstrating expertise in PostgreSQL, Bash, Python, JavaScript, GDAL, ArcGIS, PostGIS, and Mapbox technologies.](https://software.engineer.company/portfolio/led-the-development-deployment-and-support-of-over-35/)
- [Architected, developed, implemented, supported infrastructure, data processing, and the map application for 2 years non‑stop without any weekends, holidays, or vacations, 10–14 hours a day.](https://software.engineer.company/portfolio/architected-developed-implemented-supported-infrastructure-data-processing-and-55/)
- [Built the Python vessel‑data scrapers (MarineTraffic, Maritime‑Database) and a repeatable import that seeds the platform's reference data — 184,197 rows, including 698 companies and 56,149 vessels.](https://software.engineer.company/portfolio/built-a-python-vessel-data-scraper-marinetraffic-maritime-66/)
- [Generated 495 achievement pages across three languages from a read‑only SQLite export, with the page address authored as data so that correcting a sentence no longer moved the page and broke the link.](https://software.engineer.company/portfolio/generated-321-achievement-pages-from-a-sqlite-export-132/)

<https://software.engineer.company/services/data-pipeline-development/>
