#126292 - Data Engineer

Hace 19 horas

Bogotá ciudad, Bogotá, Distrito Capital, Colombia Upwork Jornada completa $ 280 - $ 435 Por obra

Job Description

We are seeking a Data Engineer to design, build, and maintain scalable data pipelines, datasets, and automation systems that support cloud cost visibility, attribution, and performance insights.

Job Description

We are seeking a Data Engineer to design, build, and maintain scalable data pipelines, datasets, and automation systems that support cloud cost visibility, attribution, and performance insights. This role will work with large-scale telemetry, usage, and financial data to help Product, Engineering, and Finance stakeholders make informed, cost-aware decisions. The ideal candidate has strong hands‑on experience with cloud data engineering, AWS, Snowflake, production pipeline ownership, data quality, and performance and cost optimization.

Key Responsibilities

  • Design, build, and maintain reliable end-to-end ELT and ETL pipelines in cloud environments.
  • Build scalable datasets that support cloud cost visibility, attribution, usage analysis, and performance insights.
  • Design and implement data models and ingestion frameworks for large-scale telemetry and usage data.
  • Develop automation and tooling that enable cost‑aware decision‑making across Product, Engineering, and Finance teams.
  • Optimize data pipelines and systems for performance, reliability, and cost efficiency.
  • Perform query tuning and improve storage and compute strategies.
  • Build and maintain integrations with REST APIs and other data sources.
  • Implement and support CI/CD processes and Infrastructure as Code.
  • Ensure data quality, validation, auditability, and consistency across end-to-end data workflows.
  • Monitor, troubleshoot, and resolve production pipeline failures, data inconsistencies, and performance issues.
  • Partner with Engineering and Finance stakeholders on cloud cost optimization and usage‑based insights.

Qualifications

Must‑Have Skills

  • Strong data engineering foundation with proven experience building and maintaining end-to-end ELT or ETL pipelines in cloud environments.
  • Strong SQL and Python skills.
  • Experience with data workflow and orchestration tools such as dbt, Airflow, or Dagster.
  • Hands‑on experience with the AWS data ecosystem, including AWS Glue, Amazon Athena, and Amazon Aurora.
  • Experience with Snowflake.
  • Strong data modeling experience.
  • Experience processing data at scale.
  • Experience with CI/CD and version control.
  • Hands‑on Infrastructure as Code experience using Terraform.
  • Experience building or maintaining REST API integrations.
  • Demonstrated ability to optimize data pipelines for performance and cost.
  • Strong analytical and troubleshooting skills.
  • Experience with data validation, auditing, and production pipeline support.
  • Enterprise experience strongly preferred.

Nice‑to‑Have Skills

  • Scala experience.
  • FinOps Certified Practitioner or FinOps Certified Engineer certification.
  • Experience with cloud cost optimization, tagging strategies, or cost‑monitoring systems.
  • Experience working across both AWS and GCP.
  • Experience with Datadog.
  • Background in data platform engineering or shared infrastructure engineering.

Additional Information

Required Tools & Platforms

  • Python
  • SQL
  • AWS Glue
  • Amazon Athena
  • Amazon Aurora
  • Snowflake
  • dbt, Airflow, or Dagster
  • Terraform
  • CI/CD tooling
  • Git or another version-control platform
  • REST APIs

Location, Time & Engagement

  • Remote contract opportunity.
  • Candidates must be located in LATAM.
  • Full‑time allocation of approximately 40 hours per week.
  • Candidates must be available to work a U.S.-based EST or CST schedule.
  • Contract expected to continue through March 31, 2027.