Senior Python Data Engineer

hace 2 semanas


Colombia Lean Tech A tiempo completo

Company Overview:

Lean Tech is a rapidly expanding organization with a strong presence in Latin America and the United States. We pride ourselves on our influential network within software development and IT services, serving the entertainment, financial, and logistics sectors. Our corporate projections offer numerous opportunities for professionals to advance their careers and experience significant growth.

Position Title: Senior Data Engineer

Location: Remote - LATAM

Job Responsibilities:

The Senior Data Engineer will be responsible for designing, developing, and maintaining data processes. They will work closely with data scientists, analysts, and other engineering teams to define, implement, and maintain high-performance data infrastructure. Key responsibilities include:

  1. Designing and optimizing scalable ETL pipelines using Apache Spark on Amazon EMR.
  2. Collaborating with stakeholders to understand business requirements and translate them into technical solutions.
  3. Developing and maintaining automated data workflows and processes for efficient data ingestion, transformation, and loading.
  4. Implementing best practices for data engineering, including monitoring, logging, and alerting for data pipelines.
  5. Optimizing performance of data processing jobs and troubleshooting issues with large-scale distributed systems.
  6. Driving innovation in data infrastructure, evaluating and integrating new tools, frameworks, and approaches.

Requirements & Qualifications:

To excel in this role, you should possess:

  1. 5+ years of experience in data engineering, with at least 3+ years working with Apache Spark and Amazon EMR.
  2. Strong programming skills in Python and Scala with a focus on performance tuning and optimization for Spark jobs.
  3. Proven experience working with SQL for data management, querying, and optimization.
  4. Deep understanding of distributed computing concepts, data partitioning, and resource management in large-scale data processing systems.
  5. Proficiency in building and maintaining ETL pipelines for structured and unstructured data.
  6. Hands-on experience with AWS services such as S3, Lambda, EMR, Glue, and RDS.
  7. Strong problem-solving skills and ability to debug complex systems.

Preferred Qualifications:

Experience with DevOps practices, including CI/CD, infrastructure as code (e.g., Terraform, CloudFormation), and containerization (e.g., Docker). Experience with Kubernetes and container orchestration for Spark jobs. Familiarity with streaming data processing using tools like Kafka, Kinesis, or Flink. Experience with modern data lake architectures, including Delta Lake or Iceberg. AWS Certification (e.g., AWS Certified Big Data – Specialty, AWS Certified Solutions Architect) is a plus.

Why Lean Tech:

  1. Join a powerful tech workforce and contribute to shaping the data landscape within a dynamic and growing organization.
  2. Professional development opportunities with international customers.
  3. Collaborative work environment.
  4. Career path and mentorship programs that will lead to new levels.

Lean Tech is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.


  • Senior Data Engineer

    hace 2 semanas


    Colombia AgileEngine, LLC A tiempo completo

    Key ResponsibilitiesWe are seeking a highly skilled professional to join our team as a Senior/Lead BI Engineer. The successful candidate will be responsible for assessing and analyzing large datasets, including census, eligibility, medical, and Rx claims data.Key SkillsProficiency in Azure, Python, and PostgresExperience with data visualization tools such as...

  • Senior Data Engineer

    hace 4 meses


    Colombia Blankfactor A tiempo completo

    It's fun to work in a company where people truly BELIEVE in what they're doing! We're committed to bringing passion and customer focus to the business. About us At Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale. In...

  • Senior Data Engineer

    hace 4 meses


    Colombia Blankfactor A tiempo completo

    It's fun to work in a company where people truly BELIEVE in what they're doing! We're committed to bringing passion and customer focus to the business. About us At Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale. In...

  • Senior Data Engineer

    hace 5 meses


    Colombia Provectus IT, Inc. A tiempo completo

    **Senior Data Engineer**: Medellín, Antioquia, Bogotá, Capital District, San Jose **About project** We are seeking a talented and experienced** Senior Data Engineer** to join our team at Provectus. You will encounter numerous technical challenges and have the opportunity to contribute to exciting open-source projects (e.g., ODD, UI for Kafka), build...


  • Colombia Lean Tech A tiempo completo

    Company Overview: Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer many opportunities for professionals to elevate their...


  • Colombia Sombra A tiempo completo

    Medellin Ukraine Hybrid Remote **Middle Python/Data Engineer** - Our client is a private investment company based in the United States that specializes in agriculture and food-related investments. - There’s a need for the Plotly Dash Engineer for the inner product which will handle the migration from the previous, 4th version of Plotly to the latest...

  • Cloud Data Engineer

    hace 2 semanas


    Colombia Mechanized AI Inc. A tiempo completo

    Job Title: Senior Cloud Backend EngineerJob Summary:We are seeking a highly skilled Senior Cloud Backend Engineer to join our team at Mechanized AI Inc. As a key member of our engineering team, you will be responsible for designing and building cloud architectures for data-centric products end-to-end. Your expertise in Python, Flask, and cloud platforms such...

  • Cloud Data Engineer

    hace 2 semanas


    Colombia Mechanized AI A tiempo completo

    Job Title: Senior Cloud Backend EngineerJob Type: Full-TimeLocation: Remote (Any Location)Company Overview:Mechanical AI is a pioneer in AI innovation, leveraging cutting-edge technology to transform legacy systems into modern, efficient, and scalable solutions. We collaborate with enterprise clients to breathe life into their existing software, ensuring...

  • Cloud Data Engineer

    hace 8 horas


    Colombia Mechanized AI Inc. A tiempo completo

    Job Title: Senior Cloud Backend EngineerJob Type: Full-TimeLocation: Remote (Any Location)Company Overview:Mechanical AI Inc. is a pioneering force in AI innovation, leveraging cutting-edge technology to transform legacy systems into modern, efficient, and scalable solutions. We collaborate with enterprise clients to breathe life into their existing...


  • Colombia AgileEngine, LLC A tiempo completo

    Job SummaryWe are seeking a highly skilled Senior/Lead Data Orchestration Engineer to join our team at AgileEngine, LLC. As a key member of our data engineering team, you will be responsible for designing and implementing data pipelines, ensuring data quality, and collaborating with cross-functional teams to drive business outcomes.Key ResponsibilitiesData...

  • Data Engineer

    hace 2 semanas


    Colombia Celes A tiempo completo

    About Celes: Celes is at the forefront of revolutionizing the retail industry through data-intensive cloud solutions, leveraging advanced analytics and artificial intelligence. Our mission is to provide actionable insights for retail companies. We boast a compact yet highly proficient team of developers dedicated to innovating solutions for...

  • Data Engineer

    hace 4 meses


    Colombia ttg Talent Solutions A tiempo completo

    **JOB TITLE**:Data Engineer **LOCATION**:Medellín - Colombia **TYPE**:Full-Time **SCHEDULE**:Hybrid (3 days on-site / 2 days remote per week) **DESCRIPTION**:The Data Engineer III will be responsible for the design, development, and maintenance of our data infrastructure, with a strong emphasis on SQL development for automation and detailed analysis,...


  • Colombia Cinte Colombia SAS A tiempo completo

    Descripción del Puesto Buscamos un Desarrollador Python Senior para unirse a nuestro equipo en Cinte Colombia SAS. Requisitos del Candidato Para este puesto, buscamos un profesional con experiencia en desarrollo de software y conocimientos en Python 3.6, Spark, HDFS, GitHub, Jenkins y bases de datos SQL. El candidato ideal tendrá al menos 3 años de...

  • Data Engineer

    hace 3 semanas


    Colombia FindJobIT A tiempo completo

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at Neostella. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure.Key Responsibilities:Develop and manage complex SQL scripts and queries for extracting, transforming, and loading data into our data...

  • Senior Data Engineer

    hace 4 meses


    Colombia Blankfactor A tiempo completo

    It's fun to work in a company where people truly BELIEVE in what they're doing! We're committed to bringing passion and customer focus to the business. About us At Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale....

  • Senior Data Engineer

    hace 1 día


    Colombia AgileEngine, LLC A tiempo completo

    Key ResponsibilitiesWe are seeking a highly skilled Senior/Lead Data Engineer to join our team at AgileEngine, LLC. The ideal candidate will have a strong background in data engineering, with expertise in designing and developing architecture for marketing automation and CRM solution components.Must-Haves4+ years of experience with Python or Java, with...

  • Senior Data Engineer

    hace 2 días


    Colombia PayJoy Inc. A tiempo completo

    About PayJoy PayJoy is a mission-first financial service provider dedicated to helping under-served customers in emerging markets to achieve financial stability and success. We lend through our patented technology that turns a smartphone into digital collateral, and our cutting-edge machine learning, data science, and anti-fraud AI allow us to offer the...

  • Data Engineer

    hace 3 semanas


    Colombia Treehouse A tiempo completo

    We are seeking a highly motivated and detail-oriented Data Engineer to join our Colombian team. The ideal candidate possesses a strong foundation in data engineering principles and is eager to contribute to the development and maintenance of our data infrastructure. As a Data Engineer, you will work closely with many cross-functional teams to ensure the...

  • Data Engineer

    hace 3 semanas


    Colombia Treehouse A tiempo completo

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to contribute to the development and maintenance of our data infrastructure. As a Data Engineer, you will work closely with cross-functional teams to ensure the efficient and effective processing, storage, and retrieval of large volumes of data.Responsibilities:Design and implement data...

  • Data Engineer

    hace 4 meses


    Colombia Kualty A tiempo completo

    **What were looking for Data Engineer** **Responsibilities** **Experience and knowledge** - ETL processes and standard methods - Capabilities of understanding object-oriented programing - Advanced knowledge of Python - Flask / Django a Python Decorators - CI/CD - Pandas / Numpy - Significant knowledge of SQL - Database Normalization & Creation a PostGres /...