pyspark

CI&T Colombia is seeking a talented Data Developer to design, build, and optimize scalable data pipelines and lake architectures that empower data-driven decision making across the organization.The role emphasizes strong Python and PySpark coding, SQL mastery, and cloud expertise in AWS. You will work with AWS Glue, Athena, Redshift, and Delta Lake,...

Job Description Design, build, and maintain end-to-end data pipelines for ingestion, transformation, and delivery of large‑scale data. Develop and optimize data processing logic using PySpark on Databricks (Apache Spark). Implement ETL/ELT pipelines integrating data from multiple structured and semi‑structured sources. Contribute to the design and...

AgileEngine is seeking a Data Engineer to build batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy workloads to a governed Lakehouse and implement robust data quality and governance controls. You will model a bronze/silver/gold medallion architecture for analytics and ML use cases, optimize Spark jobs, and...

AgileEngine is seeking a Data Engineer to build batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy workloads to a governed Lakehouse and implement robust data quality and governance controls. You will model a bronze/silver/gold medallion architecture for analytics and ML use cases, optimize Spark jobs, and...

Tata Consultancy Services is seeking a Big Data Engineer to join the technology team in Colombia. This position entails designing, developing, and optimizing large-scale data processing solutions using modern Big Data technologies like PySpark and Scala. Key responsibilities include implementing real-time data ingestion pipelines, collaborating with global...

AgileEngine is seeking a Data Engineer to build batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy workloads to a governed Lakehouse and implement robust data quality and governance controls. You will model a bronze/silver/gold medallion architecture for analytics and ML use cases, optimize Spark jobs, and...

AgileEngine is seeking a Data Engineer to build batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy workloads to a governed Lakehouse and implement robust data quality and governance controls.You will model a bronze/silver/gold medallion architecture for analytics and ML use cases, optimize Spark jobs, and...

INGEPSY busca un/a Data Engineer con 1–3 años de experiencia para proyectos de datos, con foco en entornos Cloud y AWS. Se valoran ETL, SQL y Data Lake/Data Warehouse, con Lakehouse como plus.Se ofrece teletrabajo, formación técnica y de idiomas, y oportunidades de crecimiento en proyectos de datos y Big Data. Se valoran habilidades de comunicación y...

Softtek busca un Ingeniero de Sistemas con al menos 5 años de experiencia en tecnología. Se requiere una certificación en Azure o AWS y experiencia en administración de bases de datos en la nube pública Azure.El candidato ideal debe tener conocimientos en lenguajes como SQL, Python y no ser ajeno a flujos CICD. Esta es una gran oportunidad para trabajar...

A consulting firm in Colombia is seeking a skilled Data Engineer at the mid-senior level. The ideal candidate will have over 5 years of hands-on experience with Azure Databricks, Spark, and proficient coding in Python and SQL. Responsibilities include developing data processing pipelines, maintaining data lake architecture, and ensuring data quality. This...

Perficient is seeking a Data Engineer to design, build, and operate end-to-end data pipelines using PySpark on Databricks. You will implement ETL/ELT pipelines, contribute to lakehouse architectures, and ensure data quality and observability across large-scale systems.You will collaborate with data architects, analysts, and stakeholders to translate...

Bluelight Consulting, Llc is seeking an ETL Data Engineer to join our expanding data engineering team. You will design, develop, and maintain data integration pipelines using Python (PySpark) and Azure Synapse Analytics to ensure accurate and available analytical data for stakeholders.Collaborate with data scientists and analysts, optimize ETL...

About the Role We are searching for a skilled Data Engineer to join our team. The ideal candidate will have hands‑on experience in development and production implementation with Azure Databricks and Spark, proficiency in Python (PySpark) and SQL coding, and a strong understanding of data lake architecture, ETL processes, and data quality management....

INGEPSY busca un líder de Data & Analytics para dirigir el desarrollo e implementación de soluciones orientadas al negocio en Colombia. Se trabajará traduciendo necesidades en problemas analíticos y diseñando estrategias para su resolución, con foco en generar insights accionables.El candidato ideal posee más de 5 años de experiencia, dominio de...

Information Workers S.A.S. busca un/a Ingeniero/a de datos con experiencia en diseño de arquitecturas de datos y herramientas de BI para Colombia. El rol requiere conocimiento en Data Warehouse/Lakehouse, Databricks y PySpark, además de habilidades en modelado de datos y orquestación.Se valoran plataformas cloud y fundamentos de ciencia de datos,incluida...

Sprocket International Group en Medellín busca un Ingeniero de Machine Learning (MLOps) presencial, con inglés avanzado, para llevar modelos de ML de notebooks a producción y escalar la infraestructura.El/la candidato/a trabajará con Databricks, PySpark y MLflow, diseñará pipelines batch y en tiempo real, y colaborará con Data Scientists para...

TALYCAP GLOBAL SAS busca un Líder Técnico Data para dirigir la migración de procesos y pipelines de Pentaho hacia Databricks, diseñando y optimizando flujos con PySpark y Delta Lake.Se requiere mínimo 2 años de experiencia con Databricks y liderazgo técnico en iniciativas de datos, integrando SQL Server y APIs REST dentro de una arquitectura de datos...

Sii Group Colombia busca un(a) Desarrollador(a) de Soluciones Geoespaciales para un proyecto internacional en el sector tecnología. Diseñar y desarrollar soluciones geoespaciales utilizando plataformas ESRI y tecnologías cloud, gestionando integración y procesamiento de datos geográficos en arquitecturas serverless.Colaborar con equipos...

¡Buscamos Machine Learning Engineer (MLOps) en Medellín! | Presencial | Inglés requerido ¿Te apasiona llevar modelos de Machine Learning del notebook a producción? ¿Te frustra ver despliegues manuales y quieres automatizarlo todo? ¡Esta vacante es para ti! Nos une una empresa tecnológica SaaS que usa inteligencia artificial para pronosticar la...

BairesDev is seeking a Data Engineer specialized in Databricks to design and maintain scalable data pipelines for analytics-ready datasets, using lakehouse architectures to ensure data quality. The role focuses on end-to-end ETL pipelines with PySpark and SQL, collaborating with data scientists, and ensuring robust production deployments with monitoring and...