Cloud Data Engineer

hace 6 días

Bogotá, Bogotá D.E., Colombia Capgemini Engineering A tiempo completo

About Capgemini Engineering

We bring together a global team of experts to provide unique R&D and engineering services across all industries. From autonomous cars to lifesaving robots, our digital and software technology experts think outside the box to deliver innovative solutions. Join us for a career full of opportunities where you can make a difference and no two days are the same.

We are looking for an experienced ML engineer with expertise in Unity Catalog and Feature Store in Databricks to help us build and maintain a solid foundation for our data and machine learning workflows. You will work on organizing data, managing access, and enabling machine learning models to operate efficiently in production.

Key Responsibilities:

  1. Set up and manage Unity Catalog in Databricks to organize and secure data access across teams.
  2. Design and operationalize Feature Stores to support machine learning models in production.
  3. Build efficient data pipelines to process and serve features to ML workflows.
  4. Collaborate with teams using Databricks, Azure Cosmos DB, and other Azure tools to integrate data solutions.
  5. Monitor and optimize the performance of pipelines and feature stores.

Mandatory Skills:

  1. Strong experience with Unity Catalog in Databricks for managing data assets and access control.
  2. Hands-on experience working with Databricks Feature Store or similar solutions.
  3. Knowledge of building and maintaining scalable ETL pipelines in Databricks.
  4. Familiarity with Azure tools like Azure Cosmos DB and ACR.
  5. Understanding of machine learning workflows and how feature stores fit into the pipeline.
  6. Strong problem-solving skills and a collaborative mindset.
  7. Proficiency using Java (specifically Java APIM) to deploy Machine Learning Models.
  8. Proficiency in Python and Spark for data engineering tasks.
  9. Experience with monitoring tools like Splunk or Datadog to ensure system reliability.
  10. Familiarity with AKS for deploying and managing containers.

  • Data-Centric Cloud Engineer

    hace 6 días

    Bogotá, Bogotá D.E., Colombia Mechanized Ai A tiempo completo

    Job Title: Senior Cloud Backend EngineerDescriptionWe are seeking a highly skilled Senior Cloud Backend Engineer to join our team at Mechanical AI. As a Senior Cloud Backend Engineer, you will play a critical role in designing and building cloud architectures for data-centric products end-to-end.Key ResponsibilitiesDesigning and implementing cloud-based data...

  • Cloud Data Engineer

    hace 5 días

    Bogotá, Bogotá D.E., Colombia Mechanized A tiempo completo

    Job OverviewMechanized AI is a leader in AI innovation, leveraging cutting-edge technology to transform legacy systems into modern, efficient, and scalable solutions. Our team thrives on solving complex challenges and delivering innovative solutions.We are seeking a Senior Cloud Backend Engineer to help us create AI products in different clouds (Azure, GCP,...

  • Cloud Data Engineer Position

    hace 7 días

    Bogotá, Bogotá D.E., Colombia Heinsohn Business Technology A tiempo completo

    Job Overview:Innovative data solutions require a skilled Cloud Data Engineer to design, optimize, and implement scalable data pipelines with a primary focus on Google Cloud Platform (GCP). This role involves collaborating with international teams and stakeholders, requiring advanced English proficiency.

  • Cloud Data Architect

    hace 5 días

    Bogotá, Bogotá D.E., Colombia Epsilon Data Management, LLC A tiempo completo

    Job OverviewEpsilon Data Management, LLC is seeking a highly skilled Senior Backend Engineer to join its Audiences Team. This role involves creating and maintaining software solutions that process large volumes of data in the cloud. The ideal candidate will have expertise in backend technologies, cloud platforms, and databases (SQL and NoSQL).Key...

  • Cloud Data Architect

    hace 6 días

    Bogotá, Bogotá D.E., Colombia Mechanized Ai A tiempo completo

    Job OverviewMechanical AI is a pioneer in harnessing the potential of Artificial Intelligence, revolutionizing legacy systems to deliver modern, efficient, and scalable solutions. Our team thrives on solving complex challenges and delivering innovative products.Job SummaryWe are seeking a seasoned Senior Cloud Backend Engineer to spearhead the development of...

  • Cloud Data Engineer

    hace 2 semanas

    Bogotá, Bogotá D.E., Colombia Bluetab Solutions Sas A tiempo completo

    **Descripción**:Consiste en un rol técnico que participa en proyectos que involucran el despliegue de servicios de nube (previamente diseñados por un cloud data architect) que típicamente conforman esquemas de datalake/deltalake y datawarehouse en la nube, ingesta de datos, integración, transformación, aplicación de reglas de negocio y...

  • Senior Data Engineer

    hace 7 días

    Bogotá, Bogotá D.E., Colombia Heinsohn Business Technology A tiempo completo

    Heinsohn Business Technology is seeking a highly skilled Cloud Data Engineer to join our team.In this role, you will design, optimize, and implement scalable data solutions, with a primary focus on Google Cloud Platform (GCP) .The ideal candidate has solid experience in data ingestion, cloud-based data warehouses, and modern ETL/ELT tools.Advanced English...

  • Cloud Data Engineer

    hace 6 días

    Bogotá, Bogotá D.E., Colombia Endava A tiempo completo

    Company OverviewWe harness technology to drive meaningful change. For over two decades, we've been combining world-class engineering, industry expertise, and a people-centric mindset to create innovative technology solutions.Job DescriptionOur data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial...

  • Data Engineer

    hace 6 días

    Bogotá, Bogotá D.E., Colombia Factor It A tiempo completo

    En FactorIT estamos buscando a un Data Engineer que tenga capacidad para trabajar en un entorno rápido y cambiante, así como experiência en gestión de proyectos y liderazgo de equipos.¿Le pasas la voz?¿Qué esperamos de nuestro Data Engineer?Profesional en Ingeniería de Sistemas, Electrónico, de Telecomunicaciones, Teleinformática y/o afines, con...

  • Data Engineer

    hace 6 días

    Bogotá, Bogotá D.E., Colombia Wunderman Thompson Colombia A tiempo completo

    de la oferta- Rol:- Data Engineer- En Wunderman Thompson Colombia nuestra área de Technology Business crece, buscamos Data Engineer con el siguiente perfil:- Contribuir en la arquitectura e implementación de sistemas que contribuyan a la generación de eficiencias de marketing.- Construir, automatizar, robustecer y escalar** ETL pipelines.**:- Dueño de la...

  • Cloud Data Engineer Lead

    hace 3 días

    Bogotá, Bogotá D.E., Colombia Crisil A tiempo completo

    Job DescriptionWe are seeking an experienced Data Engineer – Equity Research to join our team. In this role, you will be responsible for designing and implementing data infrastructure and ETL pipelines to support our equity research department.

  • Data Engineer Expert

    hace 4 días

    Bogotá, Bogotá D.E., Colombia Bancodebogota A tiempo completo

    At Banco de Bogotá, we are seeking a highly skilled Data Engineer to lead our cloud engineering efforts. This is an excellent opportunity for a seasoned professional to drive innovation and improve our data infrastructure.About the Role:This position requires a deep understanding of cloud-based technologies and experience in leading cross-functional...

  • Data-Centric Cloud Architect

    hace 5 días

    Bogotá, Bogotá D.E., Colombia Mechanized A tiempo completo

    Requirements & QualificationsTo succeed in this role, you should have the following skills and qualifications:Experience:4+ years of industry experience as a Cloud Data Engineer/Backend Engineer.Deep experience in Python (4+ years) and Flask (2+ years).Experience with Infrastructure as Code: Pulumi, Terraform (at least 2 years).In addition, knowledge of...

  • Data Processing Specialist

    hace 5 días

    Bogotá, Bogotá D.E., Colombia Epsilon Data Management, LLC A tiempo completo

    Epsilon Data Management, LLC is a global leader in data, technology, and services for the marketing and advertising ecosystem. Our mission is to empower marketers from leading brands to engage consumers with innovative data-driven solutions. To achieve this, we rely on a team of skilled professionals who can design, build, and maintain software solutions...

  • Bogota Data Engineer

    hace 5 días

    Bogotá, Bogotá D.E., Colombia Betsson AB A tiempo completo

    About the RoleThis Data Engineer position will play a key role in contributing to the development and maintenance of our data platform. The successful candidate will have experience with modern cloud database technologies, data integration tools, and programming languages such as Python or Java.Key ResponsibilitiesMaintaining and evolving existing data...

  • Medical Data Analyst Engineer

    hace 2 días

    Bogotá, Bogotá D.E., Colombia Dispatchhealth A tiempo completo

    As a medical data analyst engineer at DispatchHealth, you'll play a key role in developing our innovative technology platform that streamlines high-quality, cost-effective healthcare delivery to patients' homes.Role Summary:This position requires a highly skilled software engineer with expertise in data analysis, machine learning, and cloud-based...

  • Senior Data Engineer

    hace 21 horas

    Bogotá, Bogotá D.E., Colombia Crisil A tiempo completo

    About the RoleWe are looking for a highly experienced Senior Data Engineer - Equity Research to co-manage our team's ETL pipelines, data engineering operations, and cloud infrastructure. Your primary focus will be on bringing data into our ecosystem from third-party vendors in a reliable manner, designing ETL pipelines to clean and transform data, and...

  • Data Engineer

    hace 1 día

    Bogotá, Bogotá D.E., Colombia Crisil A tiempo completo

    Crisil Bogota, D.C., Capital District, Colombia Data Strategy, Data Engineer – Equity Research The Team: Data Strategy is a Global team that supports the Equity Research Department and its Analysts by helping to incorporate alternative data into their research reports, combining the fundamental team's domain expertise and our team's technical skills to...

  • Senior Data Engineer Position

    hace 3 días

    Bogotá, Bogotá D.E., Colombia Blue Orange Digital A tiempo completo

    Job DescriptionWe're looking for a highly skilled Data Engineer to join our team at Blue Orange Digital. As a Data Engineer, you'll play a key role in designing and implementing data solutions that meet our clients' needs.Key ResponsibilitiesDesign and develop data ingestion pipelines, data models, and data transformations.Collaborate with cross-functional...

  • Senior Data Architect

    hace 6 días

    Bogotá, Bogotá D.E., Colombia Publicisgroupe A tiempo completo

    Data Engineering at Publicis SapientWe are seeking a highly skilled Senior Data Engineer to join our team. You will work closely with our cross-functional teams to develop and maintain ETL processes on Oracle EPM Cloud.As a Senior Data Engineer, you will design and implement reporting solutions using Oracle EPM Cloud and utilize Oracle Integration Agent for...