Big Data Specialist

hace 3 días


Medellín, Antioquia, Colombia Sombra Inc. A tiempo completo
Key Responsibilities

The successful candidate will be responsible for:

  1. Designing and developing robust data processing pipelines using big data technologies such as Spark, Hadoop, Airflow, NiFi, and Kafka.
  2. Building batch and real-time data pipelines leveraging cloud-based data platforms such as Snowflake, Databricks, AWS, Azure, or GCP.
  3. Collaborating with data architects to review solutions and data models, ensuring adherence to best practices.
  4. Implementing data quality standards while collaborating with governance teams to ensure compliance with data policies.
  5. Troubleshooting and resolving data integration and processing issues.
Requirements

To be considered for this role, you must have:

  • 3-5 years of experience building batch and real-time data pipelines leveraging big data technologies.
  • Experience with big data technologies and distributed data processing tools like Spark, Hadoop, Airflow, NiFi, and Kafka.
  • Hands-on experience designing, developing, and maintaining ETL processes and data pipelines.
  • Proficiency in Python and/or Scala, with the ability to optimize data processing scripts.


  • Medellín, Antioquia, Colombia Experis A tiempo completo

    de la ofertaImportante empresa del sector de servicios de telecomunicaciones, requiere para su equipo de trabajo Ingeniero/a con experiência de 3 años en análisis, diseño y desarrollo de aplicaciones de BI & Big DataDebe ser ingeniero/a en sistemas, electrónico/a, telecomunicaciones, software o a fines.Debe contar con manejo de ingles - altoFunciones:-...

  • Big Data Engineer

    hace 5 días


    Medellín, Antioquia, Colombia Kiwibot A tiempo completo

    About the RoleKiwibot is an innovative adtech startup that relies on data-driven insights to drive business growth. As a Data Engineer, you will play a critical role in leading and contributing to data projects that align with our business objectives.Key Responsibilities:Design and develop scalable data architectures that meet the needs of cross-functional...


  • Medellín, Antioquia, Colombia Sombra A tiempo completo

    Required Skills and QualificationsTo be successful in this role, you will need to possess the following skills and qualifications:Key Responsibilities:Work with business stakeholders to understand data requirements and deliver scalable data solutions.Design and implement ETL processes to extract, transform, and load data from various sources into our data...


  • Medellín, Antioquia, Colombia Endava Limited A tiempo completo

    Empower your career at Endava Limited. We are a global company that combines world-class engineering, industry expertise, and a people-centric mindset to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.About Us:We have been harnessing technology to drive meaningful change for over two decades. Our...


  • Medellín, Antioquia, Colombia Sombra A tiempo completo

    Company OverviewSombra is a cutting-edge fintech company focused on creating and maintaining banking platforms for users. With over 10,000 employees, our platforms serve both internal staff and clients seeking to invest in one of Canada's largest banks.Job DescriptionWe are seeking a skilled Data Engineer to join our data engineering team. As a key member,...


  • Medellín, Antioquia, Colombia Prove Fabrica A tiempo completo

    ACERCA DE LA VACANTEFunciones del Puesto- Las inherentes al puestoRequisitos del Puesto- Profesional o egresado en ingeniería industrial- Experiência mínima de 1.5 años en reingeniería de procesos, mejora de proceso y rediseño de KPI - OKR, manejo de Big Data y minería de datos- Conocimientos avanzados en Excel, Power BI y estructuración de procesos-...

  • Cloud Data Specialist

    hace 5 días


    Medellín, Antioquia, Colombia Kiwibot A tiempo completo

    Job RequirementsTo succeed as a Data Engineer at Kiwibot, you should have:4+ years of experience in data processing, pipeline development, and related domains.Proficiency in Python and SQL.Experience with data modeling, warehousing, streaming, and building ETL/ELT pipelines in cloud environments (preferably on AWS).Ability to visualize and explain complex...


  • Medellín, Antioquia, Colombia Endava Limited A tiempo completo

    Innovate with us at Endava Limited. We combine world-class engineering, industry expertise, and a people-centric mindset to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.Our Data Team:We have expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence,...


  • Medellín, Antioquia, Colombia Inversiones La Vaquita Express A tiempo completo

    En inversiones Vaquita Express, queremos contar con el mejor talento, por eso nos encontramos en la búsqueda de nuestro próximo "Gestor Big Data y Planeación Financiera".Objetivo del cargo:Analizar e interpretar permanentemente las bases de datos generadas en Inversiones Vaquita Express.Con el objetivo de presentar información útil, veraz, precisa y...

  • Tipalti | Legal Tech

    hace 2 semanas


    Medellín, Antioquia, Colombia Sd Solutions A tiempo completo

    On behalf of Tipalti , SD Solutions is looking for a talented Legal Tech & Data Specialist to step onto a fintech unicorn rocketshipAs a Legal Tech & Data Specialist, you will play a pivotal role in managing and optimizing the legal department's technology platforms while leveraging data analytics and classification to drive efficiency and compliance.This...

  • Tipalti | Legal Tech

    hace 3 semanas


    Medellín, Antioquia, Colombia Sd Solutions A tiempo completo

    On behalf of  Tipalti , SD Solutions is looking for a talented  Legal Tech & Data Specialist  to step onto a fintech unicorn rocketshipSD Solutions is a staffing company operating globally.Contact us to get more details about the benefits we offer.As a Legal Tech & Data Specialist, you will play a pivotal role in managing and optimizing the...


  • Medellín, Antioquia, Colombia ENGINEERINGUK A tiempo completo

    Our Mission:We enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers.With deep heritage and expertise in retail - one of the world's most competitive markets, with a deluge of multi-dimensional data - dunnhumby today enables businesses all over the world, across industries, to be Customer First.


  • Medellín, Antioquia, Colombia Recurly, Inc. A tiempo completo

    About Recurly, Inc.We are a subscription management platform that empowers businesses to harness the power of recurring revenue growth. Our platform is used by market-leading brands worldwide, with thousands of companies across 55 countries relying on us to manage their entire subscription lifecycle.As an analytics engineer at Recurly, you will play a key...


  • Medellín, Antioquia, Colombia Arroyo Consulting A tiempo completo

    We are seeking a skilled ETL Consultant to join our team at Arroyo Consulting, specializing in data extraction, transformation, and loading (ETL) processes. The ideal candidate will have strong experience in ETL workflows, data mapping, and working with HR systems.Key ResponsibilitiesDesign and develop ETL processes to extract data from multiple...


  • Medellín, Antioquia, Colombia Iris Neofinanciera A tiempo completo

    Datos y Transformación DigitalLa transformación digital requiere profesionales apasionados por los datos. En Iris Neofinanciera, buscamos un Ingeniero de Datos que ayude a mejorar nuestros procesos.Detalles de la posición:Desarrollar soluciones efectivas para problemas complejos.Orientarse hacia el cliente y las necesidades del negocio.Aumentar la...

  • Data Engineer

    hace 2 semanas


    Medellín, Antioquia, Colombia Applaudo A tiempo completo

    Job Description About you You are someone who wants to influence your own development.You're looking for a company where you have the opportunity to pursue your interests and grow professionally.You bring to Applaudo the following competencies: Bachelor's degree or higher in Computer Science, Computer Engineering, related fields, or equivalent...

  • Data Engineer

    hace 4 días


    Medellín, Antioquia, Colombia Kiwibot A tiempo completo

    As a Data Engineer at Nickelytics, you will be an integral part of a fast-paced adtech startup.You will serve as the primary technical expert, responsible for leading and contributing to data projects from inception to completion.This role is critical in designing, developing, and maintaining data architectures, ETL processes, and pipelines, often leveraging...

  • Data Engineer Junior

    hace 5 días


    Medellín, Antioquia, Colombia Iris Neofinanciera A tiempo completo

    Data Engineer Junior Palabras clave: Data Engineer SQL Server pyspark Glue studio Athena servicios en la nube Únete a Iris, la Neofinanciera de los empresarios, y sé parte de nuestra transformación digital. Buscamos un Data Engineer Junior apasionado por los datos y el desarrollo tecnológico. Ofrecemos un entorno de trabajo colaborativo...

  • Middle Data Engineer

    hace 2 días


    Medellín, Antioquia, Colombia Sombra Inc. A tiempo completo

    Fintech project, the purpose of which is to create and maintain banking platforms.Users are bank employees, which is about 10,000.Various platforms are used to serve clients of the bank who would like to invest their money in one of Canada's largest banks and also internal employees of the bank.As a key member of our data engineering team, you will play a...

  • Data Entry Specialist

    hace 7 días


    Medellín, Antioquia, Colombia Genius Sports Group A tiempo parcial

    Company OverviewGenius Sports Group is a leading provider of sports data and technology solutions. Our mission is to create a more sustainable sports data ecosystem that benefits all parties.Job DescriptionThe Junior Sports Data Entry Agent will be responsible for researching information about sporting events, managing a database, and providing post-match...