Senior Data Engineer

hace 6 meses

Bogota, Colombia Intellectsoft A tiempo completo

We are **Intellectsoft** - a digital transformation consultancy group and engineering company that delivers cutting-edge solutions for global organisations and technology startups. Since 2007, we have been helping companies and established brands reimagine their business through digitalization. We're looking for an exceptional **Senior Data Engineer** to join our team. Are you up for a challenge?

**Project description**:
A biotechnology research project that earned recognition as a trusted provider of clinical genetic testing and an ideal collaborator for developing precision medicine solutions. Patients are central to the project's mission, driving partnerships with numerous non-profit organizations to support patients and healthcare professionals in their quest for answers. The main focus - is Clinical Cancer Diagnostic; however, the project is designed to expand into additional areas such as Molecular Diagnostic Testing, Cardio Genetics, Neuro Genetics, etc

**Responsibilities**:

- Develop connectors for Kafka to streamline the syncing of updates from source data repositories.
- Establish partitioned Kafka topics to optimize the synchronization of updates to destination data marts.
- Leverage Apache Flink for crafting intricate data analytics workloads to enable real-time monitoring and transformations.
- Deploy dashboards using Datadog and Cloudwatch to uphold system health and fulfil user needs.
- Institute schema registries to uphold data governance standards while catering to diverse data requirements.
- Collaborate closely with a West Coast-based scrum team, contributing to daily pull request submissions, code reviews, documentation maintenance, backlog management, and build validation across environments within sprint cycles lasting 2-4 weeks.
- Coordinate with other scrum teams to ensure coherence on data contracts, API specifications, and deployment timelines.
- Architect database schemas with a focus on query access patterns.
- Establish and manage CI/CD pipelines using infrastructure-as-code principles.
- Transition on-premises ETL jobs from PHP to AWS Flink and Glue processes gradually.
- Work alongside QA Engineers to develop automated test suites.
- Engage with end-users to troubleshoot service interruptions and champion our data product offerings.
- Maintain vigilant oversight of data quality, promptly addressing discrepancies, latency issues, and defects.

**Requirements**:
**Must have**:

- Proficiency in Apache Kafka (preferably MSK flavour), Debezium, Python, Apache Flink or PySpark Streaming, MySQL (preferably RDS flavours), CDK or Terraform, Athena, Glue, Lambda, Appflow, HANA/4, PHP, Redis, Docker, and JavaScript.
- At least 6 years of hands-on experience collaborating within professional scrum teams or equivalent educational background.
- A minimum of 3 years of practical experience in designing and indexing relational databases.
- At least 2 years of practical experience in constructing and managing real-time data streams.
- Demonstrated proficiency with at least 1 year of experience in developing monitoring dashboards.

**Nice to have**:

- A Master’s degree in computer science, data science, mathematics, or life sciences.
- Demonstrate a foundational grasp of genomic concepts and terminology.
- Exhibit flexibility in availability.
- Demonstrate experience in constructing data APIs and providing Data as a Service.
- Showcase proficiency in integrating with SaaS platforms like SAP and Salesforce.
- Display familiarity with PHP MVC frameworks such as Symfony or express readiness to acquire such skills.
- Knowledge of Atlassian products, including Jira, Confluence, and Bamboo.
- Show proficiency in utilising system diagramming tools like Miro, LucidCharts, or Visio.

**Benefits**
- 36 paid absence days per year for the work-life balance of each specialist + 1 additional day for each following year of cooperation with the company
- Up to 10 unused absence days can be added to income after 12 months of cooperation
- Health insurance compensation
- Depreciation coverage for personal laptop usage for project needs
- Udemy courses of your choice
- Regular soft-skills training
- Excellence Сenters meetups

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia NielsenIQ A tiempo completo

    **Company Description** Join GfK and help us shape tomorrow. As an NIQ company, we are the world's leading consumer intelligence firm, delivering the Full View on consumer behavior. We work to enable manufacturers and retailers better understand what consumers really want. Our name has inspired trust for over 89 years because we take pride in discovering new...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia GfK A tiempo completo

    Country Colombia Job Family Technology We show the world what people want. Join GfK and help us shape tomorrow. As an NIQ company, we are the world's leading consumer intelligence firm, delivering the Full View on consumer behavior. We work to enable manufacturers and retailers better understand what consumers really want. Our name has inspired trust...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia UBITS A tiempo completo

    **UBITS** es el hub de educación online de habla hispana, en donde, diseñas, ejecutas y mides tu estrategia de entrenamiento. Actualmente estamos buscando a nuestro próximo Senior Data Engineer, altamente talentoso y apasionado por la tecnología para unirse a esta emocionante misión. Nos enfocamos en la gestión y análisis de datos en un entorno...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia Encora A tiempo completo

    At Encora we are looking for a great talent like you to join our team as the next Senior Data Engineer (76) Would you like to join our great team of engineers? Here we will tell you more about us and the role! **About the role**: As a Senior Data Engineer, you will be part of a highly skilled technology and agile team by supporting and developing...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia Univision communications inc A tiempo completo

    ABOUT THE ROLE & TEAM: TelevisaUnivision is the leading Spanish-language media company in the world! We’re investing in our content, our people, and our properties, which span digital, streaming, social, audio, linear and live events. We’re growing our offerings, building on the launch of our successful streaming platform ViX. The Data and Analytics...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia Multiplica Talent A tiempo completo

    **Responsibilities**: - Create and maintain optimal data pipeline architecture, - Assemble large, complex data sets that meet functional / non-functional business requirements. - Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. -...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia Univision communications inc A tiempo completo

    TelevisaUnivision is the leading Spanish-language media company in the world! We’re investing in our content, our people, and our properties, which span digital, streaming, social, audio, linear and live events. We’re growing our offerings, building on the launch of our successful streaming platform ViX. The Data Engineering team at TelevisaUnivision...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia Webcreek A tiempo completo

    Are you looking for an opportunity to join a highly-regarded IT development firm? Well, look no further! WebCreek is currently seeking a Senior Data Engineer with over three years of experience and excellent English communication skills. This role offers a 100% remote position in Latin America. **What You'll Do** - Work with the business to gather...

  • Data Engineer

    hace 6 meses

    Bogota, Colombia Evalueserve A tiempo completo

    **Elevate Your Impact Through Innovation and Learning** Evalueserve is a global leader in delivering innovative and sustainable solutions to a diverse range of clients, including over 25% of Fortune 500 companies. Clients include Amazon, Deutsche Bank, Johnson & Johnson, McDonald's, Microsoft, Morgan Stanley, Nestlé, Novo Nordisk, and Procter & Gamble. We...

  • Senior Analyst

    hace 6 meses

    Bogota, Colombia Evalueserve A tiempo completo

    **Elevate Your Impact Through Innovation and Learning** We have 4,500+ talented professionals operating across 45 countries, including India, China, Chile, Romania, the US, and Canada. Our global network also extends to emerging markets such as Colombia, the Middle East and the rest of Asia-Pacific. Recognized by Great Place to Work in India, Chile,...

  • Data Center Ops Senior Associate

    hace 6 meses

    Bogota, Colombia NTT DATA A tiempo completo

    **Req ID**: 250918 We are currently seeking a Data Center Ops Senior Associate to join our team in BOGOTA D.C., Distrito Capital de Bogotá (CO-DC), Colombia (CO).- - Proveer el Soporte y gestión a los requerimientos elevados por los países en sus operaciones en línea y en Batch, por Correo, Teléfono o Casos Service now. - Dar respuesta a los...

  • Data Center Ops Senior Associate

    hace 6 meses

    Bogota, Colombia NTT DATA A tiempo completo

    **Req ID**: 278244 We are currently seeking a Data Center Ops Senior Associate to join our team in BOGOTA D.C., Distrito Capital de Bogotá (CO-DC), Colombia (CO). **Resumen** Realizar la ejecución de los trabajos diarios y de cierre del back end de nuestro cliente del sector financiero. **Responsabilidades** - Proveer el Soporte y gestión a los...

  • Data Center Ops Senior Associate

    hace 3 meses

    Bogota, Colombia NTT DATA A tiempo completo

    **Req ID**: 250918We are currently seeking a Data Center Ops Senior Associate to join our team in BOGOTA D.C., Distrito Capital de Bogotá (CO-DC), Colombia (CO).-- Proveer el Soporte y gestión a los requerimientos elevados por los países en sus operaciones en línea y en Batch, por Correo, Teléfono o Casos Service now.- Dar respuesta a los requerimientos...

  • Data Center Ops Senior Associate

    hace 3 meses

    Bogota, Colombia NTT DATA A tiempo completo

    **Req ID**: 278244We are currently seeking a Data Center Ops Senior Associate to join our team in BOGOTA D.C., Distrito Capital de Bogotá (CO-DC), Colombia (CO).**Resumen**Realizar la ejecución de los trabajos diarios y de cierre del back end de nuestro cliente del sector financiero.**Responsabilidades**- Proveer el Soporte y gestión a los requerimientos...

  • Data Engineer

    hace 6 meses

    Bogota, Colombia Capgemini Engineering A tiempo completo

    **Data Processing Engineer**: RESPONSIBILITIES - Work with multiple databases, including SQL and Couchbase, to store and manage data efficiently. Implement and work with real-time data streaming systems using Kafka. - REQUIRED SKILLS- Bachelor of Science in Engineering education. - English level B2 - 2+ years of experience with Python, Multiple DBs: SQL,...

  • Data Engineer

    hace 6 meses

    Bogota, Colombia Capgemini Engineering A tiempo completo

    **Data Processing Engineer**: RESPONSIBILITIES - Work with multiple databases, including SQL and Couchbase, to store and manage data efficiently. Implement and work with real-time data streaming systems using Kafka. - REQUIRED SKILLS - Bachelor of Science in Engineering education. - English level B2 - 2+ years of experience with Python, Multiple DBs: SQL,...

  • Data Engineer Senior

    hace 6 meses

    Bogota, Colombia STEFANINI LATAM A tiempo completo

    ¡Sé parte de Stefanini! En Stefanini somos más de 30.000 genios, conectados desde 41 países, haciendo lo que les apasiona y co-creando un futuro mejor. ¡Se nuestro Data Engineer Senior! **Responsabilidades y atribuciones** **Responsabilidades**: - Conocer y dominar los servicios y productos de la nube, especialmente los relacionados con el...

  • Data Engineer

    hace 6 meses

    Bogota, Colombia Univision communications inc A tiempo completo

    The Data Engineering team at VIX Streaming is looking for a Data Engineer to join our team! We are looking for an experienced data engineer that will be working in the streaming organization and interacting with both internal data engineering and analytics teams and external enterprise data engineering teams to build next generation data solutions on the...

  • Senior Manager

    hace 6 meses

    Bogota, Colombia Evalueserve A tiempo completo

    **Elevate Your Impact Through Innovation and Learning**We have 4,500+ talented professionals operating across 45 countries, including India, China, Chile, Romania, the US, and Canada. Our global network also extends to emerging markets such as Colombia, the Middle East and the rest of Asia-Pacific.Recognized by Great Place to Work in India, Chile, Romania,...

  • Data Engineer Senior

    hace 3 meses

    Bogota, Colombia STEFANINI LATAM A tiempo completo

    ¡Sé parte de Stefanini!En Stefanini somos más de 30.000 genios, conectados desde 41 países, haciendo lo que les apasiona y co-creando un futuro mejor.¡Se nuestro Data Engineer Senior!**Responsabilidades y atribuciones****Responsabilidades**:- Conocer y dominar los servicios y productos de la nube, especialmente los relacionados con el almacenamiento,...