Senior Data Engineer

Encontrado en: Talent CO C2 - hace 2 días


Bogotá, Colombia Intellectsoft A tiempo completo

We are Intellectsoft - a digital transformation consultancy group and engineering company that delivers cutting-edge solutions for global organisations and technology startups. Since 2007, we have been helping companies and established brands reimagine their business through digitalization. We're looking for an exceptional Senior Data Engineer to join our team. Are you up for a challenge?

Project description:

A biotechnology research project that earned recognition as a trusted provider of clinical genetic testing and an ideal collaborator for developing precision medicine solutions. Patients are central to the project's mission, driving partnerships with numerous non-profit organizations to support patients and healthcare professionals in their quest for answers. The main focus - is Clinical Cancer Diagnostic; however, the project is designed to expand into additional areas such as Molecular Diagnostic Testing, Cardio Genetics, Neuro Genetics, etc

Responsibilities:

  1. Develop connectors for Kafka to streamline the syncing of updates from source data repositories.
  2. Establish partitioned Kafka topics to optimize the synchronization of updates to destination data marts.
  3. Leverage Apache Flink for crafting intricate data analytics workloads to enable real-time monitoring and transformations.
  4. Deploy dashboards using Datadog and Cloudwatch to uphold system health and fulfil user needs.
  5. Institute schema registries to uphold data governance standards while catering to diverse data requirements.
  6. Collaborate closely with a West Coast-based scrum team, contributing to daily pull request submissions, code reviews, documentation maintenance, backlog management, and build validation across environments within sprint cycles lasting 2-4 weeks.
  7. Coordinate with other scrum teams to ensure coherence on data contracts, API specifications, and deployment timelines.
  8. Architect database schemas with a focus on query access patterns.
  9. Establish and manage CI/CD pipelines using infrastructure-as-code principles.
  10. Transition on-premises ETL jobs from PHP to AWS Flink and Glue processes gradually.
  11. Work alongside QA Engineers to develop automated test suites.
  12. Engage with end-users to troubleshoot service interruptions and champion our data product offerings.
  13. Maintain vigilant oversight of data quality, promptly addressing discrepancies, latency issues, and defects.

Requirements

Must have:

  • Proficiency in Apache Kafka (preferably MSK flavour), Debezium, Python, Apache Flink or PySpark Streaming, MySQL (preferably RDS flavours), CDK or Terraform, Athena, Glue, Lambda, Appflow, HANA/4, PHP, Redis, Docker, and JavaScript.
  • At least 6 years of hands-on experience collaborating within professional scrum teams or equivalent educational background.
  • A minimum of 3 years of practical experience in designing and indexing relational databases.
  • At least 2 years of practical experience in constructing and managing real-time data streams.
  • Demonstrated proficiency with at least 1 year of experience in developing monitoring dashboards.

Nice to have:

  • A Master’s degree in computer science, data science, mathematics, or life sciences.
  • Demonstrate a foundational grasp of genomic concepts and terminology.
  • Exhibit flexibility in availability.
  • Demonstrate experience in constructing data APIs and providing Data as a Service.
  • Showcase proficiency in integrating with SaaS platforms like SAP and Salesforce.
  • Display familiarity with PHP MVC frameworks such as Symfony or express readiness to acquire such skills.
  • Knowledge of Atlassian products, including Jira, Confluence, and Bamboo.
  • Show proficiency in utilising system diagramming tools like Miro, LucidCharts, or Visio.

Benefits

  • 36 paid absence days per year for the work-life balance of each specialist + 1 additional day for each following year of cooperation with the company
  • Up to 10 unused absence days can be added to income after 12 months of cooperation
  • Health insurance compensation
  • Depreciation coverage for personal laptop usage for project needs
  • Udemy courses of your choice
  • Regular soft-skills training
  • Excellence Сenters meetups

  • Senior Data Engineer

    Encontrado en: Talent CO C2 - hace 4 días


    Bogotá, Colombia GfK A tiempo completo

    Description Next time you go shopping, think about this: What if brands asked for your opinion on their products before they put them on the shelf? Wouldn't that be nice? At  Netquest  we give voice to the consumers enabling them to shape the products and services of tomorrow. How? We deliver consumers' genuine opinions and data to help companies...

  • Senior Data Engineer

    Encontrado en: Talent CO 2A C2 - hace 5 días


    Bogotá, Colombia CoverWallet A tiempo completo

    Volvemos a la carga con nuestros amigos deCoverWalletpara ayudarles a incorporar a sus filas un/a Senior Data Engineer.Por si no les conoces aún, sonuna plataforma online de gestión de seguros enfocada a PYMES que tiene como objetivo simplificar la forma en que las empresas gestionan sus pólizas de seguros a nivel mundial.Actualmente, operan enUSA,...

  • Senior Data Engineer

    Encontrado en: Talent CO C2 - hace 2 días


    Bogotá, Colombia Intellectsoft A tiempo completo

    We are Intellectsoft - a digital transformation consultancy group and engineering company that delivers cutting-edge solutions for global organisations and technology startups. Since 2007, we have been helping companies and established brands reimagine their business through digitalization. We're looking for an exceptional Senior Data Engineer to join our...

  • Senior Analyst

    Encontrado en: Talent CO C2 - hace 5 días


    Bogotá, Colombia Evalueserve A tiempo completo

    Elevate Your Impact Through Innovation and LearningEvalueserve is a leading global company that develops innovative and sustainable solutions for a wide range of clients, including more than 30% of the Fortune 500 companies. With a presence in more than 45 countries across five continents, we excel in leveraging state-of-the-art technology, domain-specific...

  • Senior Data Engineer

    Encontrado en: Talent CO 2A C2 - hace 4 días


    Bogotá, Colombia Blankfactor LLC A tiempo completo

    It's fun to work in a company where people truly BELIEVE in what they're doing!We're committed to bringing passion and customer focus to the business.What we doAt Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale. In...

  • Senior Manager

    Encontrado en: Talent CO C2 - hace 5 días


    Bogotá, Colombia Evalueserve A tiempo completo

    Elevate Your Impact Through Innovation and LearningEvalueserve is a leading global company that develops innovative and sustainable solutions for a wide range of clients, including more than 30% of the Fortune 500 companies. With a presence in more than 45 countries across five continents, we excel in leveraging state-of-the-art technology, domain-specific...

  • Data Engineer

    Encontrado en: Talent CO 2A C2 - hace 4 días


    Bogotá, Colombia ServiceTitan, Inc. A tiempo completo

    Play a pivotal role as a Data Engineer. Enterprise Data Engineering is part of the Data Services team. The Data Engineering team builds database solutions for various enterprise use cases including analytics, data science, and financial reporting.We want data to be at the core of everything that the company does. This is an exciting role for an engineer to...

  • Consultant - Data Engineer

    Encontrado en: Talent CO C2 - hace 4 días


    Bogotá, Colombia Evalueserve A tiempo completo

    Elevate Your Impact Through Innovation and Learning Evalueserve is a leading global company that develops innovative and sustainable solutions for a wide range of clients, including more than 30% of the Fortune 500 companies. With a presence in more than 45 countries across five continents, we excel in leveraging state-of-the-art technology, domain-specific...

  • Data Engineer

    Encontrado en: Talent CO 2A C2 - hace 5 días


    Bogotá, Colombia AES Corporation A tiempo completo

    We are looking for aData Engineerto join our Team at AES.Data engineers work in a variety of settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Their goal is to make data accessible so that organizations can use it to evaluate and optimize their performance.As...

  • Data Engineer

    Encontrado en: Talent CO 2A C2 - hace 4 días


    Bogotá, Colombia Middle Seat A tiempo completo

    Middle Seat is a full-service media and fundraising firm. We support progressive campaigns, organizations, and causes fighting for racial justice, climate action, immigrant rights, intersectional feminism, economic justice, and more. Our work includes advertising, fundraising, development, creative, organizing, and strategy.We are a proudly unionized team...

  • Senior Full Stack Engineer

    Encontrado en: Talent CO 2A C2 - hace 11 horas


    Bogotá, Colombia Cryptostart A tiempo completo

    Active 1 week agoSenior Full Stack EngineerActively looking Senior Full Stack Engineer with over a decade of experience in web/app and blockchain development. Proficient in Python, C#, and their related frameworks, with extensive knowledge of blockchain techno...See moreCurrent Location:La Plata, ColombiaLanguages:English (United...

  • Senior Frontend Software Engineer

    Encontrado en: Talent CO 2A C2 - hace 1 día


    Bogotá, Colombia Univision communications inc A tiempo completo

    Senior Applications Engineer page is loadedSenior Applications EngineerApplylocationsBogota - Calle 100 No. 19A-10time typeFull timeposted onPosted 2 Days Agojob requisition idR016126TelevisaUnivision is the leading Spanish-language media company in the world! We’re investing in our content, our people, and our properties, which span digital, streaming,...

  • Data Engineer

    Encontrado en: beBee S CO - hace 3 semanas


    Bogotá, Colombia Publicis Groupe A tiempo completo

    Company DescriptionAt Publicis Global Delivery, we are looking for a Data Engineer fluent in English fluent in English to join our Data Analytics Hub at Publicis Global Delivery, our talent powerhouse, the global interconnected network that provide offshore & nearshore solutions for our partners - sister companies´ business worldwide. 🌍We are a never...

  • Senior Data Engineer

    Encontrado en: Talent CO 2A C2 - hace 5 días


    Bogotá, Colombia FullStack Labs Inc. A tiempo completo

    FullStack is the fastest-growing software consultancy in the Americas. We help organizations like Uber, GoDaddy, MGM, Siemens, and Stanford University build distributed software development teams, and deliver transformational digital solutions. As an employee-first company, we focus on hiring the most talented software designers and developers in the western...

  • Data Engineer

    Encontrado en: Talent CO 2A C2 - hace 4 días


    Bogotá, Colombia Treehouse A tiempo completo

    We are seeking a highly motivated and detail-oriented Data Engineer to join our Colombian team. The ideal candidate possesses a strong foundation in data engineering principles and is eager to contribute to the development and maintenance of our data infrastructure. As a Data Engineer, you will work closely with many cross functional teams to ensure the...

  • Senior Software Engineer

    Encontrado en: beBee jobs CO - hace 5 días


    Bogotá, Bogotá D.E., Colombia T-mapp Jobs A tiempo completo

    A recognized company in the health technology sector in the United States is searching for its Senior Software Engineer Bilingual in a fully remote modality to revolutionize health research.Why apply for this position?Opportunity to be part of a well-funded startup in its early stages, at the forefront of changing the nature of health care for the...

  • Senior Software Engineer

    Encontrado en: beBee S CO - hace 4 días


    Bogotá, Colombia T-mapp Jobs A tiempo completo

    A recognized company in the health technology sector in the United States is searching for its Senior Software Engineer Bilingual in a fully remote modality to revolutionize health research. Why apply for this position? Opportunity to be part of a well-funded startup in its early stages, at the forefront of changing the nature of health care for the...

  • Senior Software Engineer

    Encontrado en: Talent CO C2 - hace 2 días


    Bogotá, Colombia T-mapp Jobs A tiempo completo

    A recognized company in the health technology sector in the United States is searching for its Senior Software Engineer Bilingual in a fully remote modality to revolutionize health research.Why apply for this position?Opportunity to be part of a well-funded startup in its early stages, at the forefront of changing the nature of health care for the...

  • Consultant - Snowflake Architect Data Engineer

    Encontrado en: Talent CO C2 - hace 5 días


    Bogotá, Colombia Evalueserve A tiempo completo

    Elevate Your Impact Through Innovation and LearningEvalueserve is a leading global company that develops innovative and sustainable solutions for a wide range of clients, including more than 30% of the Fortune 500 companies. With a presence in more than 45 countries across five continents, we excel in leveraging state-of-the-art technology, domain-specific...

  • Software Engineer, L3

    Encontrado en: Talent CO 2A C2 - hace 1 día


    Bogotá, Colombia Remoote A tiempo completo

    ApplySoftware Engineer, L3ColombiaTechnologyAWSJavaRequirements: 5+ years of experience in designing distributed systems, Java expertise, AWS experience, on-call experience Responsibilities: Design and build scalable distributed systems, mentor junior engineers, collaborate with cross-functional teamsRelated JobsApplyJava Fullstack Software Engineer...